SFP - test and problems

Omnia hardware Omnia HW tweaks
1

Hello.

Soon I have Internet from my ISP on fiber optic cables.
I rented a media converter (FIBRAIN FMU-APA12G-E) with two SFP inserts that work of WDM technology (Bi-Di) (FTS-S12G-B35S-005 & FTS-S12G-B53Y-005) for test.

Of course, soon I checked the operation of these inserts SFP on the two media converters - operate in bridge mode. Action without a problem.

Then one of the cartridges plugged into Turris Omnia, a media converter is my “WAN”.
After connecting the fiber optic patchcord on the Omnia LED lights up on the WAN.
Unfortunately, the media converter has no connections with the Omnia. I tried to replace the pads SFP and the media converter, etc., but still no reaction to established the connection.

No led on media converter - “FXL”.

root@turris:/# i2cdump -y 5 0x50
No size specified (using byte-data access)
     0  1  2  3  4  5  6  7  8  9  a  b  c  d  e  f    0123456789abcdef
00: 03 04 01 00 00 00 00 12 00 01 01 01 0d 00 03 1e    ???....?.????.??
10: 00 00 00 00 43 49 53 43 4f 2d 46 49 42 52 41 49    ....CISCO-FIBRAI
20: 4e 20 20 20 00 00 00 00 46 54 53 53 31 32 47 42    N   ....FTSS12GB
30: 33 35 53 30 30 35 20 20 41 20 20 20 05 1e 00 c4    35S005  A   ??.?
40: 00 1a 00 00 43 49 42 31 33 30 39 32 35 31 31 33    .?..CIB130925113
50: 20 20 20 20 31 33 30 39 32 35 20 20 20 20 20 05        130925     ?
60: 2d 00 11 6d d5 bf 36 71 c2 67 bd b6 13 83 f8 0c    -.?m??6q?g??????
70: 0c 52 f0 00 00 00 00 00 00 00 00 00 62 14 b7 34    ?R?.........b??4
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00    ................
root@turris:/# cat /tmp/log/messages |grep sfp
2017-01-26T18:11:57+01:00 err sfpswitch.py[1569]: Switching NIC mode to phy-sfp.
2017-01-26T18:11:59+01:00 err sfpswitch.py[1569]: Shutting down interface eth1
2017-01-26T18:11:59+01:00 err sfpswitch.py[1569]: Bringing up interface eth1
2017-01-26T18:12:12+01:00 emerg sfpswitch.py[1569]: Called /etc/init.d/kresd start
2017-01-26T18:12:14+01:00 emerg sfpswitch.py[1569]: line not found
2017-01-26T18:12:14+01:00 emerg sfpswitch.py[1569]: DIE:
2017-01-26T18:12:14+01:00 emerg sfpswitch.py[1569]: [string "transaction"]:351: No journal to recover
2017-01-26T18:12:14+01:00 emerg sfpswitch.py[1569]: Aborted
2017-01-26T18:12:16+01:00 emerg sfpswitch.py[1569]: setting up led Auto-configuration for PCI1
2017-01-26T18:12:16+01:00 emerg sfpswitch.py[1569]: setting up led Auto-configuration for PCI2
2017-01-26T18:12:16+01:00 emerg sfpswitch.py[1569]: setting up led Auto-configuration for PCI3
2017-01-26T18:18:55+01:00 err sfpswitch.py[1569]: Switching NIC mode to phy-def.
2017-01-26T18:18:56+01:00 err sfpswitch.py[1569]: Shutting down interface eth1
2017-01-26T18:18:56+01:00 err sfpswitch.py[1569]: Bringing up interface eth1
2017-01-26T18:18:59+01:00 err sfpswitch.py[1569]: Switching NIC mode to phy-sfp.
2017-01-26T18:19:00+01:00 err sfpswitch.py[1569]: Shutting down interface eth1
2017-01-26T18:19:00+01:00 err sfpswitch.py[1569]: Bringing up interface eth1
root@turris:/# dmesg |grep eth1
[   26.642290] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   28.372632] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   30.126585] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[  427.120619] mvneta f1034000.ethernet eth1: Link is Up - 1Gbps/Full - flow control off
[  427.120640] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[  429.123837] mvneta f1034000.ethernet eth1: Link is Down
[  447.120634] mvneta f1034000.ethernet eth1: Link is Up - 1Gbps/Full - flow control off
[  448.102011] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[  451.386702] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready

Is anyone able to help me?

2

Hi!

Just to be sure… The link is up, the line from log

eth1: Link is Up - 1Gbps/Full

popped up (right) after inserting fiber into the SFP but you can’t see any incomming packets, am I right? (Can you please run tcpdump on eth1 to see whether there are at least outgoing packets?)

Do you know what is on the other side of the router? Or even read counters when the Omnia is connected there so we can see whether there are some packets in any direction?

3

Yes.

tcpdump:

root@turris:/# tcpdump -n -i eth1 -p -A -vv
tcpdump: WARNING: eth1: no IPv4 address assigned
tcpdump: listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes
19:35:58.577446 IP (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 328)
    0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from d8:58:d7:00:33:df, length 300, xid 0x7ce0901b, Flags [none] (0x0000)
          Client-Ethernet-Address d8:58:d7:00:33:df
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Discover
            MSZ Option 57, length 2: 576
            Parameter-Request Option 55, length 8:
              Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
              Domain-Name, BR, NTP, Option 212
            Vendor-Class Option 60, length 12: "udhcp 1.25.1"
E..H....@.y..........D.C.4E.....|........................X..3...........................................................................................................................................................................................................c.Sc5..9..@7.......*.<.udhcp 1.25.1.............................

It is when restart the media converter.

4

I moved eth1 to section LAN and still does not work:

root@turris:/# tcpdump -n -i eth1 -p -A -vv
tcpdump: WARNING: eth1: no IPv4 address assigned
tcpdump: listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes
11:38:02.782971 IP6 (hlim 1, next-header Options (0) payload length: 32) fe80::da58:d7ff:fe00:33de > ff02::1: HBH (rtalert: 0x0000) (pad1)(pad1) [icmp6 sum ok] ICMP6, multicast listener querymax resp delay: 10000 addr: ::
`.... ...........X....3.................:.........t.'...................
11:38:02.782978 IP (tos 0xc0, ttl 1, id 0, offset 0, flags [DF], proto IGMP (2), length 32, options (RA))
    0.0.0.0 > 224.0.0.1: igmp query v2
F.. ..@..................d......

as above, any information on the tcpdump gets at the time of restart media converter

media converter still does not light up LED “FXL”

Any ideas how to debug ???

5

http://pastebin.com/zdr3UajA

6

Anybody help me ?

root@turris:/# ethtool -m eth1
Cannot get module EEPROM information: Not supported

When sfp is connection:

Settings for eth1:
        Supported ports: [ TP MII ]
        Supported link modes:   1000baseT/Half 1000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: Yes
        Advertised link modes:  1000baseT/Half 1000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: Yes
        Speed: 10Mb/s
        Duplex: Half
        Port: MII
        PHYAD: 2
        Transceiver: external
        Auto-negotiation: on
        Link detected: no

When SFP is not connection:

root@turris:/# ethtool eth1
Settings for eth1:
        Supported ports: [ TP MII ]
        Supported link modes:   10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full
        Supported pause frame use: No
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full
                                100baseT/Half 100baseT/Full
                                1000baseT/Half 1000baseT/Full
        Advertised pause frame use: No
        Advertised auto-negotiation: Yes
        Speed: 1000Mb/s
        Duplex: Half
        Port: MII
        PHYAD: 1
        Transceiver: external
        Auto-negotiation: on
        Link detected: no
7

How turn off auto-negotiation on SFP ?

8 
root@turris:/# tcpdump -n -i eth1 -p -A
tcpdump: WARNING: eth1: no IPv4 address assigned
tcpdump: verbose output suppressed, use -v or -vv for full protocol decode
listening on eth1, link-type EN10MB (Ethernet), capture size 65535 bytes
14:39:18.248091 IP6 :: > ff02::16: HBH ICMP6, multicast listener report v2, 3 group record(s), length 68
`....L..................................:.........5t......................3.........................................
14:39:18.308036 IP 0.0.0.0.68 > 255.255.255.255.67: BOOTP/DHCP, Request from d8:58:d7:00:33:df, length 300
E..H....@.y..........D.C.4........Cu.....................X..3...........................................................................................................................................................................................................c.Sc5..9..@7.......*.<.udhcp 1.25.1.............................
14:39:18.498047 IP6 :: > ff02::16: HBH ICMP6, multicast listener report v2, 3 group record(s), length 68
`....L..................................:.........5t......................3.........................................
14:39:18.658038 IP6 :: > ff02::1:ff00:33df: ICMP6, neighbor solicitation, who has fe80::da58:d7ff:fe00:33df, length 24
`.....:...............................3...d..............X....3.
14:39:19.658099 IP6 fe80::da58:d7ff:fe00:33df > ff02::16: HBH ICMP6, multicast listener report v2, 4 group record(s), length 88
`....`...........X....3.................:.........P...........................................3.........................................
9

Hey.

To Turris Team:
I found a mailing list where is the question of DDM functions of January 8, 2016.
http://bird.network.cz/pipermail/bird-users/2016-January/010130.html
In practice, has already passed a year and I want to know when this option is available?

Digital diagnostics monitoring

Modern optical SFP transceivers support standard digital diagnostics monitoring (DDM) functions.[29] This feature is also known as digital optical monitoring (DOM). Modules with this capability give the end user the ability to monitor parameters of the SFP, such as optical output power, optical input power, temperature, laser bias current, and transceiver supply voltage, in real time. This functionality is commonly implemented for monitoring on routers, switches and optical transport equipment via SNMP.

Source: Wikipedia

Edit: It may be useful to you it?

10

You could try to ask your ISP to disable auto-negotionation at their end.

11

To disable auto-negotionation only on side ISP ?
In this case, I had to understand something wrong before.
I grab everything to simple configuration with two inserts SFP started as a “bridge” that is, the transfer of DHCP to Turris Omnia.
Tests only connect locally with another router.

12

Can you try to disable the auto-negotiation at that “another router”?

14

I suppose, however, is not about auto-negotiation

15

If you want to check the DOM data here’s a workaround: SFP Diagnostic (DDM/DOM)

16

Thanks, but i have a problem with this:

root@TurrisOmnia:/tmp/run/mountd/sda1/sonic_sfp# python SFP_Diagnostic.py Traceback (most recent call last): File "SFP_Diagnostic.py", line 25, in <module> eeprom_dom = read_eeprom(dom_address) File "SFP_Diagnostic.py", line 20, in read_eeprom byte = bus.read_byte_data(address, i+offset)

or

root@TurrisOmnia:/tmp/run/mountd/sda1/sonic_sfp# python3.5 SFP_Diagnostic.py
  File "SFP_Diagnostic.py", line 8
    except ImportError, e:
                      ^
SyntaxError: invalid syntax