Hi Jon, Thanks for your kind response. I see your point - one of the node having very old kernel is a risk. Atleast the TIPC link establishment part - There isn't much difference I believe. I suspect this has to do something with either the host environment or TIPC configuration.
I would like to share few observations on the tests I carried out with different kernel versions. TIPC compatibility between 1. 3.13.0-32 and 4.4.0-45 works fine . 2. 3.13.0-32 and 4.6.0-rc6 has issue similar to (3.2.0-29 <-> 4.6.0-rc6). Coming back to the original problem (3.2.0-29 and 4.6.0-rc6) - Below I am sharing TIPC message capture that happens forever without link getting to stable state. Please help if this data will hint something on the TIPC link fluctuations. ------------------------------------------------------------------------------------------------------------- 5 0.267202 1.1.6 1.1.1 TIPC 70 Link State Activate Frame 5: 70 bytes on wire (560 bits), 70 bytes captured (560 bits) Ethernet II, Src: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f), Dst: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 111. .... .... .... .... .... .... = User: Link State Maintenance Protocol (7) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0011 1000 = Message size: 56 010. .... .... .... .... .... .... .... = Message type: Activate (2) ...0 0000 0000 0000 .... .... .... .... = Sequence Gap: 0 .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0010 .... .... .... .... = Link Level Acknowledge Number: 2 .... .... .... .... 1000 0000 0000 0000 = Link Level Sequence Number: 32768 Previous Node: 1.1.6 0000 0000 0000 0000 .... .... .... .... = Next Sent Broadcast: 0 .... .... .... .... 0000 0000 0000 0001 = Next Sent Packet: 1 1101 1110 0111 0100 .... .... .... .... = Session Number: 56948 .... .... .... .... ...0 .... .... .... = Redundant Link: 0 .... .... .... .... .... 000. .... .... = Bearer identity: 0 .... .... .... .... .... ...0 1010 .... = Link Priority: 10 .... .... .... .... .... .... .... 000. = Network Plane: A (0) .... .... .... .... .... .... .... ...0 = Probe: 0 Originating Node: 1.1.6 Destination Node: 1.1.1 0000 0000 0000 0000 0000 0000 0000 0000 = Timestamp: 0 0000 0001 0111 0111 .... .... .... .... = Max Packet: 375 .... .... .... .... 0000 0101 1101 1100 = Link Tolerance (ms): 1500 6 0.267220 1.1.1 1.1.6 TIPC 70 Link State State Frame 6: 70 bytes on wire (560 bits), 70 bytes captured (560 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 111. .... .... .... .... .... .... = User: Link State Maintenance Protocol (7) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0010 1000 = Message size: 40 000. .... .... .... .... .... .... .... = Message type: State (0) ...0 0000 0000 0000 .... .... .... .... = Sequence Gap: 0 .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 1000 0000 0000 0000 = Link Level Sequence Number: 32768 Previous Node: 1.1.1 0000 0000 0000 0000 .... .... .... .... = Next Sent Broadcast: 0 .... .... .... .... 0000 0000 0000 0001 = Next Sent Packet: 1 1001 0010 1110 0111 .... .... .... .... = Session Number: 37607 .... .... .... .... ...0 .... .... .... = Redundant Link: 0 .... .... .... .... .... 000. .... .... = Bearer identity: 0 .... .... .... .... .... ...0 0000 .... = Link Priority: 0 .... .... .... .... .... .... .... 000. = Network Plane: A (0) .... .... .... .... .... .... .... ...0 = Probe: 0 Originating Node: 1.1.1 Destination Node: 1.1.6 0000 0000 0000 0000 0000 0000 0000 0000 = Timestamp: 0 0000 0000 0000 0000 .... .... .... .... = Max Packet: 0 .... .... .... .... 0000 0000 0000 0000 = Link Tolerance (ms): 0 7 0.267237 1.1.1 1.1.6 TIPC 54 Broadcast Bcast Frame 7: 54 bytes on wire (432 bits), 54 bytes captured (432 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 101. .... .... .... .... .... .... = User: Broadcast Maintenance Protocol (5) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0010 1000 = Message size: 40 000. .... .... .... .... .... .... .... = Message type: Bcast (0) .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 0000 0000 0000 0001 = Link Level Sequence Number: 1 Previous Node: 1.1.1 word 4 unused for this user 0000 0000 0000 0000 0000 0000 0000 0000 = Network Identity: 0 Originating Node: 1.1.1 Destination Node: 1.1.6 word 8 unused for this user 0000 0000 0000 0000 .... .... .... .... = Broadcast Tag: 0 8 0.267242 1.1.1 1.1.6 TIPC 174 Name Dist Publication type:0 inst:16781313 Frame 8: 174 bytes on wire (1392 bits), 174 bytes captured (1392 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...1 011. .... .... .... .... .... .... = User: Name Table Update Protocol (11) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 1010 0000 = Message size: 160 000. .... .... .... .... .... .... .... = Message type: Publication (0) .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 0000 0000 0000 0010 = Link Level Sequence Number: 2 Previous Node: 1.1.1 words 4+5 unused for this user Originating Node: 1.1.1 Destination Node: 1.1.6 0000 0000 0000 0000 0000 0000 0000 0000 = Transport Sequence No: 0 0000 0000 .... .... .... .... .... .... = Item Size: 0 0000 0000 0000 0000 0000 0000 0000 0000 = Published port name type: 0 0000 0001 0000 0000 0001 0000 0000 0001 = Lower bound of published sequence: 16781313 0000 0001 0000 0000 0001 0000 0000 0001 = Upper bound of published sequence: 16781313 0000 0000 0000 0000 0000 0000 0000 0000 = Random number part of port identity: 0 0000 0001 0000 0000 0001 0000 0000 0001 = Key (Use for verification at withdrawal): 16781313 0000 0000 0000 0000 0000 0001 0001 0100 = Published port name type: 276 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 1011 1011 0000 1111 1000 0001 0010 1110 = Random number part of port identity: 3138355502 1011 1011 0000 1111 1000 0001 0010 1111 = Key (Use for verification at withdrawal): 3138355503 0000 0000 0000 0000 0000 0001 0001 0111 = Published port name type: 279 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 0010 1100 1001 1100 0101 1011 1111 0111 = Random number part of port identity: 748444663 0010 1100 1001 1100 0101 1011 1111 1000 = Key (Use for verification at withdrawal): 748444664 0000 0000 0000 0000 0000 0001 0000 0001 = Published port name type: 257 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 1100 1111 1011 0101 1010 1000 0010 1110 = Random number part of port identity: 3484788782 1100 1111 1011 0101 1010 1000 0010 1111 = Key (Use for verification at withdrawal): 3484788783 0000 0000 0000 0000 0000 0001 0000 0100 = Published port name type: 260 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 0101 0100 1000 1010 0110 1000 0111 1010 = Random number part of port identity: 1418356858 0101 0100 1000 1010 0110 1000 0111 1011 = Key (Use for verification at withdrawal): 1418356859 0000 0000 0000 0000 0000 0001 0000 1001 = Published port name type: 265 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 0111 1100 1001 1001 1111 0000 1110 1111 = Random number part of port identity: 2090463471 0111 1100 1001 1001 1111 0000 1111 0000 = Key (Use for verification at withdrawal): 2090463472 10 0.274515 1.1.6 1.1.1 TIPC 70 Link State State Frame 10: 70 bytes on wire (560 bits), 70 bytes captured (560 bits) Ethernet II, Src: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f), Dst: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 111. .... .... .... .... .... .... = User: Link State Maintenance Protocol (7) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0011 1000 = Message size: 56 000. .... .... .... .... .... .... .... = Message type: State (0) ...0 0000 0000 0000 .... .... .... .... = Sequence Gap: 0 .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 1000 0000 0000 0000 = Link Level Sequence Number: 32768 Previous Node: 1.1.6 0000 0000 0000 0000 .... .... .... .... = Next Sent Broadcast: 0 .... .... .... .... 0000 0000 0000 0001 = Next Sent Packet: 1 1101 1110 0111 0100 .... .... .... .... = Session Number: 56948 .... .... .... .... ...0 .... .... .... = Redundant Link: 0 .... .... .... .... .... 000. .... .... = Bearer identity: 0 .... .... .... .... .... ...0 1010 .... = Link Priority: 10 .... .... .... .... .... .... .... 000. = Network Plane: A (0) .... .... .... .... .... .... .... ...1 = Probe: 1 Originating Node: 1.1.6 Destination Node: 1.1.1 0000 0000 0000 0000 0000 0000 0000 0000 = Timestamp: 0 0000 0000 0000 0000 .... .... .... .... = Max Packet: 0 .... .... .... .... 0000 0000 0000 0000 = Link Tolerance (ms): 0 Bearer Instance: base Padding: 3 bytes Filler for MTU discovery: 8 bytes 11 0.274529 1.1.1 1.1.6 TIPC 70 Link State Reset Frame 11: 70 bytes on wire (560 bits), 70 bytes captured (560 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 111. .... .... .... .... .... .... = User: Link State Maintenance Protocol (7) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0011 1000 = Message size: 56 001. .... .... .... .... .... .... .... = Message type: Reset (1) ...0 0000 0000 0000 .... .... .... .... = Sequence Gap: 0 .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 1000 0000 0000 0000 = Link Level Sequence Number: 32768 Previous Node: 1.1.1 0000 0000 0000 0000 .... .... .... .... = Next Sent Broadcast: 0 .... .... .... .... 0000 0000 0000 0001 = Next Sent Packet: 1 1001 0010 1110 1000 .... .... .... .... = Session Number: 37608 .... .... .... .... ...0 .... .... .... = Redundant Link: 0 .... .... .... .... .... 000. .... .... = Bearer identity: 0 .... .... .... .... .... ...0 0000 .... = Link Priority: 0 .... .... .... .... .... .... .... 000. = Network Plane: A (0) .... .... .... .... .... .... .... ...0 = Probe: 0 Originating Node: 1.1.1 Destination Node: 1.1.6 0000 0000 0000 0000 0000 0000 0000 0000 = Timestamp: 0 0000 0001 0111 0111 .... .... .... .... = Max Packet: 375 .... .... .... .... 0000 0000 0000 0000 = Link Tolerance (ms): 0 Bearer Instance: base Padding: 3 bytes Filler for MTU discovery: 8 bytes 12 0.274534 1.1.6 1.1.1 TIPC 634 Name Dist Publication type:0 inst:16781318 Frame 12: 634 bytes on wire (5072 bits), 634 bytes captured (5072 bits) Ethernet II, Src: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f), Dst: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...1 011. .... .... .... .... .... .... = User: Name Table Update Protocol (11) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0010 0110 1100 = Message size: 620 000. .... .... .... .... .... .... .... = Message type: Publication (0) .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0010 .... .... .... .... = Link Level Acknowledge Number: 2 .... .... .... .... 0000 0000 0000 0001 = Link Level Sequence Number: 1 Previous Node: 1.1.6 words 4+5 unused for this user Originating Node: 1.1.6 Destination Node: 1.1.1 0000 0000 0000 0000 0000 0000 0000 0000 = Transport Sequence No: 0 0000 0000 .... .... .... .... .... .... = Item Size: 0 0000 0000 0000 0000 0000 0000 0000 0000 = Published port name type: 0 0000 0001 0000 0000 0001 0000 0000 0110 = Lower bound of published sequence: 16781318 0000 0001 0000 0000 0001 0000 0000 0110 = Upper bound of published sequence: 16781318 1110 0111 0000 0011 1110 0000 0000 0001 = Random number part of port identity: 3875790849 1110 0111 0000 0011 1110 0000 0000 0010 = Key (Use for verification at withdrawal): 3875790850 0000 0000 0000 0000 0000 0001 0001 0100 = Published port name type: 276 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 0101 = Random number part of port identity: 3875782661 1110 0111 0000 0011 1100 0000 0000 0110 = Key (Use for verification at withdrawal): 3875782662 0000 0000 0000 0000 0000 0001 0001 0111 = Published port name type: 279 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 0111 = Random number part of port identity: 3875782663 1110 0111 0000 0011 1100 0000 0000 1000 = Key (Use for verification at withdrawal): 3875782664 0000 0000 0000 0000 0000 0001 0000 0001 = Published port name type: 257 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 1001 = Random number part of port identity: 3875782665 1110 0111 0000 0011 1100 0000 0000 1010 = Key (Use for verification at withdrawal): 3875782666 0000 0000 0000 0000 0000 0001 0000 0100 = Published port name type: 260 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 1011 = Random number part of port identity: 3875782667 1110 0111 0000 0011 1100 0000 0000 1100 = Key (Use for verification at withdrawal): 3875782668 0000 0000 0000 0000 0000 0001 0000 1001 = Published port name type: 265 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 1101 = Random number part of port identity: 3875782669 1110 0111 0000 0011 1100 0000 0000 1110 = Key (Use for verification at withdrawal): 3875782670 0000 0001 0000 0000 0000 0000 0000 0000 = Published port name type: 16777216 0000 0000 0000 0000 0000 0000 0000 0001 = Lower bound of published sequence: 1 0000 0000 0000 0000 0000 0000 0000 0001 = Upper bound of published sequence: 1 1110 0111 0000 0011 1100 0000 0000 1001 = Random number part of port identity: 3875782665 1110 0111 0000 0011 1100 0000 0000 1100 = Key (Use for verification at withdrawal): 3875782668 0000 0011 0000 0000 0000 0000 0000 0001 = Published port name type: 50331649 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 1001 = Random number part of port identity: 3875782665 1110 0111 0000 0011 1100 0000 0000 1101 = Key (Use for verification at withdrawal): 3875782669 0000 0000 0000 0000 0000 0001 0000 0010 = Published port name type: 258 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0001 0001 = Random number part of port identity: 3875782673 1110 0111 0000 0011 1100 0000 0001 0010 = Key (Use for verification at withdrawal): 3875782674 0000 0000 0000 0000 0000 0001 0000 0101 = Published port name type: 261 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0001 0011 = Random number part of port identity: 3875782675 1110 0111 0000 0011 1100 0000 0001 0100 = Key (Use for verification at withdrawal): 3875782676 0000 0000 0000 0000 0000 0001 0000 1100 = Published port name type: 268 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0001 0101 = Random number part of port identity: 3875782677 1110 0111 0000 0011 1100 0000 0001 0110 = Key (Use for verification at withdrawal): 3875782678 0000 0001 0000 0000 0000 0000 0000 0000 = Published port name type: 16777216 0000 0000 0000 0000 0000 0000 0000 1100 = Lower bound of published sequence: 12 0000 0000 0000 0000 0000 0000 0000 1100 = Upper bound of published sequence: 12 1110 0111 0000 0011 1100 0000 0001 0101 = Random number part of port identity: 3875782677 1110 0111 0000 0011 1100 0000 0001 1000 = Key (Use for verification at withdrawal): 3875782680 0000 0011 0000 0000 0000 0000 0000 1100 = Published port name type: 50331660 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0001 0101 = Random number part of port identity: 3875782677 1110 0111 0000 0011 1100 0000 0001 1001 = Key (Use for verification at withdrawal): 3875782681 0000 0000 0000 0000 0000 0001 0000 1110 = Published port name type: 270 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0100 0000 0000 1111 = Random number part of port identity: 3875815439 1110 0111 0000 0100 0100 0000 0001 0000 = Key (Use for verification at withdrawal): 3875815440 0000 0000 0000 0000 0000 0001 0000 0011 = Published port name type: 259 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0001 0111 = Random number part of port identity: 3875782679 1110 0111 0000 0011 1100 0000 0001 1000 = Key (Use for verification at withdrawal): 3875782680 0000 0001 0000 0000 0000 0000 0000 0000 = Published port name type: 16777216 0000 0000 0000 0000 0000 0000 0000 0100 = Lower bound of published sequence: 4 0000 0000 0000 0000 0000 0000 0000 0100 = Upper bound of published sequence: 4 1110 0111 0000 0011 1100 0000 0000 1011 = Random number part of port identity: 3875782667 1110 0111 0000 0011 1100 0000 0000 1110 = Key (Use for verification at withdrawal): 3875782670 0000 0011 0000 0000 0000 0000 0000 0100 = Published port name type: 50331652 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1100 0000 0000 1011 = Random number part of port identity: 3875782667 1110 0111 0000 0011 1100 0000 0000 1111 = Key (Use for verification at withdrawal): 3875782671 0000 0000 0000 0000 0000 0001 1000 1011 = Published port name type: 395 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0100 0000 0010 1111 = Random number part of port identity: 3875815471 1110 0111 0000 0100 0100 0000 0011 0000 = Key (Use for verification at withdrawal): 3875815472 0000 0000 0000 0000 0000 0001 1001 0100 = Published port name type: 404 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1110 0000 0010 0100 = Random number part of port identity: 3875790884 1110 0111 0000 0011 1110 0000 0010 0101 = Key (Use for verification at withdrawal): 3875790885 0000 0000 0000 0000 0000 0001 1001 0101 = Published port name type: 405 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1110 0000 0010 0011 = Random number part of port identity: 3875790883 1110 0111 0000 0011 1110 0000 0010 0100 = Key (Use for verification at withdrawal): 3875790884 0000 0000 0000 0000 0000 0001 1001 0110 = Published port name type: 406 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1110 0000 0010 1010 = Random number part of port identity: 3875790890 1110 0111 0000 0011 1110 0000 0010 1011 = Key (Use for verification at withdrawal): 3875790891 0000 0000 0000 0000 0000 0001 1001 0111 = Published port name type: 407 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1110 0000 0001 1100 = Random number part of port identity: 3875790876 1110 0111 0000 0011 1110 0000 0001 1101 = Key (Use for verification at withdrawal): 3875790877 0000 0000 0000 0000 0000 0001 1001 1000 = Published port name type: 408 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0011 1110 0000 0010 0110 = Random number part of port identity: 3875790886 1110 0111 0000 0011 1110 0000 0010 0111 = Key (Use for verification at withdrawal): 3875790887 0000 0000 0000 0000 0000 0001 1001 1011 = Published port name type: 411 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0000 0000 0010 1101 = Random number part of port identity: 3875799085 1110 0111 0000 0100 0000 0000 0010 1110 = Key (Use for verification at withdrawal): 3875799086 0000 0000 0000 0000 0000 0001 1001 1100 = Published port name type: 412 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0000 0000 0001 1001 = Random number part of port identity: 3875799065 1110 0111 0000 0100 0000 0000 0001 1010 = Key (Use for verification at withdrawal): 3875799066 0000 0000 0000 0000 0000 0001 1001 1101 = Published port name type: 413 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0000 0000 0001 1111 = Random number part of port identity: 3875799071 1110 0111 0000 0100 0000 0000 0010 0000 = Key (Use for verification at withdrawal): 3875799072 0000 0000 0000 0000 0000 0001 1001 1110 = Published port name type: 414 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0000 0000 0001 1101 = Random number part of port identity: 3875799069 1110 0111 0000 0100 0000 0000 0001 1110 = Key (Use for verification at withdrawal): 3875799070 0000 0000 0000 0000 0000 0001 1001 1111 = Published port name type: 415 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0000 0000 0010 0001 = Random number part of port identity: 3875799073 1110 0111 0000 0100 0000 0000 0010 0010 = Key (Use for verification at withdrawal): 3875799074 0000 0000 0000 0000 0000 0001 1010 0000 = Published port name type: 416 0000 0000 0000 0000 0000 0000 0000 0110 = Lower bound of published sequence: 6 0000 0000 0000 0000 0000 0000 0000 0110 = Upper bound of published sequence: 6 1110 0111 0000 0100 0100 0000 0010 0111 = Random number part of port identity: 3875815463 1110 0111 0000 0100 0100 0000 0010 1000 = Key (Use for verification at withdrawal): 3875815464 13 0.292522 1.1.6 1.1.0 TIPC 60 Ngbr Disc Request Frame 13: 60 bytes on wire (480 bits), 60 bytes captured (480 bits) Ethernet II, Src: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f), Dst: Broadcast (ff:ff:ff:ff:ff:ff) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...1 101. .... .... .... .... .... .... = User: Neighbour Discovery Protocol (13) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...1 .... .... .... .... .... = Non-sequenced: 1 .... .... .... ...0 0000 0000 0010 1000 = Message size: 40 000. .... .... .... .... .... .... .... = Message type: Request (0) .... .... 0000 0000 .... .... .... .... = Minor protocol version: 0 .... .... .... .... 0000 0000 0000 0000 = Node signature: 0 Destination Domain: 1.1.0 Previous Node: 1.1.6 0000 0000 0000 0000 0000 0100 0010 0101 = Network Identity: 1061 .... .... .... .... .... .... 0000 0001 = Media Id: 1 Bearer Level Originating Address: ec9ecd0c816f00000000000000000000 14 0.292535 1.1.1 1.1.0 TIPC 74 Ngbr Disc Response Frame 14: 74 bytes on wire (592 bits), 74 bytes captured (592 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...1 101. .... .... .... .... .... .... = User: Neighbour Discovery Protocol (13) .... ...1 111. .... .... .... .... .... = Header size: 15 = 60 bytes .... .... ...1 .... .... .... .... .... = Non-sequenced: 1 .... .... .... ...0 0000 0000 0011 1100 = Message size: 60 001. .... .... .... .... .... .... .... = Message type: Response (1) .... .... 0000 0011 .... .... .... .... = Minor protocol version: 3 .... .... .... .... 0000 1101 0100 1001 = Node signature: 3401 Destination Domain: 1.1.0 Previous Node: 1.1.1 0000 0000 0000 0000 0000 0100 0010 0101 = Network Identity: 1061 .... .... .... .... .... .... 0000 0001 = Media Id: 1 Bearer Level Originating Address: ec9ecd0b519000000000000000000000 15 0.550484 1.1.1 1.1.6 TIPC 70 Link State Reset Frame 15: 70 bytes on wire (560 bits), 70 bytes captured (560 bits) Ethernet II, Src: ArtesynE_0b:51:90 (ec:9e:cd:0b:51:90), Dst: ArtesynE_0c:81:6f (ec:9e:cd:0c:81:6f) Transparent Inter Process Communication(TIPC) 010. .... .... .... .... .... .... .... = Version: 2 ...0 111. .... .... .... .... .... .... = User: Link State Maintenance Protocol (7) .... ...1 010. .... .... .... .... .... = Header size: 10 = 40 bytes .... .... ...0 .... .... .... .... .... = Non-sequenced: 0 .... .... .... ...0 0000 0000 0011 1000 = Message size: 56 001. .... .... .... .... .... .... .... = Message type: Reset (1) ...0 0000 0000 0000 .... .... .... .... = Sequence Gap: 0 .... .... .... .... 0000 0000 0000 0000 = Broadcast Acknowledge Number: 0 0000 0000 0000 0000 .... .... .... .... = Link Level Acknowledge Number: 0 .... .... .... .... 1000 0000 0000 0000 = Link Level Sequence Number: 32768 Previous Node: 1.1.1 0000 0000 0000 0000 .... .... .... .... = Next Sent Broadcast: 0 .... .... .... .... 0000 0000 0000 0001 = Next Sent Packet: 1 1001 0010 1110 1000 .... .... .... .... = Session Number: 37608 .... .... .... .... ...0 .... .... .... = Redundant Link: 0 .... .... .... .... .... 000. .... .... = Bearer identity: 0 .... .... .... .... .... ...0 0000 .... = Link Priority: 0 .... .... .... .... .... .... .... 000. = Network Plane: A (0) .... .... .... .... .... .... .... ...0 = Probe: 0 Originating Node: 1.1.1 Destination Node: 1.1.6 0000 0000 0000 0000 0000 0000 0000 0000 = Timestamp: 0 0000 0001 0111 0111 .... .... .... .... = Max Packet: 375 .... .... .... .... 0000 0000 0000 0000 = Link Tolerance (ms): 0 Bearer Instance: base Padding: 3 bytes Filler for MTU discovery: 8 bytes AND Followed by the same sequence Starting from Activate to Reset ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Thanks, Amar On Wed, Nov 16, 2016 at 12:22 AM, Jon Maloy <ma...@donjonn.com> wrote: > Hi Amar, > > The claim that TIPC is compatible between different kernel versions is > true, and we always test for backwards compatibility when we introduce > changes that may cause compatibility problems. However, you kernel 3.2.0 > i on node 1.1.6 is *very* old, and I don't think anybody of us is > testing this far back before we release. > > The changes between the versions is substantial, (yes, I know I should > have changed module version, I will do that soon), and I think there is > a risk we might have run into an unknown compatibility issue here. > > One thing is puzzling me in the dump from node 1.1.1: why is the bearer > disabled and enabled repeatedly? If you have done that manually, it is > completely consistent with what you see on the other node. But I guess > it can't be that simple? > > Regards > ///jon > > On 11/15/2016 05:15 AM, Amar Nv wrote: > > Hello, > > > > I am trying to bring up a cluster of 2 nodes hosted on different > > environments. > > > > > > > > *NODE1 TIPC Node-addr > > (6)*root@host1:/lib/modules/3.2.0-29-generic/kernel/net/tipc# > > modinfo tipc.ko > > filename: tipc.ko > > version: 2.0.0 > > license: Dual BSD/GPL > > description: TIPC: Transparent Inter Process Communication > > srcversion: A0CB14DDCCCBB1ABAE73386 > > depends: > > intree: Y > > vermagic: 3.2.0-29-generic SMP mod_unload modversions > > > > > > > > *NODE2 TIPC Node-addr (1)*root@host2:/lib/modules/4. > 6.0-rc6/kernel/net/tipc# > > modinfo tipc.ko > > filename: /lib/modules/4.6.0-rc6/kernel/net/tipc/tipc.ko > > version: 2.0.0 > > license: Dual BSD/GPL > > description: TIPC: Transparent Inter Process Communication > > srcversion: C58612B2A6F6FABF1EF75CE > > depends: udp_tunnel,ip6_udp_tunnel > > intree: Y > > vermagic: 4.6.0-rc6 SMP mod_unload modversions > > > > > > > > > > *Node 1 Kernel logs* > > Nov 15 15:40:09 7311-6 kernel: [598187.276986] TIPC: Established link > > <1.1.6:base-1.1.1:base> on network plane A > > Nov 15 15:40:09 7311-6 kernel: [598187.277100] TIPC: Resetting link > > <1.1.6:base-1.1.1:base>, requested by peer > > Nov 15 15:40:09 7311-6 kernel: [598187.277103] TIPC: Lost link > > <1.1.6:base-1.1.1:base> on network plane A > > Nov 15 15:40:09 7311-6 kernel: [598187.277106] TIPC: Lost contact with > > <1.1.1> > > Nov 15 15:40:09 7311-6 kernel: [598187.656616] TIPC: Established link > > <1.1.6:base-1.1.1:base> on network plane A > > Nov 15 15:40:09 7311-6 kernel: [598187.656687] TIPC: Resetting link > > <1.1.6:base-1.1.1:base>, requested by peer > > Nov 15 15:40:09 7311-6 kernel: [598187.656689] TIPC: Lost link > > <1.1.6:base-1.1.1:base> on network plane A > > Nov 15 15:40:09 7311-6 kernel: [598187.656691] TIPC: Lost contact with > > <1.1.1> > > > > > > > > *Node 2 Kernel logs*Nov 15 15:39:03 7470-1 kernel: [452484.786678] tipc: > > Activated (version 2.0.0) > > Nov 15 15:39:03 7470-1 kernel: [452484.786713] NET: Registered protocol > > family 30 > > Nov 15 15:39:03 7470-1 kernel: [452484.786813] tipc: Started in single > node > > mode > > Nov 15 15:39:03 7470-1 kernel: [452484.907687] Started in network mode > > Nov 15 15:39:03 7470-1 kernel: [452484.907693] Own node address <1.1.1>, > > network identity 1061 > > Nov 15 15:39:03 7470-1 kernel: [452484.907759] Enabled bearer <eth:base>, > > discovery domain <1.1.0>, priority 10 > > Nov 15 15:40:09 7470-1 kernel: [452551.143276] Disabling bearer > <eth:base> > > Nov 15 15:40:09 7470-1 kernel: [452551.254557] Left network mode > > Nov 15 15:40:10 7470-1 kernel: [452551.310490] NET: Unregistered protocol > > family 30 > > Nov 15 15:40:10 7470-1 kernel: [452551.310502] tipc: Deactivated > > Nov 15 15:40:47 7470-1 kernel: [452588.331653] tipc: Activated (version > > 2.0.0) > > Nov 15 15:40:47 7470-1 kernel: [452588.331688] NET: Registered protocol > > family 30 > > Nov 15 15:40:47 7470-1 kernel: [452588.331790] tipc: Started in single > node > > mode > > Nov 15 15:40:47 7470-1 kernel: [452588.432707] Started in network mode > > Nov 15 15:40:47 7470-1 kernel: [452588.432713] Own node address <1.1.1>, > > network identity 1061 > > Nov 15 15:40:47 7470-1 kernel: [452588.432781] Enabled bearer <eth:base>, > > discovery domain <1.1.0>, priority 10 > > Nov 15 15:41:53 7470-1 kernel: [452654.591363] Disabling bearer > <eth:base> > > Nov 15 15:41:53 7470-1 kernel: [452654.713347] Left network mode > > Nov 15 15:41:53 7470-1 kernel: [452654.761326] NET: Unregistered protocol > > family 30 > > Nov 15 15:41:53 7470-1 kernel: [452654.761340] tipc: Deactivated > > > > > > >From the tcpdump capture - I see a "Link State" message with type RESET > is > > sent from Node2. > > I confirm the TIPC address is same on both the nodes. > > > > Please suggest, > > 1. Does the TIPC protocol works between 2 kernels as stated above? > > 2. How can we determine the reason for RESET trigger by Node2 - Any other > > debugging ideas ? > > > > Thanks, > > Amar > > ------------------------------------------------------------ > ------------------ > > _______________________________________________ > > tipc-discussion mailing list > > tipc-discussion@lists.sourceforge.net > > https://lists.sourceforge.net/lists/listinfo/tipc-discussion > > > ------------------------------------------------------------ > ------------------ > _______________________________________________ > tipc-discussion mailing list > tipc-discussion@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/tipc-discussion > ------------------------------------------------------------------------------ _______________________________________________ tipc-discussion mailing list tipc-discussion@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/tipc-discussion