This series deals with fixes related to Ethernet 8021q vlan
priority-bits used by mlx4 code under IBoE. It is made of
one kernel/mlx4_ib patch and three user-space/libmlx4 patches.
This series makes the IBoE code to follow IBTA's IBoE Annex, section
A16.8.1 "SL, VL MANAGEMENT" - and map SLs 0-7 to Ethernet 8021q user
priority bits (pbits) which are part of the VLAN tag, SLs 8-15 are
reserved.
Under Ethernet, the ConnectX firmware treats (decode/encode) the four
bit SL field in various constructs such as QPC / UD WQE / CQE as PPP0
and not as 0PPP. This correlates well to the fact that within the
vlan tag the pbits are located in bits 15-13 and not 12-14.
The current kernel code wasn't consistent around that area - the
encoding was correct for the IBoE QPC.path.schedule_queue field, but
was wrong for IBoE CQEs and when MLX header was built. In user-space,
libmlx4 had the same problem with IBoE CQEs and another problem
related to UD address-handles.
These in
consistencies resulted in wrong SL <--> wire 8021q bpits
mappings, which are fixed by using SL <--> PPP0 all around the place.
I'd like to thank Oren Duer for his guidance and support
throughout working on these fixes.
Or Gerlitz (1):
ib/mlx4: fix SL to 8021q priority-bits settings under IBoE
drivers/infiniband/hw/mlx4/ah.c | 2 +-
drivers/infiniband/hw/mlx4/cq.c | 6 +++++-
drivers/infiniband/hw/mlx4/qp.c | 4 ++--
3 files changed, 8 insertions(+), 4 deletions(-)
Or Gerlitz (3):
use Ethernet 8021q vlans related fields with CQE
add link layer field to mlx4 QPs
fix SL to 8021q priority-bits settings under IBoE
src/cq.c | 28 +++++++++++++++++-----------
src/mlx4.h | 2 ++
src/verbs.c | 13 +++++++++++--
3 files changed, 30 insertions(+), 13 deletions(-)
The problems and the fixes could be easily observed using RC and UD based
librdmacm examples (ucmatose, and udaddy) which let the user to specify
a TOS param, whose 3 MSBits translate under IBoE to SL.
The RC basic flow would then be (exclusing address resolution done by ARP):
CM REQ A --> B
CM REP A <-- B
CM RTU A --> B
RC send A --> B
RC ack A <-- B
CM DREQ A --> B
CM DREP A <-- B
The UD basic flow would then be (the 2nd UD send is just the way this app works)
CM SIDR REQ A --> B
CM SIDR REP A <-- B
UD send A --> B
UD send A <-- B
Using port mirroring on an ethernet switch, such that a 3rd host gets all
packets
from that A,B conversation, we can see that before the patches, for RC
connection, the
RC data/ack packets were using the correct pbits, and the CM packets wrong
pbits, where
for UD, only half the data packets used the correct pbits, where the other
direction
and the CM used wrong pbits.
IBoE CM + RC before fixes
11:05:41.961396 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:41.963920 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:41.964131 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:41.964146 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:41.964217 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:41.964570 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:41.964713 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:42.981451 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:42.983351 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:42.983545 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:42.983563 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:42.983633 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:42.984040 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:42.984225 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:44.001505 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:44.003138 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:44.003347 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:44.003381 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0074 1b01 fe80 0000 @3..`....t......
11:05:44.003442 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0014 1b01 fe80 0000 @3..`...........
11:05:44.003746 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:44.003896 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:45.021613 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:45.023248 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:45.023460 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:45.023479 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0074 1b01 fe80 0000 `3..`....t......
11:05:45.023545 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0014 1b01 fe80 0000 `3..`...........
11:05:45.023963 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:45.024130 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:46.041646 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:46.042852 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:46.043051 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:46.043068 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:46.043124 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:46.043448 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:46.043610 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:47.061656 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:47.062645 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:47.062839 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:47.062856 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:47.062914 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:47.063417 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:47.063675 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:48.081705 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:48.082693 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:48.082886 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:48.082904 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:48.082963 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:48.083248 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:48.083448 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:05:49.101771 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:49.102758 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:49.102987 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:49.102996 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 174: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0074 1b01 fe80 0000 .3..`....t......
11:05:49.103025 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 78: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0014 1b01 fe80 0000 .3..`...........
11:05:49.103299 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:05:49.103480 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
IBoE CM + RC after fixes
12:26:46.520083 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:46.520930 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:46.521007 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:46.521245 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:47.540200 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:47.541070 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:47.541170 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:47.541407 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:48.564261 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
12:26:48.565137 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
12:26:48.565219 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
12:26:48.565469 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
12:26:49.584231 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0118 1b00 fe80 0000 `3..`...........
12:26:49.585098 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0118 1b00 fe80 0000 `3..`...........
12:26:49.585181 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 005c 1b01 fe80 0000 `3..`....\......
12:26:49.585433 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 005c 1b01 fe80 0000 `3..`....\......
12:26:50.604373 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:50.605231 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:50.605307 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:50.605564 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:51.624419 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:51.625279 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:51.625361 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:51.625614 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:52.644486 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:52.645348 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:52.645422 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:52.645682 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:53.664521 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:53.665421 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:26:53.665520 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:26:53.665731 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
IBoE CM + UD before fixes
11:03:36.767031 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:36.768694 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:36.768763 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:36.769000 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:37.783156 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:03:37.784617 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:37.784692 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:37.784958 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
11:03:38.799211 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:38.800688 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:38.800764 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
11:03:38.801000 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:39.815254 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:03:39.816728 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:39.816764 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 005c 1b01 fe80 0000 `3..`....\......
11:03:39.817036 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:40.831318 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:40.832765 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:40.832842 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:40.833077 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:41.847462 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:03:41.848918 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:41.848994 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:41.849273 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
11:03:42.863417 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:42.864984 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:42.865068 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:42.865326 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:43.883464 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
11:03:43.884922 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
11:03:43.884997 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
11:03:43.885255 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
IBoE CM + UD after fixes
12:28:34.213862 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:34.214796 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:34.214926 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:34.215129 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 0, ethertype 0x8915,
0x0000: 0033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:35.233911 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:35.234758 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:35.234873 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:35.235090 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 1, ethertype 0x8915,
0x0000: 2033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:36.253948 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
12:28:36.254816 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 0118 1b00 fe80 0000 @3..`...........
12:28:36.254929 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
12:28:36.255153 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 2, ethertype 0x8915,
0x0000: 4033 8915 6000 0000 005c 1b01 fe80 0000 @3..`....\......
12:28:37.274036 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0118 1b00 fe80 0000 `3..`...........
12:28:37.274896 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 0118 1b00 fe80 0000 `3..`...........
12:28:37.274971 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 005c 1b01 fe80 0000 `3..`....\......
12:28:37.275228 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 3, ethertype 0x8915,
0x0000: 6033 8915 6000 0000 005c 1b01 fe80 0000 `3..`....\......
12:28:38.294078 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:38.294943 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:38.295019 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:38.295285 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 4, ethertype 0x8915,
0x0000: 8033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:39.314047 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:39.314897 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:39.314974 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:39.315237 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 5, ethertype 0x8915,
0x0000: a033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:40.334200 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:40.335069 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:40.335151 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:40.335411 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 6, ethertype 0x8915,
0x0000: c033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:41.354255 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:41.355119 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 338: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 0118 1b00 fe80 0000 .3..`...........
12:28:41.355191 00:02:c9:10:c6:e9 > 00:02:c9:07:1f:f9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
12:28:41.355453 00:02:c9:07:1f:f9 > 00:02:c9:10:c6:e9, ethertype 802.1Q
(0x8100), length 150: vlan 51, p 7, ethertype 0x8915,
0x0000: e033 8915 6000 0000 005c 1b01 fe80 0000 .3..`....\......
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majord...@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
