Hi Simon,

2016-11-30, Simon Horman:
Thomas Morin wrote:
2016-11-30, Ben Pfaff:
Do you have any idea what in your OpenFlow pipeline might do that,
i.e. is there anything especially tricky in the OpenFlow flows?

Are you willing to show us your OpenFlow flow table?

The setup involves three OVS bridges connected with patch-ports: br-int --
br-tun -- br-mpls, with the traffic that triggers the assert being processed
by br-int with a NORMAL action (ie. MAC learning).

The flows in this setup aren't particularly tricky, I think, although I'm
not sure what qualifies as tricky or non-tricky :)

Anyway, since yesterday I managed to identify the event that trigger the
assert, by adding more logging before the assert and displaying the actions
taken:

2016-11-29T14:44:40.126Z|00001|odp_util(revalidator45)|WARN|commit_set_ipv4_action
assert would fail....
2016-11-29T14:44:40.126Z|00002|odp_util(revalidator45)|WARN|  base_flow: 
ip,in_port=5,dl_vlan=3,dl_vlan_pcp=0,dl_src=fa:16:3e:33:f7:fe,dl_dst=00:00:5e:00:43:64,nw_src=0.0.0.0,nw_dst=0.0.0.0,nw_proto=0,nw_tos=0,nw_ecn=0,nw_ttl=0

Possibly I'm on entirely the wrong track here but if I am reading the above
correctly it seems that nw_proto, nw_src and nw_dst are all zero (or
perhaps missing). Do you have any idea why this might be the case?

Not at all, the traffic flowing is simple TCP traffic.

I would very blindly imagine (because I don't know what role 'base_flow' really plays) that perhaps this field is zeroed out at some masking/wildcarding step in the pipeline.




2016-11-29T14:44:40.126Z|00003|odp_util(revalidator45)|WARN|  flow: 
tcp,in_port=5,dl_vlan=3,dl_vlan_pcp=0,dl_src=fa:16:3e:33:f7:fe,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.22,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=53295,tp_dst=8080,tcp_flags=psh|ack
2016-11-29T14:44:40.126Z|00004|odp_util(revalidator45)|WARN|  masks: 
recirc_id=0xffffffff,reg0=0xffffffff,in_port=4294967295,dl_vlan=4095,dl_vlan_pcp=7,dl_src=ff:ff:ff:ff:ff:ff,dl_dst=ff:ff:ff:ff:ff:ff,dl_type=0xffff
2016-11-29T14:44:40.126Z|00005|odp_util(revalidator45)|WARN|  actions: 
set(ipv4(src=10.0.1.22,dst=10.0.0.3,ttl=63)),set(eth(src=b8:2a:72:de:1b:e3,dst=00:17:cb:79:2c:01)),push_mpls(label=410384,tc=0,ttl=63,bos=1,eth_type=0x8847),9,set(eth(src=fa:16:3e:33:f7:fe,dst=00:00:5e:00:43:64)),pop_mpls(eth_type=0x800),push_vlan(vid=3,pcp=0),1
2016-11-29T14:44:40.126Z|00006|odp_util(revalidator45)|WARN| flow->nw_proto
(6) != base_flow->nw_proto (0)
2016-11-29T14:44:40.126Z|00007|util(revalidator45)|EMER|lib/odp-util.c:5237:
assertion flow->nw_proto == base_flow->nw_proto && flow->nw_frag ==
base_flow->nw_frag failed in commit_set_ipv4_action()

Noticing that the actions include two outputs (to ports 9 and 1, which
mapped respectively to an eth interface and to br-int linux kernel network
interface), I thought that the issue could be related to an absence of MAC
learning entry in br-int.  I was then able to reliably trigger the
assert/crash/restart, without waiting for an unknown time, by artificially
expiring all MACs (ovs-appctl fdb/flush).

The file attached contains detailed information on the flow tables of the
three bridges, dpctl of active flows, and ofproto/trace of a flow that on a
MAC entry expiration, would trigger the assert.

I hope this information can help identify what ultimately ends up triggering
this assert.

As a side comment: I understand that this assert acts as a safeguard for
something that should never happen, but at the same time it would seem nice
to have OVS fail in a more smoother way than a crash/restart.

Agreed, this does seem like a recoverable error.

Yes, commenting out the assert results in something that at least does not violently break, although vswitchd and the kernel complain about a failed flow put.

-Thomas



---------------------------- br-int ----------------------------
OFPT_FEATURES_REPLY (xid=0x2): dpid:00002ec84846f549
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: output enqueue set_vlan_vid set_vlan_pcp strip_vlan mod_dl_src 
mod_dl_dst mod_nw_src mod_nw_dst mod_nw_tos mod_tp_src mod_tp_dst
 2(patch-tun): addr:32:0a:14:95:18:23
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 29(int-br-ex): addr:4a:86:48:67:35:56
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 32(qvo5b1356b5-2a): addr:76:a4:eb:db:53:d7
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 33(qvofad52a10-d4): addr:46:53:40:4b:a5:3e
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 35(qvo6241e101-ef): addr:ae:a5:87:e0:fa:bf
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 LOCAL(br-int): addr:2e:c8:48:46:f5:49
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
NXST_FLOW reply (xid=0x4):
 cookie=0x89a17a5684164aed, duration=4092.564s, table=0, n_packets=0, 
n_bytes=0, idle_age=4092, priority=10,icmp6,in_port=32,icmp_type=136 
actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=4090.353s, table=0, n_packets=0, 
n_bytes=0, idle_age=4090, priority=10,icmp6,in_port=33,icmp_type=136 
actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=113.702s, table=0, n_packets=0, n_bytes=0, 
idle_age=113, priority=10,icmp6,in_port=35,icmp_type=136 actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=4092.471s, table=0, n_packets=2140, 
n_bytes=89880, idle_age=96, priority=10,arp,in_port=32 actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=4090.264s, table=0, n_packets=6, 
n_bytes=252, idle_age=485, priority=10,arp,in_port=33 actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=113.613s, table=0, n_packets=3, 
n_bytes=126, idle_age=91, priority=10,arp,in_port=35 actions=resubmit(,24)
 cookie=0x89a17a5684164aed, duration=66121.334s, table=0, n_packets=15, 
n_bytes=1018, idle_age=4094, hard_age=65534, priority=2,in_port=29 actions=drop
 cookie=0x89a17a5684164aed, duration=4092.659s, table=0, n_packets=18646, 
n_bytes=1355462, idle_age=0, priority=9,in_port=32 actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=4090.442s, table=0, n_packets=21543, 
n_bytes=3640668, idle_age=0, priority=9,in_port=33 actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=113.792s, table=0, n_packets=2131, 
n_bytes=419189, idle_age=0, priority=9,in_port=35 actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=4091.297s, table=0, n_packets=14015, 
n_bytes=1013042, idle_age=0, priority=3,in_port=29,vlan_tci=0x0000 
actions=mod_vlan_vid:2,NORMAL
 cookie=0x89a17a5684164aed, duration=66122.082s, table=0, n_packets=15022, 
n_bytes=2060391, idle_age=0, hard_age=65534, priority=0 actions=NORMAL
 cookie=0x89a17a5684164aed, duration=66122.037s, table=23, n_packets=0, 
n_bytes=0, idle_age=65534, hard_age=65534, priority=0 actions=drop
 cookie=0x89a17a5684164aed, duration=4092.612s, table=24, n_packets=0, 
n_bytes=0, idle_age=4092, 
priority=2,icmp6,in_port=32,icmp_type=136,nd_target=fe80::f816:3eff:fe0e:15ad 
actions=NORMAL
 cookie=0x89a17a5684164aed, duration=4090.397s, table=24, n_packets=0, 
n_bytes=0, idle_age=4090, 
priority=2,icmp6,in_port=33,icmp_type=136,nd_target=fe80::f816:3eff:fe87:3ffa 
actions=NORMAL
 cookie=0x89a17a5684164aed, duration=113.748s, table=24, n_packets=0, 
n_bytes=0, idle_age=113, 
priority=2,icmp6,in_port=35,icmp_type=136,nd_target=fe80::f816:3eff:fed4:112f 
actions=NORMAL
 cookie=0x89a17a5684164aed, duration=4092.519s, table=24, n_packets=2140, 
n_bytes=89880, idle_age=96, priority=2,arp,in_port=32,arp_spa=10.0.1.23 
actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=4090.308s, table=24, n_packets=6, 
n_bytes=252, idle_age=485, priority=2,arp,in_port=33,arp_spa=10.194.67.93 
actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=113.658s, table=24, n_packets=3, 
n_bytes=126, idle_age=91, priority=2,arp,in_port=35,arp_spa=10.0.1.3 
actions=resubmit(,25)
 cookie=0x89a17a5684164aed, duration=66121.993s, table=24, n_packets=0, 
n_bytes=0, idle_age=65534, hard_age=65534, priority=0 actions=drop
 cookie=0x89a17a5684164aed, duration=4092.751s, table=25, n_packets=20784, 
n_bytes=1445202, idle_age=0, priority=2,in_port=32,dl_src=fa:16:3e:0e:15:ad 
actions=NORMAL
 cookie=0x89a17a5684164aed, duration=4090.531s, table=25, n_packets=21547, 
n_bytes=3640780, idle_age=0, priority=2,in_port=33,dl_src=fa:16:3e:87:3f:fa 
actions=NORMAL
 cookie=0x89a17a5684164aed, duration=113.881s, table=25, n_packets=2132, 
n_bytes=419175, idle_age=0, priority=2,in_port=35,dl_src=fa:16:3e:d4:11:2f 
actions=NORMAL
---------------------------- br-tun ----------------------------
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000fa8d6293c749
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: output enqueue set_vlan_vid set_vlan_pcp strip_vlan mod_dl_src 
mod_dl_dst mod_nw_src mod_nw_dst mod_nw_tos mod_tp_src mod_tp_dst
 1(patch-int): addr:52:8b:0d:36:a2:f4
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 2(patch-to-mpls): addr:02:1e:6d:e8:16:41
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 3(patch-from-mpls): addr:de:4c:72:95:ea:b7
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 4(vxlan-0ac2435a): addr:b6:87:f4:19:b4:05
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-tun): addr:fa:8d:62:93:c7:49
     config:     PORT_DOWN
     state:      LINK_DOWN
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
NXST_FLOW reply (xid=0x4):
 cookie=0xb1946ccce609ec6c, duration=66120.084s, table=0, n_packets=14454, 
n_bytes=1969353, idle_age=0, hard_age=65534, priority=1,in_port=3 
actions=output:1
 cookie=0x8b07ac4b1e759333, duration=66120.038s, table=0, n_packets=31383, 
n_bytes=2205140, idle_age=0, hard_age=65534, priority=1,in_port=1 
actions=resubmit(,2)
 cookie=0x8b07ac4b1e759333, duration=4155.958s, table=0, n_packets=234, 
n_bytes=43516, idle_age=91, priority=1,in_port=4 actions=resubmit(,4)
 cookie=0x8b07ac4b1e759333, duration=66120.038s, table=0, n_packets=18, 
n_bytes=756, idle_age=123, hard_age=65534, priority=0 actions=drop
 cookie=0x8b07ac4b1e759333, duration=66120.037s, table=2, n_packets=2216, 
n_bytes=96114, idle_age=93, hard_age=65534, 
priority=1,arp,dl_dst=ff:ff:ff:ff:ff:ff actions=resubmit(,21)
 cookie=0xb1946ccce609ec6c, duration=66120.127s, table=2, n_packets=28120, 
n_bytes=2009143, idle_age=0, hard_age=65534, 
priority=1,in_port=1,dl_dst=00:00:5e:00:43:64 actions=output:2
 cookie=0x8b07ac4b1e759333, duration=66120.037s, table=2, n_packets=948, 
n_bytes=87105, idle_age=91, hard_age=65534, 
priority=0,dl_dst=00:00:00:00:00:00/01:00:00:00:00:00 actions=resubmit(,20)
 cookie=0x8b07ac4b1e759333, duration=66120.037s, table=2, n_packets=99, 
n_bytes=12778, idle_age=87, hard_age=65534, 
priority=0,dl_dst=01:00:00:00:00:00/01:00:00:00:00:00 actions=resubmit(,22)
 cookie=0x8b07ac4b1e759333, duration=66120.036s, table=3, n_packets=0, 
n_bytes=0, idle_age=65534, hard_age=65534, priority=0 actions=drop
 cookie=0x8b07ac4b1e759333, duration=4157.393s, table=4, n_packets=234, 
n_bytes=43516, idle_age=91, priority=1,tun_id=0x5 
actions=mod_vlan_vid:1,resubmit(,10)
 cookie=0x8b07ac4b1e759333, duration=66120.036s, table=4, n_packets=0, 
n_bytes=0, idle_age=65534, hard_age=65534, priority=0 actions=drop
 cookie=0x8b07ac4b1e759333, duration=66120.036s, table=6, n_packets=0, 
n_bytes=0, idle_age=65534, hard_age=65534, priority=0 actions=drop
 cookie=0x8b07ac4b1e759333, duration=66120.035s, table=10, n_packets=466, 
n_bytes=85542, idle_age=91, hard_age=65534, priority=1 
actions=learn(table=20,hard_timeout=300,priority=1,cookie=0x8b07ac4b1e759333,NXM_OF_VLAN_TCI[0..11],NXM_OF_ETH_DST[]=NXM_OF_ETH_SRC[],load:0->NXM_OF_VLAN_TCI[],load:NXM_NX_TUN_ID[]->NXM_NX_TUN_ID[],output:NXM_OF_IN_PORT[]),output:1
 cookie=0x8b07ac4b1e759333, duration=4155.957s, table=20, n_packets=305, 
n_bytes=28542, idle_age=91, priority=2,dl_vlan=1,dl_dst=fa:16:3e:ec:11:88 
actions=strip_vlan,set_tunnel:0x5,output:4
 cookie=0x8b07ac4b1e759333, duration=97.121s, table=20, n_packets=0, n_bytes=0, 
hard_timeout=300, idle_age=97, hard_age=91, 
priority=1,vlan_tci=0x0001/0x0fff,dl_dst=fa:16:3e:ec:11:88 
actions=load:0->NXM_OF_VLAN_TCI[],load:0x5->NXM_NX_TUN_ID[],output:4
 cookie=0x8b07ac4b1e759333, duration=66120.035s, table=20, n_packets=330, 
n_bytes=28185, idle_age=1597, hard_age=65534, priority=0 actions=resubmit(,22)
 cookie=0x8b07ac4b1e759333, duration=4155.958s, table=21, n_packets=0, n_bytes=0, idle_age=4155, 
priority=1,arp,dl_vlan=1,arp_tpa=10.0.1.2 
actions=move:NXM_OF_ETH_SRC[]->NXM_OF_ETH_DST[],mod_dl_src:fa:16:3e:ec:11:88,load:0x2->NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]->NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]->NXM_OF_ARP_TPA[],load:0xfa163eec1188->NXM_NX_ARP_SHA[],load:0xa000102->NXM_OF_ARP_SPA[],IN_PORT
 cookie=0xb1946ccce609ec6c, duration=112.690s, table=21, n_packets=1, n_bytes=42, idle_age=93, 
priority=1,arp,dl_vlan=1,arp_tpa=10.0.1.1 
actions=move:NXM_OF_ETH_SRC[]->NXM_OF_ETH_DST[],mod_dl_src:00:00:5e:00:43:64,load:0x2->NXM_OF_ARP_OP[],move:NXM_NX_ARP_SHA[]->NXM_NX_ARP_THA[],move:NXM_OF_ARP_SPA[]->NXM_OF_ARP_TPA[],load:0x5e004364->NXM_NX_ARP_SHA[],load:0xa000101->NXM_OF_ARP_SPA[],IN_PORT
 cookie=0x8b07ac4b1e759333, duration=66120.035s, table=21, n_packets=2143, 
n_bytes=93048, idle_age=96, hard_age=65534, priority=0 actions=resubmit(,22)
 cookie=0x8b07ac4b1e759333, duration=4155.914s, table=22, n_packets=2150, 
n_bytes=101604, idle_age=87, dl_vlan=1 
actions=strip_vlan,set_tunnel:0x5,output:4
 cookie=0x8b07ac4b1e759333, duration=66119.989s, table=22, n_packets=248, 
n_bytes=20598, idle_age=114, hard_age=65534, priority=0 actions=drop
---------------------------- br-mpls ----------------------------
OFPT_FEATURES_REPLY (xid=0x2): dpid:0000b82a72de1be3
n_tables:254, n_buffers:256
capabilities: FLOW_STATS TABLE_STATS PORT_STATS QUEUE_STATS ARP_MATCH_IP
actions: output enqueue set_vlan_vid set_vlan_pcp strip_vlan mod_dl_src 
mod_dl_dst mod_nw_src mod_nw_dst mod_nw_tos mod_tp_src mod_tp_dst
 1(eth2): addr:b8:2a:72:de:1b:e3
     config:     0
     state:      0
     current:    100MB-FD COPPER AUTO_NEG
     advertised: 10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-HD 1GB-FD COPPER 
AUTO_NEG AUTO_PAUSE
     supported:  10MB-HD 10MB-FD 100MB-HD 100MB-FD 1GB-HD 1GB-FD COPPER AUTO_NEG
     speed: 100 Mbps now, 1000 Mbps max
 2(patch-from-tun): addr:9a:0b:74:10:7b:20
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 3(patch-to-tun): addr:56:7e:ba:d8:2e:48
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 19(toarpns1): addr:82:7e:11:55:c6:68
     config:     0
     state:      0
     current:    10GB-FD COPPER
     speed: 10000 Mbps now, 0 Mbps max
 20(ipvpn1-pp-in): addr:1e:49:4c:b0:89:20
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 21(ipvpn1-pp-out): addr:22:ce:f2:74:99:8f
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
 LOCAL(br-mpls): addr:b8:2a:72:de:1b:e3
     config:     0
     state:      0
     speed: 0 Mbps now, 0 Mbps max
OFPT_GET_CONFIG_REPLY (xid=0x4): frags=normal miss_send_len=0
NXST_FLOW reply (xid=0x4):
 cookie=0x1, duration=129.956s, table=0, n_packets=12, n_bytes=888, 
idle_age=11, priority=40000,ip,in_port=20,nw_dst=10.0.1.1 actions=output:19
 cookie=0x1, duration=129.939s, table=0, n_packets=0, n_bytes=0, idle_age=129, 
priority=40000,ip,in_port=19,nw_dst=10.0.1.23 actions=mod_vlan_vid:1,output:3
 cookie=0x1, duration=113.461s, table=0, n_packets=1792, n_bytes=133095, 
idle_age=0, priority=40000,ip,in_port=20,nw_dst=10.0.0.3 
actions=multipath(symmetric_l3l4+udp,1024,hrw,1,0,NXM_NX_REG0[]),resubmit(,1)
 cookie=0x1, duration=112.922s, table=0, n_packets=0, n_bytes=0, idle_age=112, 
priority=40000,ip,in_port=19,nw_dst=10.0.1.3 actions=mod_vlan_vid:1,output:3
 cookie=0x1, duration=112.933s, table=0, n_packets=1863, n_bytes=138349, 
idle_age=0, priority=40000,ip,in_port=2,dl_vlan=1 actions=strip_vlan,output:21
 cookie=0x1, duration=112.929s, table=0, n_packets=3, n_bytes=126, 
idle_age=123, priority=40000,arp,in_port=2,dl_vlan=1 
actions=strip_vlan,output:19
 cookie=0x1, duration=129.942s, table=0, n_packets=3, n_bytes=126, 
idle_age=123, priority=40000,arp,in_port=19,dl_dst=fa:16:3e:0e:15:ad 
actions=mod_vlan_vid:1,output:2
 cookie=0x1, duration=112.926s, table=0, n_packets=0, n_bytes=0, idle_age=112, 
priority=40000,arp,in_port=19,dl_dst=fa:16:3e:d4:11:2f 
actions=mod_vlan_vid:1,output:2
 cookie=0x1, duration=129.936s, table=0, n_packets=2245, n_bytes=440282, 
idle_age=0, priority=40000,mpls,in_port=1,mpls_label=149,mpls_bos=1 
actions=pop_mpls:0x0800,mod_vlan_vid:1,mod_dl_src:00:00:5e:00:43:64,mod_dl_dst:fa:16:3e:0e:15:ad,output:3
 cookie=0x1, duration=112.919s, table=0, n_packets=0, n_bytes=0, idle_age=112, 
priority=40000,mpls,in_port=1,mpls_label=150,mpls_bos=1 
actions=pop_mpls:0x0800,mod_vlan_vid:1,mod_dl_src:00:00:5e:00:43:64,mod_dl_dst:fa:16:3e:d4:11:2f,output:3
 cookie=0x0, duration=66124.598s, table=0, n_packets=3563, n_bytes=229661, 
idle_age=7, hard_age=65534, in_port=LOCAL actions=output:1
 cookie=0x0, duration=66124.596s, table=0, n_packets=3548, n_bytes=251824, 
idle_age=7, hard_age=65534, in_port=1 actions=LOCAL
 cookie=0x1, duration=113.461s, table=1, n_packets=1792, n_bytes=133095, 
idle_age=0, priority=40000,ip,reg0=0,in_port=20,nw_dst=10.0.0.3 
actions=dec_ttl,push_mpls:0x8847,load:0x644c0->OXM_OF_MPLS_LABEL[],mod_dl_src:b8:2a:72:de:1b:e3,mod_dl_dst:00:17:cb:79:2c:01,output:1
----------------- ovs-dpctl ----------
recirc_id(0),in_port(12),eth(src=fa:16:3e:0e:15:ad,dst=fa:16:3e:d4:11:2f),eth_type(0x0800),ipv4(frag=no),
 packets:1583, bytes:112820, used:0.000s, flags:SP., actions:10
recirc_id(0),in_port(8),eth(src=00:10:db:ff:10:00,dst=fa:16:3e:87:3f:fa),eth_type(0x0800),ipv4(frag=no),
 packets:9856, bytes:659858, used:0.004s, flags:SFP., actions:13
recirc_id(0),in_port(13),eth(src=fa:16:3e:87:3f:fa,dst=00:10:db:ff:10:00),eth_type(0x0800),ipv4(frag=no),
 packets:16351, bytes:1715791, used:0.004s, flags:SFPR., 
actions:push_vlan(vid=2,pcp=0),8
recirc_id(0),in_port(6),eth(src=00:23:34:81:a6:10,dst=01:80:c2:00:00:00),eth_type(0/0xffff),
 packets:33036, bytes:1982160, used:0.368s, actions:drop
recirc_id(0),in_port(11),eth(src=fa:16:3e:87:3f:fa,dst=00:10:db:ff:10:00),eth_type(0x8100),vlan(vid=2,pcp=0),encap(eth_type(0x0800),ipv4(frag=no)),
 packets:16351, bytes:1781195, used:0.004s, flags:SFPR., actions:pop_vlan,6
recirc_id(0),in_port(12),eth(src=fa:16:3e:0e:15:ad,dst=00:00:5e:00:43:64),eth_type(0x0800),ipv4(src=10.0.1.23,dst=10.0.0.3,proto=6,tos=0/0xfc,ttl=64,frag=no),tcp(src=60083,dst=8080),
 packets:1530, bytes:109307, used:0.012s, flags:P., 
actions:set(ipv4(src=10.0.1.23,dst=10.0.0.3,ttl=63)),set(eth(src=b8:2a:72:de:1b:e3,dst=00:17:cb:79:2c:01)),push_mpls(label=410816,tc=0,ttl=63,bos=1,eth_type=0x8847),9
recirc_id(0),in_port(9),eth(src=00:17:cb:79:2c:01,dst=b8:2a:72:de:1b:e3),eth_type(0x8847),mpls(label=149/0xfffff,tc=0/0,ttl=0/0x0,bos=1/1),
 packets:2248, bytes:440984, used:0.012s, 
actions:set(eth(src=00:00:5e:00:43:64,dst=fa:16:3e:0e:15:ad)),pop_mpls(eth_type=0x800),push_vlan(vid=1,pcp=0),recirc(0x58)
recirc_id(0),in_port(6),eth(src=00:10:db:ff:10:00,dst=fa:16:3e:87:3f:fa),eth_type(0x0800),ipv4(frag=no),
 packets:9856, bytes:659858, used:0.004s, flags:SFP., actions:11
recirc_id(0),in_port(9),eth_type(0x0806), packets:0, bytes:0, used:never, 
actions:7
recirc_id(0),in_port(10),eth(src=fa:16:3e:d4:11:2f,dst=fa:16:3e:0e:15:ad),eth_type(0x0800),ipv4(frag=no),
 packets:2134, bytes:423320, used:0.000s, flags:SPR., actions:12
recirc_id(0),in_port(3),eth(dst=ff:ff:ff:ff:ff:ff),eth_type(0x0806), packets:2, 
bytes:84, used:9.736s, actions:drop
recirc_id(0),in_port(7),eth_type(0x0806), packets:0, bytes:0, used:never, 
actions:9
recirc_id(0x58),in_port(9),eth(src=00:00:5e:00:43:64,dst=fa:16:3e:0e:15:ad),eth_type(0x8100),vlan(vid=1,pcp=0),encap(eth_type(0x0800),ipv4(frag=no)),
 packets:2248, bytes:440984, used:0.012s, flags:SFPR., actions:pop_vlan,12
recirc_id(0),in_port(6),eth(src=00:23:34:81:a6:10,dst=00:23:34:81:a6:10),eth_type(0x9000),
 packets:79, bytes:4740, used:3.104s, actions:drop
system@ovs-system:
        lookups: hit:487730 missed:34866 lost:50
        flows: 14
        masks: hit:1165930 total:8 hit/pkt:2.23
        port 0: ovs-system (internal)
        port 1: br-int (internal)
        port 2: br-tun (internal)
        port 3: toarpns1
        port 4: vxlan_sys_4789 (vxlan)
        port 5: br-ex (internal)
        port 6: eth1
        port 7: br-mpls (internal)
        port 8: int-br-ex
        port 9: eth2
        port 10: qvo6241e101-ef
        port 11: phy-br-ex
        port 12: qvo5b1356b5-2a
        port 13: qvofad52a10-d4
-----------------------
Bridge: br-int
Flow: 
tcp,in_port=32,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=60083,tp_dst=8080,tcp_flags=0

Rule: table=0 cookie=0x89a17a5684164aed priority=9,in_port=32
OpenFlow actions=resubmit(,25)

        Resubmitted flow: 
tcp,in_port=32,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=60083,tp_dst=8080,tcp_flags=0
        Resubmitted regs: reg0=0x0 reg1=0x0 reg2=0x0 reg3=0x0 reg4=0x0 reg5=0x0 
reg6=0x0 reg7=0x0
        Resubmitted  odp: drop
        Resubmitted megaflow: 
recirc_id=0,ip,in_port=32,dl_src=fa:16:3e:0e:15:ad,nw_frag=no
        Rule: table=25 cookie=0x89a17a5684164aed 
priority=2,in_port=32,dl_src=fa:16:3e:0e:15:ad
        OpenFlow actions=NORMAL
        forwarding to learned port

                Resubmitted flow: 
tcp,in_port=1,dl_vlan=1,dl_vlan_pcp=0,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=60083,tp_dst=8080,tcp_flags=0
                Resubmitted regs: reg0=0x0 reg1=0x0 reg2=0x0 reg3=0x0 reg4=0x0 
reg5=0x0 reg6=0x0 reg7=0x0
                Resubmitted  odp: drop
                Resubmitted megaflow: 
recirc_id=0,ip,in_port=32,vlan_tci=0x0000/0x1fff,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_frag=no
                Rule: table=0 cookie=0x8b07ac4b1e759333 priority=1,in_port=1
                OpenFlow actions=resubmit(,2)

                        Resubmitted flow: unchanged
                        Resubmitted regs: reg0=0x0 reg1=0x0 reg2=0x0 reg3=0x0 
reg4=0x0 reg5=0x0 reg6=0x0 reg7=0x0
                        Resubmitted  odp: drop
                        Resubmitted megaflow: 
recirc_id=0,ip,in_port=32,vlan_tci=0x0000/0x1fff,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_frag=no
                        Rule: table=2 cookie=0xb1946ccce609ec6c 
priority=1,in_port=1,dl_dst=00:00:5e:00:43:64
                        OpenFlow actions=output:2

                                Resubmitted flow: 
tcp,in_port=2,dl_vlan=1,dl_vlan_pcp=0,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=60083,tp_dst=8080,tcp_flags=0
                                Resubmitted regs: reg0=0x0 reg1=0x0 reg2=0x0 
reg3=0x0 reg4=0x0 reg5=0x0 reg6=0x0 reg7=0x0
                                Resubmitted  odp: drop
                                Resubmitted megaflow: 
recirc_id=0,ip,in_port=32,vlan_tci=0x0000/0x1fff,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_frag=no
                                Rule: table=0 cookie=0x1 
priority=40000,ip,in_port=2,dl_vlan=1
                                OpenFlow actions=pop_vlan,output:21

                                        Resubmitted flow: 
tcp,in_port=20,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ecn=0,nw_ttl=64,tp_src=60083,tp_dst=8080,tcp_flags=0
                                        Resubmitted regs: reg0=0x0 reg1=0x0 
reg2=0x0 reg3=0x0 reg4=0x0 reg5=0x0 reg6=0x0 reg7=0x0
                                        Resubmitted  odp: drop
                                        Resubmitted megaflow: 
recirc_id=0,ip,in_port=32,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_dst=10.0.0.3,nw_frag=no
                                        Rule: table=0 cookie=0x1 
priority=40000,ip,in_port=20,nw_dst=10.0.0.3
                                        OpenFlow 
actions=multipath(symmetric_l3l4+udp,1024,hrw,1,0,NXM_NX_REG0[]),resubmit(,1)

                                                Resubmitted flow: unchanged
                                                Resubmitted regs: reg0=0x0 
reg1=0x0 reg2=0x0 reg3=0x0 reg4=0x0 reg5=0x0 reg6=0x0 reg7=0x0
                                                Resubmitted  odp: drop
                                                Resubmitted megaflow: 
recirc_id=0,tcp,reg0=0,in_port=32,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_frag=no,tp_src=60083,tp_dst=8080
                                                Rule: table=1 cookie=0x1 
priority=40000,ip,reg0=0,in_port=20,nw_dst=10.0.0.3
                                                OpenFlow 
actions=dec_ttl,push_mpls:0x8847,load:0x644c0->OXM_OF_MPLS_LABEL[],set_field:b8:2a:72:de:1b:e3->eth_src,set_field:00:17:cb:79:2c:01->eth_dst,output:1

Final flow: unchanged
Megaflow: 
recirc_id=0,tcp,in_port=32,vlan_tci=0x0000,dl_src=fa:16:3e:0e:15:ad,dl_dst=00:00:5e:00:43:64,nw_src=10.0.1.23,nw_dst=10.0.0.3,nw_tos=0,nw_ttl=64,mpls_label=0,nw_frag=no,tp_src=60083,tp_dst=8080
Datapath actions: 
set(ipv4(src=10.0.1.23,dst=10.0.0.3,ttl=63)),set(eth(src=b8:2a:72:de:1b:e3,dst=00:17:cb:79:2c:01)),push_mpls(label=410816,tc=0,ttl=63,bos=1,eth_type=0x8847),9


_______________________________________________
dev mailing list
d...@openvswitch.org
https://mail.openvswitch.org/mailman/listinfo/ovs-dev

Reply via email to