Re: [ovs-discuss] [ovs-dev] [ovn] no tunnel from GW to compute
Thanks Numan for the hint! I thought it's about OF flow and DP flow. Didn't realize the problem could be in upstream. I checked NB DB and found a LRP leftover from previous deletion. Someone was testing a deployment with network and VMs. They destroy and recreate the deployment back-to-back. It's likely some issue in Neutron OVN ML2 driver who is responsible for programming NB DB. Somehow, the driver didn't have a chance to completely finish the deletion while start the new creation. I manually delete that stale LRP, everything starts working fine. Tony > -Original Message- > From: Numan Siddique > Sent: Wednesday, October 28, 2020 1:56 AM > To: Tony Liu > Cc: ovs-discuss ; ovs-dev d...@openvswitch.org> > Subject: Re: [ovs-dev] [ovn] no tunnel from GW to compute > > On Wed, Oct 28, 2020 at 11:29 AM Tony Liu > wrote: > > > > Checked OF flows for working and non-working FIPs, can't find any > > difference. DF flow is installed by vswitchd based on OF flow when > > processing the first packet. I enabled debug logging, no log for > > working FIP, a few logs for non-working FIP. Does that mean something > > wrong about non-working FIP? > > Could you share your OVN NB DB ? or ovn-nbctl commands to create the > resources so that I can try it out locally ? > > Thanks > Numan > > > == > > 2020-10-28T05:15:22.058Z|01203|dpif(handler8)|DBG|system@ovs-system: > miss upcall: > > recirc_id(0),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),ct_stat > > e(0),ct_zone(0),ct_mark(0),ct_label(0),eth(src=e8:1c:ba:9f:b7:c6,dst=f > > a:16:3e:45:da:61),eth_type(0x0800),ipv4(src=172.16.160.1,dst=10.59.53. > > 8,proto=1,tos=0,ttl=125,frag=no),icmp(type=8,code=0) > > icmp,vlan_tci=0x,dl_src=e8:1c:ba:9f:b7:c6,dl_dst=fa:16:3e:45:da:61 > > ,nw_src=172.16.160.1,nw_dst=10.59.53.8,nw_tos=0,nw_ecn=0,nw_ttl=125,ic > mp_type=8,icmp_code=0 icmp_csum:6013 .. > > 2020-10-28T05:15:22.059Z|00808|vconn|DBG|unix#1: sent (Success): > > NXT_PACKET_IN2 (OF1.3) (xid=0x0): table_id=24 cookie=0x9173f925 > > total_len=74 > > ct_state=new|trk|dnat,ct_zone=507,ct_nw_src=172.16.160.1,ct_nw_dst=10. > > 59.53.8,ct_nw_proto=1,ct_tp_src=8,ct_tp_dst=0,ip,reg0=0xa0a000a,reg1=0 > > xa0a0001,reg9=0x8,reg10=0x1,reg11=0x1fb,reg12=0x1fa,reg14=0x1,reg15=0x > > 7,metadata=0x121,in_port=1 (via action) data_len=74 (unbuffered) > > > > userdata=00.00.00.00.00.00.00.00.00.19.00.10.80.00.06.06.ff.ff.ff.ff.f > > f.ff.00.00.ff.ff.00.18.00.00.23.20.00.06.00.20.00.40.00.00.00.01.de.10 > > .00.00.20.04.ff.ff.00.18.00.00.23.20.00.06.00.20.00.60.00.00.00.01.de. > > 10.00.00.22.04.00.19.00.10.80.00.2a.02.00.01.00.00.00.00.00.00.ff.ff.0 > > 0.10.00.00.23.20.00.0e.ff.f8.20.00.00.00 > > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00 > > ,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,ic > > mp_type=8,icmp_code=0 icmp_csum:6013 > > > > .. > > 2020-10-28T05:15:27.060Z|01102|dpif(handler10)|DBG|system@ovs-system: > action upcall: > > recirc_id(0x3ad25),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),c > > t_state(0xa1),ct_zone(0x1fb),ct_mark(0),ct_label(0),ct_tuple4(src=172. > > 16.160.1,dst=10.59.53.8,proto=1,tp_src=8,tp_dst=0),eth(src=fa:16:3e:93 > > :f4:1e,dst=00:00:00:00:00:00),eth_type(0x0800),ipv4(src=172.16.160.1,d > > st=10.10.0.10,proto=1,tos=0,ttl=124,frag=no),icmp(type=8,code=0) > > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00 > > ,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,ic > mp_type=8,icmp_code=0 icmp_csum:6012 .. > > 2020-10-28T05:15:27.061Z|00834|vconn|DBG|unix#1: sent (Success): > > NXT_PACKET_IN2 (OF1.3) (xid=0x0): table_id=24 cookie=0x9173f925 > > total_len=74 > > ct_state=new|trk|dnat,ct_zone=507,ct_nw_src=172.16.160.1,ct_nw_dst=10. > > 59.53.8,ct_nw_proto=1,ct_tp_src=8,ct_tp_dst=0,ip,reg0=0xa0a000a,reg1=0 > > xa0a0001,reg9=0x8,reg10=0x1,reg11=0x1fb,reg12=0x1fa,reg14=0x1,reg15=0x > > 7,metadata=0x121,in_port=1 (via action) data_len=74 (unbuffered) > > > > userdata=00.00.00.00.00.00.00.00.00.19.00.10.80.00.06.06.ff.ff.ff.ff.f > > f.ff.00.00.ff.ff.00.18.00.00.23.20.00.06.00.20.00.40.00.00.00.01.de.10 > > .00.00.20.04.ff.ff.00.18.00.00.23.20.00.06.00.20.00.60.00.00.00.01.de. > > 10.00.00.22.04.00.19.00.10.80.00.2a.02.00.01.00.00.00.00.00.00.ff.ff.0 > > 0.10.00.00.23.20.00.0e.ff.f8.20.00.00.00 > > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00 > > ,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,ic > mp_type=8,icmp_code=0 icmp_csum:6012 .. > > 2020-10-28T05:15:32.059Z|01359|dpif(handler8)|DBG|system@ovs-system: > action upcall: > > recirc_id(0x3ad25),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),c > > t_state(0xa1),ct_zone(0x1fb),ct_mark(0),ct_label(0),ct_tuple4(src=172. > > 16.160.1,dst=10.59.53.8,proto=1,tp_src=8,tp_dst=0),eth(src=fa:16:3e:93 > > :f4:1e,dst=00:00:00:00:00:00),eth_type(0x0800),ipv4(src=172.16.160.1,d > >
Re: [ovs-discuss] [ovs-dev] [ovn] no tunnel from GW to compute
On Wed, Oct 28, 2020 at 11:29 AM Tony Liu wrote: > > Checked OF flows for working and non-working FIPs, can't find > any difference. DF flow is installed by vswitchd based on OF flow > when processing the first packet. I enabled debug logging, no log > for working FIP, a few logs for non-working FIP. Does that mean > something wrong about non-working FIP? Could you share your OVN NB DB ? or ovn-nbctl commands to create the resources so that I can try it out locally ? Thanks Numan > == > 2020-10-28T05:15:22.058Z|01203|dpif(handler8)|DBG|system@ovs-system: miss > upcall: > recirc_id(0),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),ct_state(0),ct_zone(0),ct_mark(0),ct_label(0),eth(src=e8:1c:ba:9f:b7:c6,dst=fa:16:3e:45:da:61),eth_type(0x0800),ipv4(src=172.16.160.1,dst=10.59.53.8,proto=1,tos=0,ttl=125,frag=no),icmp(type=8,code=0) > icmp,vlan_tci=0x,dl_src=e8:1c:ba:9f:b7:c6,dl_dst=fa:16:3e:45:da:61,nw_src=172.16.160.1,nw_dst=10.59.53.8,nw_tos=0,nw_ecn=0,nw_ttl=125,icmp_type=8,icmp_code=0 > icmp_csum:6013 > .. > 2020-10-28T05:15:22.059Z|00808|vconn|DBG|unix#1: sent (Success): > NXT_PACKET_IN2 (OF1.3) (xid=0x0): table_id=24 cookie=0x9173f925 total_len=74 > ct_state=new|trk|dnat,ct_zone=507,ct_nw_src=172.16.160.1,ct_nw_dst=10.59.53.8,ct_nw_proto=1,ct_tp_src=8,ct_tp_dst=0,ip,reg0=0xa0a000a,reg1=0xa0a0001,reg9=0x8,reg10=0x1,reg11=0x1fb,reg12=0x1fa,reg14=0x1,reg15=0x7,metadata=0x121,in_port=1 > (via action) data_len=74 (unbuffered) > > userdata=00.00.00.00.00.00.00.00.00.19.00.10.80.00.06.06.ff.ff.ff.ff.ff.ff.00.00.ff.ff.00.18.00.00.23.20.00.06.00.20.00.40.00.00.00.01.de.10.00.00.20.04.ff.ff.00.18.00.00.23.20.00.06.00.20.00.60.00.00.00.01.de.10.00.00.22.04.00.19.00.10.80.00.2a.02.00.01.00.00.00.00.00.00.ff.ff.00.10.00.00.23.20.00.0e.ff.f8.20.00.00.00 > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,icmp_type=8,icmp_code=0 > icmp_csum:6013 > > .. > 2020-10-28T05:15:27.060Z|01102|dpif(handler10)|DBG|system@ovs-system: action > upcall: > recirc_id(0x3ad25),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),ct_state(0xa1),ct_zone(0x1fb),ct_mark(0),ct_label(0),ct_tuple4(src=172.16.160.1,dst=10.59.53.8,proto=1,tp_src=8,tp_dst=0),eth(src=fa:16:3e:93:f4:1e,dst=00:00:00:00:00:00),eth_type(0x0800),ipv4(src=172.16.160.1,dst=10.10.0.10,proto=1,tos=0,ttl=124,frag=no),icmp(type=8,code=0) > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,icmp_type=8,icmp_code=0 > icmp_csum:6012 > .. > 2020-10-28T05:15:27.061Z|00834|vconn|DBG|unix#1: sent (Success): > NXT_PACKET_IN2 (OF1.3) (xid=0x0): table_id=24 cookie=0x9173f925 total_len=74 > ct_state=new|trk|dnat,ct_zone=507,ct_nw_src=172.16.160.1,ct_nw_dst=10.59.53.8,ct_nw_proto=1,ct_tp_src=8,ct_tp_dst=0,ip,reg0=0xa0a000a,reg1=0xa0a0001,reg9=0x8,reg10=0x1,reg11=0x1fb,reg12=0x1fa,reg14=0x1,reg15=0x7,metadata=0x121,in_port=1 > (via action) data_len=74 (unbuffered) > > userdata=00.00.00.00.00.00.00.00.00.19.00.10.80.00.06.06.ff.ff.ff.ff.ff.ff.00.00.ff.ff.00.18.00.00.23.20.00.06.00.20.00.40.00.00.00.01.de.10.00.00.20.04.ff.ff.00.18.00.00.23.20.00.06.00.20.00.60.00.00.00.01.de.10.00.00.22.04.00.19.00.10.80.00.2a.02.00.01.00.00.00.00.00.00.ff.ff.00.10.00.00.23.20.00.0e.ff.f8.20.00.00.00 > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,icmp_type=8,icmp_code=0 > icmp_csum:6012 > .. > 2020-10-28T05:15:32.059Z|01359|dpif(handler8)|DBG|system@ovs-system: action > upcall: > recirc_id(0x3ad25),dp_hash(0),skb_priority(0),in_port(4),skb_mark(0),ct_state(0xa1),ct_zone(0x1fb),ct_mark(0),ct_label(0),ct_tuple4(src=172.16.160.1,dst=10.59.53.8,proto=1,tp_src=8,tp_dst=0),eth(src=fa:16:3e:93:f4:1e,dst=00:00:00:00:00:00),eth_type(0x0800),ipv4(src=172.16.160.1,dst=10.10.0.10,proto=1,tos=0,ttl=124,frag=no),icmp(type=8,code=0) > icmp,vlan_tci=0x,dl_src=fa:16:3e:93:f4:1e,dl_dst=00:00:00:00:00:00,nw_src=172.16.160.1,nw_dst=10.10.0.10,nw_tos=0,nw_ecn=0,nw_ttl=124,icmp_type=8,icmp_code=0 > icmp_csum:6011 > .. > 2020-10-28T05:15:32.060Z|00856|vconn|DBG|unix#1: sent (Success): > NXT_PACKET_IN2 (OF1.3) (xid=0x0): table_id=24 cookie=0x9173f925 total_len=74 > ct_state=new|trk|dnat,ct_zone=507,ct_nw_src=172.16.160.1,ct_nw_dst=10.59.53.8,ct_nw_proto=1,ct_tp_src=8,ct_tp_dst=0,ip,reg0=0xa0a000a,reg1=0xa0a0001,reg9=0x8,reg10=0x1,reg11=0x1fb,reg12=0x1fa,reg14=0x1,reg15=0x7,metadata=0x121,in_port=1 > (via action) data_len=74 (unbuffered) > > userdata=00.00.00.00.00.00.00.00.00.19.00.10.80.00.06.06.ff.ff.ff.ff.ff.ff.00.00.ff.ff.00.18.00.00.23.20.00.06.00.20.00.40.00.00.00.01.de.10.00.00.20.04.ff.ff.00.18.00.00.23.20.00.06.00.20.00.60.00.00.00.01.de.10.00.00.22.04.00.19.00.10.80.00.2a.02.00.01.00.00.00.00.00.00.ff.ff.00.10.00.00.23.20.00.0e.ff.f8.20.00.00.00 >
