Re: Very BIG mess with networking
I'm fine with just a beer :P Glad you solved that one ! On Wed, 26 Jun 2019 at 11:53, Alessandro Caviglione wrote: > Hi Andrija, > I want to say a big THANK YOU for your suggestions, I changed bond mode and > Network name on XenSerevr Pool and updated network name on CS... and it > works now!! > Thank you again!! > A big hug! :) > > On Tue, Jun 25, 2019 at 12:45 PM Andrija Panic > wrote: > > > I would say, to make sure you have identical network/bond setup as before > > (irrelevant of which chils pifs are in the bond/network) - so from > > CloudStack point of view, you did zero changes (same networks/bind). > > > > Limited reading capabilities from myside on mobile...but I would say that > > pluging in the vif for a guest Network is the problem - in XenServer > logs, > > you can clearly see error while joining slave interface (vif) to the > > network - but again, not sure which network is it (public or guest > Network) > > > > On Tue, Jun 25, 2019, 10:50 Alessandro Caviglione < > c.alessan...@gmail.com> > > wrote: > > > > > No, new bond have the same name... > > > In the log there is: > > > > > > Found more than one network with the name Public > > > 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] > > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) *Found a network called > > > Public on host=192.168.200.39; > > > Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; > > > pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c* > > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif > > > dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 > > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for > r-899-VM > > on > > > nic [Nic:Guest-10.122.12.1-vlan://384] > > > 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network > named > > > GuestVM > > > 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] > > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > > > GuestVM on host=192.168.200.39; > > > Network=300e55f0-88ff-a460-e498-e75424bc292a; > > > pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc > > > > > > So it seems that, however, it get the right Network and continue to > > looking > > > for other network. > > > Do you think this is the issue also if CS continue with other tasks > > instead > > > stops founding more than one network Public? > > > Could I simply change network name in Xen Pool and update in CS? > > > > > > On Tue, Jun 25, 2019 at 9:52 AM Andrija Panic > > > > wrote: > > > > > > > If your new bond have changes name, have you changed also XenServer > > > Traffic > > > > Label in CloudStack ? > > > > Active-active is known to be sometimes very problematic, switch back > to > > > > active-passive until you solve your issues. Experiment later with > > > > active-active. > > > > > > > > > > > > > > > > On Tue, Jun 25, 2019, 09:34 Michael Kesper > > > wrote: > > > > > > > > > Hi Alessandro, > > > > > > > > > > On 25.06.19 08:43, Alessandro Caviglione wrote: > > > > > > complains on more than one network with name Publci... ??? > > > > > > > > > > [...] > > > > > > > > > > >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for > network > > > > named > > > > > >> Public > > > > > >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than > one > > > > > > network > > > > > >> with the name Public > > > > > > > > > > Bye > > > > > Michael > > > > > > > > > > > > > > > > > > > > > > > > > -- Andrija Panić
Re: Very BIG mess with networking
Hi Andrija, I want to say a big THANK YOU for your suggestions, I changed bond mode and Network name on XenSerevr Pool and updated network name on CS... and it works now!! Thank you again!! A big hug! :) On Tue, Jun 25, 2019 at 12:45 PM Andrija Panic wrote: > I would say, to make sure you have identical network/bond setup as before > (irrelevant of which chils pifs are in the bond/network) - so from > CloudStack point of view, you did zero changes (same networks/bind). > > Limited reading capabilities from myside on mobile...but I would say that > pluging in the vif for a guest Network is the problem - in XenServer logs, > you can clearly see error while joining slave interface (vif) to the > network - but again, not sure which network is it (public or guest Network) > > On Tue, Jun 25, 2019, 10:50 Alessandro Caviglione > wrote: > > > No, new bond have the same name... > > In the log there is: > > > > Found more than one network with the name Public > > 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) *Found a network called > > Public on host=192.168.200.39; > > Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; > > pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c* > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif > > dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM > on > > nic [Nic:Guest-10.122.12.1-vlan://384] > > 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > > GuestVM > > 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > > GuestVM on host=192.168.200.39; > > Network=300e55f0-88ff-a460-e498-e75424bc292a; > > pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc > > > > So it seems that, however, it get the right Network and continue to > looking > > for other network. > > Do you think this is the issue also if CS continue with other tasks > instead > > stops founding more than one network Public? > > Could I simply change network name in Xen Pool and update in CS? > > > > On Tue, Jun 25, 2019 at 9:52 AM Andrija Panic > > wrote: > > > > > If your new bond have changes name, have you changed also XenServer > > Traffic > > > Label in CloudStack ? > > > Active-active is known to be sometimes very problematic, switch back to > > > active-passive until you solve your issues. Experiment later with > > > active-active. > > > > > > > > > > > > On Tue, Jun 25, 2019, 09:34 Michael Kesper > > wrote: > > > > > > > Hi Alessandro, > > > > > > > > On 25.06.19 08:43, Alessandro Caviglione wrote: > > > > > complains on more than one network with name Publci... ??? > > > > > > > > [...] > > > > > > > > >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network > > > named > > > > >> Public > > > > >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > > > > > network > > > > >> with the name Public > > > > > > > > Bye > > > > Michael > > > > > > > > > > > > > > > > > >
Re: Very BIG mess with networking
I would say, to make sure you have identical network/bond setup as before (irrelevant of which chils pifs are in the bond/network) - so from CloudStack point of view, you did zero changes (same networks/bind). Limited reading capabilities from myside on mobile...but I would say that pluging in the vif for a guest Network is the problem - in XenServer logs, you can clearly see error while joining slave interface (vif) to the network - but again, not sure which network is it (public or guest Network) On Tue, Jun 25, 2019, 10:50 Alessandro Caviglione wrote: > No, new bond have the same name... > In the log there is: > > Found more than one network with the name Public > 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) *Found a network called > Public on host=192.168.200.39; > Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; > pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c* > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif > dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on > nic [Nic:Guest-10.122.12.1-vlan://384] > 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > GuestVM > 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > GuestVM on host=192.168.200.39; > Network=300e55f0-88ff-a460-e498-e75424bc292a; > pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc > > So it seems that, however, it get the right Network and continue to looking > for other network. > Do you think this is the issue also if CS continue with other tasks instead > stops founding more than one network Public? > Could I simply change network name in Xen Pool and update in CS? > > On Tue, Jun 25, 2019 at 9:52 AM Andrija Panic > wrote: > > > If your new bond have changes name, have you changed also XenServer > Traffic > > Label in CloudStack ? > > Active-active is known to be sometimes very problematic, switch back to > > active-passive until you solve your issues. Experiment later with > > active-active. > > > > > > > > On Tue, Jun 25, 2019, 09:34 Michael Kesper > wrote: > > > > > Hi Alessandro, > > > > > > On 25.06.19 08:43, Alessandro Caviglione wrote: > > > > complains on more than one network with name Publci... ??? > > > > > > [...] > > > > > > >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network > > named > > > >> Public > > > >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > > > > network > > > >> with the name Public > > > > > > Bye > > > Michael > > > > > > > > > > > >
Re: Very BIG mess with networking
No, new bond have the same name... In the log there is: Found more than one network with the name Public 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) *Found a network called Public on host=192.168.200.39; Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c* 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on nic [Nic:Guest-10.122.12.1-vlan://384] 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named GuestVM 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called GuestVM on host=192.168.200.39; Network=300e55f0-88ff-a460-e498-e75424bc292a; pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc So it seems that, however, it get the right Network and continue to looking for other network. Do you think this is the issue also if CS continue with other tasks instead stops founding more than one network Public? Could I simply change network name in Xen Pool and update in CS? On Tue, Jun 25, 2019 at 9:52 AM Andrija Panic wrote: > If your new bond have changes name, have you changed also XenServer Traffic > Label in CloudStack ? > Active-active is known to be sometimes very problematic, switch back to > active-passive until you solve your issues. Experiment later with > active-active. > > > > On Tue, Jun 25, 2019, 09:34 Michael Kesper wrote: > > > Hi Alessandro, > > > > On 25.06.19 08:43, Alessandro Caviglione wrote: > > > complains on more than one network with name Publci... ??? > > > > [...] > > > > >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network > named > > >> Public > > >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > > > network > > >> with the name Public > > > > Bye > > Michael > > > > > > >
Re: Very BIG mess with networking
If your new bond have changes name, have you changed also XenServer Traffic Label in CloudStack ? Active-active is known to be sometimes very problematic, switch back to active-passive until you solve your issues. Experiment later with active-active. On Tue, Jun 25, 2019, 09:34 Michael Kesper wrote: > Hi Alessandro, > > On 25.06.19 08:43, Alessandro Caviglione wrote: > > complains on more than one network with name Publci... ??? > > [...] > > >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > >> Public > >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > > network > >> with the name Public > > Bye > Michael > > >
Re: Very BIG mess with networking
Hi Alessandro, On 25.06.19 08:43, Alessandro Caviglione wrote: > complains on more than one network with name Publci... ??? [...] >> 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named >> Public >> 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] >> (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > network >> with the name Public Bye Michael signature.asc Description: OpenPGP digital signature
Re: Very BIG mess with networking
complains on more than one network with name Publci... ??? On Tue, Jun 25, 2019 at 6:41 AM Andrija Panic wrote: > Quick one... > > > Issues creating slave interface are reported by XenS. > Active-active ia VERY problematic on XenS, revert to lacp or something.acs > complains on more than one network with name Publci... > > > Best... > > On Tue, Jun 25, 2019, 01:15 Alessandro Caviglione > wrote: > > > Hi guys, > > I'm experiencing a big issue with networking. > > First of all, we're running CS 4.11.2 on XS 6.5 with Advanced Networking. > > Our XS Pool network conf was: > > - eth0 Management > > - eth1 empty > > - eth2 Public > > - eth3 empty > > - eth4 + eth5: bond LACP for GuestVM > > > > During our last maintenance last week, we decided to create a new bond > > active-passive for Management (eth0 + eth1) and a new bond for Public > > (eth2 + eth3) > > In addition, we would change GuestVM bond from LACP to active-active. > > So, we created from pool master a new bond and put eth0 + eth1 interface > > in. > > > > MGT_NET_UUID=$(xe network-create name-label=Management) > > PMI_PIF_UUID=$(xe pif-list host-uuid=xxx management=true params=uuid | > awk > > '{ print $5 }') > > MGT_PIF0_UUID=$(xe pif-list host-uuid=xxx device=eth0 params=uuid | awk > '{ > > print $5 }') > > MGT_PIF1_UUID=$(xe pif-list host-uuid=xxx device=eth1 params=uuid | awk > '{ > > print $5 }') > > xe bond-create network-uuid=$MGT_NET_UUID > > pif-uuids=$PMI_PIF_UUID,$MGT_PIF1_UUID mode=active-backup > > > > I used the same method to create new bond for Public network (obviously > > changing nics). > > > > To change bond mode for GuestVM network I've used: > > > > xe pif-list device=bond0 VLAN=-1 > > xe pif-param-set uuid= other-config:bond-mode=balance-slb > > > > I've repeated Public and GuestVM commands on each of the three hosts in > the > > pool, for Management I've done it only on Pool Master. > > After that I've restarted toolstack and (after the issue I'll explain) > also > > reboot every host. > > However, this is the result: > > - Existing VMs runs fine and I can stop, start, migrate > > - New VM that require new network will fail > > - restart network with clean will fail and makes network and instance > > unavailable > > > > This is the CS log: > > > > 2019-06-25 00:14:35,751 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created VM > > dbb045ef-5072-96ef-fbb0-1d7e3af0a0ea for r-899-VM > > 2019-06-25 00:14:35,756 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) PV args are > > > > > %template=domP%name=r-899-VM%eth2ip=31.44.38.53%eth2mask=255.255.255.240%gateway=31.44.38.49%eth0ip=10.122.12.1%eth0mask=255.255.255.0%domain= > > tet.com > > > > > %cidrsize=24%dhcprange=10.122.12.1%eth1ip=169.254.3.241%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%dns2=8.8.4.4 > > 2019-06-25 00:14:35,757 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) HVM args are > template=domP > > name=r-899-VM eth2ip=31.44.38.53 eth2mask=255.255.255.240 > > gateway=31.44.38.49 eth0ip=10.122.12.1 eth0mask=255.255.255.0 domain= > > tet.com > > cidrsize=24 dhcprange=10.122.12.1 eth1ip=169.254.3.241 > eth1mask=255.255.0.0 > > type=router disable_rp_filter=true dns1=8.8.8.8 dns2=8.8.4.4 > > 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) VBD > > ec5e1e54-5902-cbcb-a6a8-abec0479d27c created for > > com.cloud.agent.api.to.DiskTO@36117847 > > 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM > on > > nic [Nic:Public-31.44.38.53-vlan://untagged] > > 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > > Public > > 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one > network > > with the name Public > > 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > > Public on host=192.168.200.39; > > Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; > > pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif > > dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 > > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM > on > > nic [Nic:Guest-10.122.12.1-vlan://384] > > 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > > GuestVM > > 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] > > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > >
Re: Very BIG mess with networking
Quick one... Issues creating slave interface are reported by XenS. Active-active ia VERY problematic on XenS, revert to lacp or something.acs complains on more than one network with name Publci... Best... On Tue, Jun 25, 2019, 01:15 Alessandro Caviglione wrote: > Hi guys, > I'm experiencing a big issue with networking. > First of all, we're running CS 4.11.2 on XS 6.5 with Advanced Networking. > Our XS Pool network conf was: > - eth0 Management > - eth1 empty > - eth2 Public > - eth3 empty > - eth4 + eth5: bond LACP for GuestVM > > During our last maintenance last week, we decided to create a new bond > active-passive for Management (eth0 + eth1) and a new bond for Public > (eth2 + eth3) > In addition, we would change GuestVM bond from LACP to active-active. > So, we created from pool master a new bond and put eth0 + eth1 interface > in. > > MGT_NET_UUID=$(xe network-create name-label=Management) > PMI_PIF_UUID=$(xe pif-list host-uuid=xxx management=true params=uuid | awk > '{ print $5 }') > MGT_PIF0_UUID=$(xe pif-list host-uuid=xxx device=eth0 params=uuid | awk '{ > print $5 }') > MGT_PIF1_UUID=$(xe pif-list host-uuid=xxx device=eth1 params=uuid | awk '{ > print $5 }') > xe bond-create network-uuid=$MGT_NET_UUID > pif-uuids=$PMI_PIF_UUID,$MGT_PIF1_UUID mode=active-backup > > I used the same method to create new bond for Public network (obviously > changing nics). > > To change bond mode for GuestVM network I've used: > > xe pif-list device=bond0 VLAN=-1 > xe pif-param-set uuid= other-config:bond-mode=balance-slb > > I've repeated Public and GuestVM commands on each of the three hosts in the > pool, for Management I've done it only on Pool Master. > After that I've restarted toolstack and (after the issue I'll explain) also > reboot every host. > However, this is the result: > - Existing VMs runs fine and I can stop, start, migrate > - New VM that require new network will fail > - restart network with clean will fail and makes network and instance > unavailable > > This is the CS log: > > 2019-06-25 00:14:35,751 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created VM > dbb045ef-5072-96ef-fbb0-1d7e3af0a0ea for r-899-VM > 2019-06-25 00:14:35,756 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) PV args are > > %template=domP%name=r-899-VM%eth2ip=31.44.38.53%eth2mask=255.255.255.240%gateway=31.44.38.49%eth0ip=10.122.12.1%eth0mask=255.255.255.0%domain= > tet.com > > %cidrsize=24%dhcprange=10.122.12.1%eth1ip=169.254.3.241%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%dns2=8.8.4.4 > 2019-06-25 00:14:35,757 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) HVM args are template=domP > name=r-899-VM eth2ip=31.44.38.53 eth2mask=255.255.255.240 > gateway=31.44.38.49 eth0ip=10.122.12.1 eth0mask=255.255.255.0 domain= > tet.com > cidrsize=24 dhcprange=10.122.12.1 eth1ip=169.254.3.241 eth1mask=255.255.0.0 > type=router disable_rp_filter=true dns1=8.8.8.8 dns2=8.8.4.4 > 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) VBD > ec5e1e54-5902-cbcb-a6a8-abec0479d27c created for > com.cloud.agent.api.to.DiskTO@36117847 > 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on > nic [Nic:Public-31.44.38.53-vlan://untagged] > 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > Public > 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one network > with the name Public > 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > Public on host=192.168.200.39; > Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; > pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif > dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 > 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on > nic [Nic:Guest-10.122.12.1-vlan://384] > 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named > GuestVM > 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called > GuestVM on host=192.168.200.39; > Network=300e55f0-88ff-a460-e498-e75424bc292a; > pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc > 2019-06-25 00:14:35,826 DEBUG [c.c.h.x.r.CitrixResourceBase] > (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VLAN 384 on host > 192.168.200.39 on device bond0 > 2019-06-25 00:14:36,467 DEBUG
Very BIG mess with networking
Hi guys, I'm experiencing a big issue with networking. First of all, we're running CS 4.11.2 on XS 6.5 with Advanced Networking. Our XS Pool network conf was: - eth0 Management - eth1 empty - eth2 Public - eth3 empty - eth4 + eth5: bond LACP for GuestVM During our last maintenance last week, we decided to create a new bond active-passive for Management (eth0 + eth1) and a new bond for Public (eth2 + eth3) In addition, we would change GuestVM bond from LACP to active-active. So, we created from pool master a new bond and put eth0 + eth1 interface in. MGT_NET_UUID=$(xe network-create name-label=Management) PMI_PIF_UUID=$(xe pif-list host-uuid=xxx management=true params=uuid | awk '{ print $5 }') MGT_PIF0_UUID=$(xe pif-list host-uuid=xxx device=eth0 params=uuid | awk '{ print $5 }') MGT_PIF1_UUID=$(xe pif-list host-uuid=xxx device=eth1 params=uuid | awk '{ print $5 }') xe bond-create network-uuid=$MGT_NET_UUID pif-uuids=$PMI_PIF_UUID,$MGT_PIF1_UUID mode=active-backup I used the same method to create new bond for Public network (obviously changing nics). To change bond mode for GuestVM network I've used: xe pif-list device=bond0 VLAN=-1 xe pif-param-set uuid= other-config:bond-mode=balance-slb I've repeated Public and GuestVM commands on each of the three hosts in the pool, for Management I've done it only on Pool Master. After that I've restarted toolstack and (after the issue I'll explain) also reboot every host. However, this is the result: - Existing VMs runs fine and I can stop, start, migrate - New VM that require new network will fail - restart network with clean will fail and makes network and instance unavailable This is the CS log: 2019-06-25 00:14:35,751 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created VM dbb045ef-5072-96ef-fbb0-1d7e3af0a0ea for r-899-VM 2019-06-25 00:14:35,756 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) PV args are %template=domP%name=r-899-VM%eth2ip=31.44.38.53%eth2mask=255.255.255.240%gateway=31.44.38.49%eth0ip=10.122.12.1%eth0mask=255.255.255.0%domain= tet.com %cidrsize=24%dhcprange=10.122.12.1%eth1ip=169.254.3.241%eth1mask=255.255.0.0%type=router%disable_rp_filter=true%dns1=8.8.8.8%dns2=8.8.4.4 2019-06-25 00:14:35,757 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) HVM args are template=domP name=r-899-VM eth2ip=31.44.38.53 eth2mask=255.255.255.240 gateway=31.44.38.49 eth0ip=10.122.12.1 eth0mask=255.255.255.0 domain=tet.com cidrsize=24 dhcprange=10.122.12.1 eth1ip=169.254.3.241 eth1mask=255.255.0.0 type=router disable_rp_filter=true dns1=8.8.8.8 dns2=8.8.4.4 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) VBD ec5e1e54-5902-cbcb-a6a8-abec0479d27c created for com.cloud.agent.api.to.DiskTO@36117847 2019-06-25 00:14:35,790 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on nic [Nic:Public-31.44.38.53-vlan://untagged] 2019-06-25 00:14:35,792 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named Public 2019-06-25 00:14:35,793 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found more than one network with the name Public 2019-06-25 00:14:35,802 DEBUG [c.c.h.x.r.XsLocalNetwork] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called Public on host=192.168.200.39; Network=9fa48b75-d68e-feaf-2eb4-8a7340f8c89b; pif=ca4c1679-fa36-bc93-37de-28a74ddc4f2c 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif dfaab3d7-7921-e4d5-ba27-537e8d549a5c on 2 2019-06-25 00:14:35,807 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on nic [Nic:Guest-10.122.12.1-vlan://384] 2019-06-25 00:14:35,809 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Looking for network named GuestVM 2019-06-25 00:14:35,825 DEBUG [c.c.h.x.r.XsLocalNetwork] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Found a network called GuestVM on host=192.168.200.39; Network=300e55f0-88ff-a460-e498-e75424bc292a; pif=b67841c5-6361-0dbf-a63d-a3e9c1b9f2fc 2019-06-25 00:14:35,826 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VLAN 384 on host 192.168.200.39 on device bond0 2019-06-25 00:14:36,467 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) VLAN is created for 384. The uuid is e34dc684-8a87-7ef6-5a49-8214011f8c3c 2019-06-25 00:14:36,480 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Created a vif 94558211-6bc6-ce64-9535-6d424b2b072c on 0 2019-06-25 00:14:36,481 DEBUG [c.c.h.x.r.CitrixResourceBase] (DirectAgent-35:ctx-c5073156) (logid:0d9e7907) Creating VIF for r-899-VM on nic