Re: [CentOS-virt] [Advice] CentOS6 + KVM + bonding + bridging
On 09/06/2012 12:19 PM, SilverTip257 wrote: > My question to the members of this list is what bonding mode(s) are > you using for a high availability setup? > I welcome any advice/tips/gotchas on bridging to a bonded interface. I'm not sure I'd call this high availability... but here's an example of bonding two ethernet ports (eth0 and eth1) together into a bond (mode 4) and then setting up a bridge for a VLAN (id 375) that some VMs can run on: [root@kvm01a network-scripts]# grep -iv hwadd ifcfg-eth0 DEVICE=eth0 SLAVE=yes MASTER=bond0 [root@kvm01a network-scripts]# grep -iv hwadd ifcfg-eth1 DEVICE=eth1 SLAVE=yes MASTER=bond0 [root@kvm01a network-scripts]# cat ifcfg-bond0 | sed 's/[1-9]/x/g' DEVICE=bond0 ONBOOT=yes BOOTPROTO=static IPADDR=x0.xxx.xx.xx NETMASK=xxx.xxx.xxx.0 DNSx=xx0.xxx.xxx.xxx DNSx=x0.xxx.xx.xx DNSx=x0.xxx.xx.x0 [root@kvm01a network-scripts]# cat ifcfg-br375 DEVICE=br375 BOOTPROTO=none TYPE=Bridge ONBOOT=yes [root@kvm01a network-scripts]# cat ifcfg-bond0.375 DEVICE=bond0.375 BOOTPROTO=none ONBOOT=yes VLAN=yes BRIDGE=br375 [root@kvm01a network-scripts]# cat /etc/modprobe.d/local.conf alias bond0 bonding options bonding mode=4 miimon=100 [root@kvm01a network-scripts]# grep Mode /proc/net/bonding/bond0 Bonding Mode: IEEE 802.3ad Dynamic link aggregation [root@kvm01a network-scripts]# egrep '^V|375' /proc/net/vlan/config VLAN Dev name| VLAN ID bond0.375 | 375 | bond0 Repeat ad nauseam for the other VLANs you want to put VMs on (assuming your switch is trunking them to your hypervisor). See also http://backdrift.org/howtonetworkbonding via http://irclog.perlgeek.de/crimsonfu/2012-08-15#i_5900501 Phil ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
Re: [CentOS-virt] [Advice] CentOS6 + KVM + bonding + bridging
On 09/06/2012 06:19 PM, SilverTip257 wrote: > With the current talk on bonding, I have a few questions of my own. > > > I'm setting up a KVM host with CentOS 6.3 x86_64 on which I'd like to > attach the VMs to a bonded interface. > My target setup is one where two GigE NICs are bonded and then the KVM > bridge interface is attached to the bonded interface. > > Initially I tried to use the balance-alb mode (mode6), but had little > luck (receiving traffic on the bond appeared to be non-functional from > the perspective of a VM). After some reading [0] [1] - I switched the > mode to balance-tlb (mode5) and hosts are now reachable. > > See bottom of [0] for a note on "known ARP problem for bridge on a > bonded interface". > > I'd prefer mode5 or 6 since it would balance between my slave > interfaces and need not worry about 802.3ad support (mode4) on the > switch this host will be connected to. But the way it seems mode 6 > isn't going to work out for me. (Maybe experimenting with mode4 is > the way to go.) > > [0] http://www.linux-kvm.org/page/HOWTO_BONDING > [1] https://lists.linux-foundation.org/pipermail/bridge/2007-April/005376.html > > > My question to the members of this list is what bonding mode(s) are > you using for a high availability setup? > I welcome any advice/tips/gotchas on bridging to a bonded interface. You probably either want to use Centos 6.2 or wait for 6.4. Apparently there have been some changes in the network device infrastructure with 6.3 kernels which resulted in bonding issues especially when used with vlan tagging. I've been bitten by this and these issues have been addressed on the red hat bugzilla but it's not entirely clear which kernel contains all the final fixes. Regards, Dennis ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] [Advice] CentOS6 + KVM + bonding + bridging
With the current talk on bonding, I have a few questions of my own. I'm setting up a KVM host with CentOS 6.3 x86_64 on which I'd like to attach the VMs to a bonded interface. My target setup is one where two GigE NICs are bonded and then the KVM bridge interface is attached to the bonded interface. Initially I tried to use the balance-alb mode (mode6), but had little luck (receiving traffic on the bond appeared to be non-functional from the perspective of a VM). After some reading [0] [1] - I switched the mode to balance-tlb (mode5) and hosts are now reachable. See bottom of [0] for a note on "known ARP problem for bridge on a bonded interface". I'd prefer mode5 or 6 since it would balance between my slave interfaces and need not worry about 802.3ad support (mode4) on the switch this host will be connected to. But the way it seems mode 6 isn't going to work out for me. (Maybe experimenting with mode4 is the way to go.) [0] http://www.linux-kvm.org/page/HOWTO_BONDING [1] https://lists.linux-foundation.org/pipermail/bridge/2007-April/005376.html My question to the members of this list is what bonding mode(s) are you using for a high availability setup? I welcome any advice/tips/gotchas on bridging to a bonded interface. Thanks! ---~~.~~--- Mike // SilverTip257 // ___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
[CentOS-virt] Antwort: Re: 802.3ad + Centos 6 + KVM (bridging)
centos-virt-boun...@centos.org schrieb am 06.09.2012 00:51:38: > Alexander Dalloz > Gesendet von: centos-virt-boun...@centos.org > > 06.09.2012 00:52 > > Bitte antworten an > Discussion about the virtualization on CentOS > > An > > Discussion about the virtualization on CentOS > > Kopie > > Thema > > Re: [CentOS-virt] 802.3ad + Centos 6 + KVM (bridging) > > Am 05.09.2012 21:40, schrieb aurfalien: > > Hi all, > > > > Don't mean to double post as I sent this to the general Centos list. > > > > But, does any one have 802.3ad (mode 4) working on there Centos6 KVM setup? > > > > This would be a bridge+bond setup of course. > > > > If not possible, would I still bond the interfaces on the switch > and then bond them in the guest rather then from within the hypervisor? > > > > - aurf > > Can you explain what your precise problem is? > > I have a setup where eth0 and eth1 are bond0 (LACP) slaves and bond0 is > part of a bridge br0 (in addition VLAN is involved). That's on the KVM > host, a CentOS 6.3 install. > > Alexander > > ___ > CentOS-virt mailing list > CentOS-virt@centos.org > http://lists.centos.org/mailman/listinfo/centos-virt I've the near the same problem: Server with bondig with 802.3ad (mode 4). This works without problem. But on this server there 4 KVM-VM in the same subnet as the server. The VM can ping all server in the subnet, but not the other VM and the host. Mit freundlichen Grüßen Andreas Reschke Unix/Linux-Administration andreas.resc...@behrgroup.com___ CentOS-virt mailing list CentOS-virt@centos.org http://lists.centos.org/mailman/listinfo/centos-virt
