[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
It would be worth testing this with a container in place of a kvm VM. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/iperf/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
That's a good question :) ** Changed in: qemu-kvm (Ubuntu) Importance: Undecided => Medium ** Changed in: qemu-kvm (Ubuntu) Status: New => Confirmed ** Changed in: iperf (Ubuntu) Importance: Undecided => Medium ** Changed in: iperf (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/iperf/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Yes, it seems a lot like an iperf bug. I did the same test with uperf and got full bandwith. Even bonding works well: ubuntu5# bmon # Interface RX Rate RX # TX Rate TX # --- ubuntu5 (source: local) 0 br2 39.00B0 377.00B0 6 bond2216.04MiB 213299 213.28MiB 179034 12 vnet0106.83MiB 35932 107.96MiB 51115 15 eth1 103.92MiB 103566 102.63MiB 85928 17 eth2 112.11MiB 109715 110.58MiB 93057 22 vnet1 99.18MiB 32968 100.49MiB 49117 What I do not know is, why this occurs only with iperf on virtual machines talking to another iperf instance on the network. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/iperf/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
** Changed in: linux (Ubuntu) Importance: Undecided => Medium -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/iperf/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
** Also affects: iperf (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/iperf/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Actually, it seems like this might be an iperf bug. The man page specifically says: "The threading implementation is rather heinous." -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Was able to easily reproduce this now with just 'iperf -c -d". When I ran your longer loop before it never seemed to happen. I believe '-n 10' just made it transfer more data, which smoothed over the inequities here. [ ID] Interval Transfer Bandwidth [ 5] 0.0-10.0 sec 20.5 MBytes 17.1 Mbits/sec [ 4] 0.0-10.0 sec 564 MBytes 471 Mbits/sec I'm not sure there's really a bug here, as opposed to the host cpu doing the best it can to load-balance too much work. I'll re-try with raring now and look for any differences. -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
Re: [Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Quoting ITec (1079...@bugs.launchpad.net): Thanks for the .xml. Nothing stands out there... > What could you have done differently? The main thing is that I used raring, not quantal. This could be somethign which was fixed in either qemu or the kernel. > - Did you run 2 VMs at the same time? yup > - Is networking on your VMs using virtio? yup > - Did you start "iperf -s" on both VMs? yup > - Did you use iperf with "-d" option on two remote hosts to connect to the VMs? No, i did so from a single host. I used two laptops connected over an ethernet cable (with the one beign pxe+dhcp server for the other, my regular install setup). > - Are all hosts (KVM hypervisor, and both remote hosts) connected to the same physical network switch by 1Gbit/s? No switch involved. I'll try using just quantal first on the VM host, but wouldn't that be interesting if adding a switch caused this! -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
What could you have done differently? - Did you run 2 VMs at the same time? - Is networking on your VMs using virtio? - Did you start "iperf -s" on both VMs? - Did you use iperf with "-d" option on two remote hosts to connect to the VMs? - Are all hosts (KVM hypervisor, and both remote hosts) connected to the same physical network switch by 1Gbit/s? ** Attachment added: "vm3.xml" https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1079212/+attachment/3443962/+files/vm3.xml -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Thanks for the effort to try to reproduce this. Yes, vmhost_net is loaded. ubuntu5# lsmod Module Size Used by vhost_net 31873 3 macvtap18293 1 vhost_net macvlan19002 1 macvtap ipmi_devintf 17521 0 ipmi_si52889 0 ipmi_msghandler45243 2 ipmi_devintf,ipmi_si ip6table_filter12815 0 ip6_tables 27207 1 ip6table_filter ebtable_nat12807 0 ebtables 30671 1 ebtable_nat ipt_MASQUERADE 12759 3 iptable_nat13182 1 nf_nat 25254 2 ipt_MASQUERADE,iptable_nat nf_conntrack_ipv4 14480 4 iptable_nat,nf_nat nf_defrag_ipv4 12729 1 nf_conntrack_ipv4 xt_state 12578 1 nf_conntrack 82633 5 ipt_MASQUERADE,iptable_nat,nf_nat,nf_conntrack_ipv4,xt_state ipt_REJECT 12541 4 xt_CHECKSUM12549 2 iptable_mangle 12695 1 xt_tcpudp 12603 10 iptable_filter 12810 1 ip_tables 26995 3 iptable_nat,iptable_mangle,iptable_filter x_tables 29711 12 ip6table_filter,ip6_tables,ebtables,ipt_MASQUERADE,iptable_nat,xt_state,ipt_REJECT,xt_CHECKSUM,iptable_mangle,xt_tcpudp,iptable_filter,ip_tables bridge 90446 0 stp12931 1 bridge llc14552 2 bridge,stp bonding 107986 0 vesafb 13797 1 kvm_amd55604 7 kvm 414070 1 kvm_amd dm_multipath 22828 0 scsi_dh14554 1 dm_multipath ghash_clmulni_intel13180 0 aesni_intel51037 0 cryptd 20403 2 ghash_clmulni_intel,aesni_intel aes_x86_64 17208 1 aesni_intel amd64_edac_mod 23904 0 microcode 22803 0 edac_core 52451 6 amd64_edac_mod psmouse95552 0 sp5100_tco 13697 0 edac_mce_amd 23303 1 amd64_edac_mod i2c_piix4 13167 0 joydev 17457 0 serio_raw 13215 0 fam15h_power 13119 0 k10temp13126 0 mac_hid13205 0 w83627ehf 42929 0 hwmon_vid 12783 1 w83627ehf lp 17759 0 parport46345 1 lp xfs 837979 6 hid_generic12493 0 usbhid 46947 0 hid 100366 2 hid_generic,usbhid r8169 61650 0 qla2xxx 471919 0 pata_atiixp13204 0 scsi_transport_fc 58962 1 qla2xxx igb 129237 0 scsi_tgt 20065 1 scsi_transport_fc e1000e199114 0 arcmsr 32514 6 dca15130 1 igb ** Attachment added: "vm2.xml" https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1079212/+attachment/3443961/+files/vm2.xml -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
I tried to reproduce this on a raring host I had handy and could not. The throughput definately varied, but was not consistently lopsided. This doesn't mean it is not present in quantal, or that I didn't do something different from you. Is the vhost_net kernel module loaded? Could you please show the xml for the vms? -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
** Attachment added: "apport.linux" https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1079212/+attachment/3435402/+files/apport.linux-image-3.5.0-18-generic.a5kfg4.apport -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
Since I do not have direct access to the internet on that machine, I had to do: apport-cli -f -p linux; apport-cli -f -p qemu-kvm ** Attachment added: "apport.qemu-kvm" https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/1079212/+attachment/3435401/+files/apport.qemu-kvm.n_27o0.apport -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Bug 1079212] Re: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host
** Also affects: linux (Ubuntu) Importance: Undecided Status: New ** Tags added: kvm-linux -- You received this bug notification because you are a member of Ubuntu Server Team, which is subscribed to qemu-kvm in Ubuntu. https://bugs.launchpad.net/bugs/1079212 Title: network slow when 2 VMs using virtio net bridged to same pyhs. network device on kvm host To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1079212/+subscriptions -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
