Re: [CentOS-virt] poor performance with dom0 on centos7

[Pasi Kärkkäinen]

On Wed, Sep 16, 2015 at 09:46:52PM +0200, Christoph wrote:
> Hi
>

Hi,
 
> Im now pretty sure the problem is the DomU with NFS Server.
> 
> If I write on a NFS share from other Host (bare metal or other vm)
> then I see on my NFS server nearly the whole time 100% io at
> [jbd2/dm-5-8] process...
> If I write on a SMB share (same partition as nfs share) from other
> Host then it is a little bit better but still ever and ever again
> 100% io load
> 

Are you using nfs over UDP or TCP ? 

> If I write a 1GB file on the same partition (with nfs/samba share)
> with dd, I dont see the high io load...
> 
> Is there a known problem with nfs/smb shares and/or dm in xen domU's
> on centos 7 as dom0? With centos 6 as dom0 I didnt had the
> problem...
> (the partition with the shares is a raid5 software partition, soft
> raid is build in dom0 and as a xvd device passed through to the domU
> with the shares)
> 
> could selinux be the problem? I have it in permissive mode on all
> hosts here (dom0 and domU) not disabled...
> 

I don't think.

> Any hints for me?
> 

If you used NFS over UDP, try running it over TCP.

What does 'top' and/or 'iostat -x 1' say during the 'benchmark'  ?


-- Pasi

> Am 2015-09-01 06:47, schrieb Christoph:
> >Hi All
> >
> >it is possible to tune dom0/domU for better IO/network performance?
> >Since I have changed to Cenots7 dom0, I have a really poor IO
> >performance inside a PV VM.
> >
> >I have already done what is described on
> >http://wiki.xenproject.org/wiki/Tuning_Xen_for_Performance
> >It is better now but still significantly worse than with centos6 dom0
> >
> >my settings:
> >
> >xen parameter: dom0_mem=1024M cpufreq=xen dom0_max_vcpus=2
> >dom0_vcpus_pin
> >
> >xl sched-credit
> >Cpupool Pool-0: tslice=30ms ratelimit=1000us
> >NameID Weight  Cap
> >Domain-0 0   10240
> >samael   12560
> >satan25120
> >amon 32560
> >leviathan45120
> >
> >echo 1048576 > /proc/sys/net/ipv4/tcp_limit_output_bytes on dom0
> >
> >the both domU's satan and leviathan are very IO performance oriented
> >(NFS server and downloading vm)
> >
> >Is there something more what I can do or try?
> >
> >could it be a selinux issue? I have it in permissive mode there, not
> >disabled. But permissive means only to collect the info not enforcing
> >the rules...
> >
> >(I use the xen45 pkgs)
> 
> -- 
> --
> Greetz
> ___
> CentOS-virt mailing list
> CentOS-virt@centos.org
> https://lists.centos.org/mailman/listinfo/centos-virt
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

Re: [CentOS-virt] poor performance with dom0 on centos7

[Alvin Starr]

run mount -v on your old system and on the new system.
Look for differences in the NFS mounts.


On 09/17/2015 05:06 AM, Christoph wrote:

Am 2015-09-17 09:29, schrieb Pasi Kärkkäinen:


Are you using nfs over UDP or TCP ?



TCP, but Network cant be the bottleneck, have tested it with iperf 
between bare metal/domU's and the nfs domU and it was perfectly fast...




I don't think.


If you used NFS over UDP, try running it over TCP.


no I use it over TCP...



What does 'top' and/or 'iostat -x 1' say during the 'benchmark' ?


top:

top - 09:01:12 up 22:45,  1 user,  load average: 1,97, 2,01, 1,99
Tasks: 210 total,   1 running, 209 sleeping,   0 stopped,   0 zombie
%Cpu0  :  0,3 us,  1,0 sy,  0,0 ni, 91,4 id,  7,3 wa,  0,0 hi, 0,0 
si,  0,0 st
%Cpu1  :  0,0 us,  0,0 sy,  0,0 ni,100,0 id,  0,0 wa,  0,0 hi, 0,0 
si,  0,0 st
%Cpu2  :  0,0 us,  0,0 sy,  0,0 ni,100,0 id,  0,0 wa,  0,0 hi, 0,0 
si,  0,0 st
%Cpu3  :  0,0 us,  0,3 sy,  0,0 ni, 13,0 id, 86,7 wa,  0,0 hi, 0,0 
si,  0,0 st
KiB Mem :  1013016 total,19548 free,   591456 used,   402012 
buff/cache
KiB Swap:  1048572 total,   990776 free,57796 used.   353468 avail 
Mem


iostat:

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
   0,000,000,00   50,000,00   50,00

Device: rrqm/s   wrqm/s r/s w/srkB/swkB/s 
avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
xvda  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdb  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdc  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdd  0,00 0,000,00   26,00 0,00 2336,00   
179,6969,31 1060,620,00 1060,62  38,46 100,00
xvde  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdf  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdg  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdh  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdi  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdj  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-0  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-1  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-2  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-3  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-4  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-5  0,00 0,000,000,00 0,00 0,00 
0,0069,310,000,000,00   0,00 100,00
dm-6  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00


so not really a problem...




--
Alvin Starr   ||   voice: (905)513-7688
Netvel Inc.   ||   Cell:  (416)806-0133
al...@netvel.net  ||

___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

Re: [CentOS-virt] poor performance with dom0 on centos7

[Keith Roberts]

On 2 Sep 2015, at 09:22, Pasi Kärkkäinen  wrote:

> On Tue, Sep 01, 2015 at 06:47:18AM +0200, Christoph wrote:
>> Hi All
>> 
> 
> Hello,
> 
>> it is possible to tune dom0/domU for better IO/network performance?
>> Since I have changed to Cenots7 dom0, I have a really poor IO
>> performance inside a PV VM.
>> 
>> I have already done what is described on
>> http://wiki.xenproject.org/wiki/Tuning_Xen_for_Performance
>> It is better now but still significantly worse than with centos6 dom0
>> 
>> my settings:
>> 
>> xen parameter: dom0_mem=1024M cpufreq=xen dom0_max_vcpus=2
>> dom0_vcpus_pin
>> 
>> xl sched-credit
>> Cpupool Pool-0: tslice=30ms ratelimit=1000us
>> NameID Weight  Cap
>> Domain-0 0   10240
>> samael   12560
>> satan25120
>> amon 32560
>> leviathan45120
>> 
>> echo 1048576 > /proc/sys/net/ipv4/tcp_limit_output_bytes on dom0
>> 
>> the both domU's satan and leviathan are very IO performance oriented
>> (NFS server and downloading vm)
>> 
>> Is there something more what I can do or try?
>> 
>> could it be a selinux issue? I have it in permissive mode there, not
>> disabled. But permissive means only to collect the info not enforcing
>> the rules...
>> 
>> (I use the xen45 pkgs)
>> 
> 
> You forgot to mention the most important thing.. what kind of performance 
> numbers are you seeing? What are you expecting? 
> 
> 
> Thanks,
> 
> —
> Pasi


Here’s a useful disk i/o stress test program that I got good results with on 
openSUSE 13.1, by running it on several VM’s overnight:

Using Bonnie++ for filesystem performance benchmarking
http://archive09.linux.com/feature/139742

HTH

Keith Roberts
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

Re: [CentOS-virt] poor performance with dom0 on centos7

[Christoph]

Am 2015-09-17 09:29, schrieb Pasi Kärkkäinen:


Are you using nfs over UDP or TCP ?



TCP, but Network cant be the bottleneck, have tested it with iperf 
between bare metal/domU's and the nfs domU and it was perfectly fast...




I don't think.


If you used NFS over UDP, try running it over TCP.


no I use it over TCP...



What does 'top' and/or 'iostat -x 1' say during the 'benchmark'  ?


top:

top - 09:01:12 up 22:45,  1 user,  load average: 1,97, 2,01, 1,99
Tasks: 210 total,   1 running, 209 sleeping,   0 stopped,   0 zombie
%Cpu0  :  0,3 us,  1,0 sy,  0,0 ni, 91,4 id,  7,3 wa,  0,0 hi,  0,0 si,  
0,0 st
%Cpu1  :  0,0 us,  0,0 sy,  0,0 ni,100,0 id,  0,0 wa,  0,0 hi,  0,0 si,  
0,0 st
%Cpu2  :  0,0 us,  0,0 sy,  0,0 ni,100,0 id,  0,0 wa,  0,0 hi,  0,0 si,  
0,0 st
%Cpu3  :  0,0 us,  0,3 sy,  0,0 ni, 13,0 id, 86,7 wa,  0,0 hi,  0,0 si,  
0,0 st
KiB Mem :  1013016 total,19548 free,   591456 used,   402012 
buff/cache
KiB Swap:  1048572 total,   990776 free,57796 used.   353468 avail 
Mem


iostat:

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
   0,000,000,00   50,000,00   50,00

Device: rrqm/s   wrqm/s r/s w/srkB/swkB/s 
avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
xvda  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdb  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdc  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdd  0,00 0,000,00   26,00 0,00  2336,00   
179,6969,31 1060,620,00 1060,62  38,46 100,00
xvde  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdf  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdg  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdh  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdi  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
xvdj  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-0  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-1  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-2  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-3  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-4  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00
dm-5  0,00 0,000,000,00 0,00 0,00 
0,0069,310,000,000,00   0,00 100,00
dm-6  0,00 0,000,000,00 0,00 0,00 
0,00 0,000,000,000,00   0,00   0,00


so not really a problem...

--
--
Greetz
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

Re: [CentOS-virt] Official openvswitch package for CentOS7

[George Dunlap]

On Thu, Sep 17, 2015 at 3:19 PM, C. L. Martinez  wrote:
> Hi all,
>
>  Exists an official openvswitch package for CentoS7?? If I am not wrong, this:
>
> http://mirror.centos.org/centos/7/cloud/x86_64/openstack-kilo/openstack-neutron-openvswitch-2015.1.0-1.el7.noarch.rpm
>
> it can be used with openstack only.
>
> Do I need to recompile from source like is is explained here:
> https://n40lab.wordpress.com/2015/06/28/centos-7-installing-openvswitch-2-3-2-lts/
> or exists another rpm package for CentOS7??

Since you're sending this to centos-virt, I assume you want to use
openvswitch for virtualization?

If you think it would be particularly helpful to have an openvswitch
package in the Virt SIG, then we could consider adding it.

 -George
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

Re: [CentOS-virt] Official openvswitch package for CentOS7

[C. L. Martinez]

On Thu, Sep 17, 2015 at 6:06 PM, George Dunlap  wrote:
> On Thu, Sep 17, 2015 at 3:19 PM, C. L. Martinez  wrote:
>> Hi all,
>>
>>  Exists an official openvswitch package for CentoS7?? If I am not wrong, 
>> this:
>>
>> http://mirror.centos.org/centos/7/cloud/x86_64/openstack-kilo/openstack-neutron-openvswitch-2015.1.0-1.el7.noarch.rpm
>>
>> it can be used with openstack only.
>>
>> Do I need to recompile from source like is is explained here:
>> https://n40lab.wordpress.com/2015/06/28/centos-7-installing-openvswitch-2-3-2-lts/
>> or exists another rpm package for CentOS7??
>
> Since you're sending this to centos-virt, I assume you want to use
> openvswitch for virtualization?

Correct, I will need to use for virtualization. In my case, only for
KVM. I don't use LXC or Docker.

And in my opinion, I think it could be a great idea.

Thanks.
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt

[CentOS-virt] Official openvswitch package for CentOS7

[C. L. Martinez]

Hi all,

 Exists an official openvswitch package for CentoS7?? If I am not wrong, this:

http://mirror.centos.org/centos/7/cloud/x86_64/openstack-kilo/openstack-neutron-openvswitch-2015.1.0-1.el7.noarch.rpm

it can be used with openstack only.

Do I need to recompile from source like is is explained here:
https://n40lab.wordpress.com/2015/06/28/centos-7-installing-openvswitch-2-3-2-lts/
or exists another rpm package for CentOS7??

Thanks.
___
CentOS-virt mailing list
CentOS-virt@centos.org
https://lists.centos.org/mailman/listinfo/centos-virt