Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-14 Thread Sahina Bose 


On 05/14/2014 02:55 PM, Vadims Korsaks wrote:

Citējot "Sahina Bose" :

On 05/14/2014 02:36 PM, Vadims Korsaks wrote:

Citējot Sahina Bose  :

On 05/13/2014 07:27 PM, Vadims Korsaks wrote:

Citējot Humble Devassy Chirammal
 :

Citējot Vijay Bellur  :

On 05/11/2014 02:04 AM, Vadims Korsaks

wrote:

HI!

Created 2 node setup with oVirt 3.4 and

CentOS 6.5, for storage created

2 node replicated gluster (3.5) fs on same

hosts with oVirt.

mount looks like this:
127.0.0.1:/gluster01 on


/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01

type fuse.glusterfs

(rw,default_permissions,allow_other,max_read=131072)

when i making gluster test with dd,

something

like

dd if=/dev/zero bs=1M count=2


of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka

i'm gettting speed ~ 110 MB/s, so this is

1Gbps speed of ethernet adapter

but with in VM created in oVirt speed is

lower than 20 MB/s

why there is so huge difference?
how can improve VMs disks speed?


What are your gluster volume settings?

Have you

applied the following

performance tunables in gluster's virt

profile:

eager-lock=enable
remote-dio=enable

Regards,
Vijay


setting were:
[root@centos155 ~]# gluster volume info

gluster01

Volume Name: gluster01
Type: Replicate
Volume ID:

436edaa3-ac8b-421f-aa35-68b5bd7064b6

Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: 10.2.75.152:/mnt/gluster01/brick
Brick2: 10.2.75.155:/mnt/gluster01/brick
Options Reconfigured:
storage.owner-gid: 36
storage.owner-uid: 36


add your settings settings now it looks

[root@centos155 ~]# gluster volume info

gluster01

Volume Name: gluster01
Type: Replicate
Volume ID:

436edaa3-ac8b-421f-aa35-68b5bd7064b6

Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: 10.2.75.152:/mnt/gluster01/brick
Brick2: 10.2.75.155:/mnt/gluster01/brick
Options Reconfigured:
network.remote-dio: enable
cluster.eager-lock: enable
storage.owner-gid: 36
storage.owner-uid: 36


but this didn't affected performace in any

big way

should hosts to be restarted?


glusterfs storage domain configuration GUI got

""Optimize for virt. store" option which have to
be enabled when configuring for virt store.



Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain

If the configuration is manual, you need to

set the group to 'virt' as shown below

#gluster volume set VOLNAME group virt

This will enable below options on gluster

volume :

quick-read=off
read-ahead=off
io-cache=off
stat-prefetch=off
eager-lock=enable
remote-dio=on


Can you please make sure group has set

properly ?

Also, invoke "dd" with oflag=direct option and

check whether it helps ..


--Humble

tnx a lot!! now it's much better - from VM i can
get dd with ~ 60 MB/s
this is still ~ x2 lower than from host, but x3
better than it was before :)

BTW could not found "GUI got ""Optimize for virt.
store" option" in oVirt 3.5


The option "Optimize for Virt store" is

available when you select a

volume in Ovirt - both as a right click menu

option as well as a button

in the top sub navigation bar.

You also can check this option while creating a

gluster volume using the

oVirt GUI



i have glusterfs as my master storage, but there
is nothing in volumes, empty. And i can't create
gluster volume, there is no choise in Data Center
and Volume Cluster.



To be able to manage gluster (i.e create volume,

add bricks and peer

probe hosts) from Ovirt UI, the cluster should

have the "Enable gluster

service" option checked. I think you may not

have enabled this when you

created the cluster. To use gluster volume as

storage domain, this

option is not required.

Hope this helps.



Ok, i see, tnx a lot.
any chances to change this for Default Cluster,
because i have self hosted engine and just 2 hosts?




You can edit the cluster and change this option. Please make sure that 
vdsm-gluster is installed on the hosts in the cluster and a gluster peer 
probe has been done if there are more than one hosts in the cluster.







___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-14 Thread Vadims Korsaks 
Citējot "Sahina Bose" :
> 
> On 05/14/2014 02:36 PM, Vadims Korsaks wrote:
>> Citējot Sahina Bose  :
>>> 
>>> On 05/13/2014 07:27 PM, Vadims Korsaks wrote:
 Citējot Humble Devassy Chirammal
  :
> 
>> 
>> Citējot Vijay Bellur  :
>>> On 05/11/2014 02:04 AM, Vadims Korsaks
>> wrote:
 HI!
 
 Created 2 node setup with oVirt 3.4 and
>> CentOS 6.5, for storage created
 2 node replicated gluster (3.5) fs on same
>> hosts with oVirt.
 mount looks like this:
 127.0.0.1:/gluster01 on
 
>> 
 
>>
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>> type fuse.glusterfs
 
>> 
 
>>
(rw,default_permissions,allow_other,max_read=131072)
 
 when i making gluster test with dd,
 something
>> like
 dd if=/dev/zero bs=1M count=2
 
>> 
 
>>
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
 i'm gettting speed ~ 110 MB/s, so this is
>> 1Gbps speed of ethernet adapter
 
 but with in VM created in oVirt speed is
>> lower than 20 MB/s
 
 why there is so huge difference?
 how can improve VMs disks speed?
 
>>> 
>>> What are your gluster volume settings?
 Have you
>> applied the following
>>> performance tunables in gluster's virt
 profile:
>>> 
>>> eager-lock=enable
>>> remote-dio=enable
>>> 
>>> Regards,
>>> Vijay
>>> 
>> setting were:
>> [root@centos155 ~]# gluster volume info
>> gluster01
>> 
>> Volume Name: gluster01
>> Type: Replicate
>> Volume ID:
>> 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>> Status: Started
>> Number of Bricks: 1 x 2 = 2
>> Transport-type: tcp
>> Bricks:
>> Brick1: 10.2.75.152:/mnt/gluster01/brick
>> Brick2: 10.2.75.155:/mnt/gluster01/brick
>> Options Reconfigured:
>> storage.owner-gid: 36
>> storage.owner-uid: 36
>> 
>> 
>> add your settings settings now it looks
>> 
>> [root@centos155 ~]# gluster volume info
>> gluster01
>> 
>> Volume Name: gluster01
>> Type: Replicate
>> Volume ID:
>> 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>> Status: Started
>> Number of Bricks: 1 x 2 = 2
>> Transport-type: tcp
>> Bricks:
>> Brick1: 10.2.75.152:/mnt/gluster01/brick
>> Brick2: 10.2.75.155:/mnt/gluster01/brick
>> Options Reconfigured:
>> network.remote-dio: enable
>> cluster.eager-lock: enable
>> storage.owner-gid: 36
>> storage.owner-uid: 36
>> 
>> 
>> but this didn't affected performace in any
 big way
>> should hosts to be restarted?
>> 
> 
> glusterfs storage domain configuration GUI got
 ""Optimize for virt. store" option which have to
 be enabled when configuring for virt store.
> 
> 
 
>>
Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
> 
> If the configuration is manual, you need to
 set the group to 'virt' as shown below
> 
> #gluster volume set VOLNAME group virt
> 
> This will enable below options on gluster
>> volume :
> 
> quick-read=off
> read-ahead=off
> io-cache=off
> stat-prefetch=off
> eager-lock=enable
> remote-dio=on
> 
> 
> Can you please make sure group has set
>> properly ?
> 
> Also, invoke "dd" with oflag=direct option and
 check whether it helps ..
> 
> 
> --Humble
 tnx a lot!! now it's much better - from VM i can
 get dd with ~ 60 MB/s
 this is still ~ x2 lower than from host, but x3
 better than it was before :)
 
 BTW could not found "GUI got ""Optimize for virt.
 store" option" in oVirt 3.5
>>> 
>>> 
>>> The option "Optimize for Virt store" is
>> available when you select a
>>> volume in Ovirt - both as a right click menu
>> option as well as a button
>>> in the top sub navigation bar.
>>> 
>>> You also can check this option while creating a
>> gluster volume using the
>>> oVirt GUI
>>> 
>>> 
>> i have glusterfs as my master storage, but there
>> is nothing in volumes, empty. And i can't create
>> gluster volume, there is no choise in Data Center
>> and Volume Cluster.
>> 
> 
> 
> To be able to manage gluster (i.e create volume,
add bricks and peer
> probe hosts) from Ovirt UI, the cluster should
have the "Enable gluster
> service" option checked. I think you may not
have enabled this when you
> created the cluster. To use gluster volume as
storage domain, this
> option is not required.
> 
> Hope this helps.
> 
> 
Ok, i see, tnx a lot.
any chances to change this for Default Cluster,
because i have self hosted engine and just 2 hosts?

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-14 Thread Humble Devassy Chirammal 
>
tnx a lot!! now it's much better - from VM i can
get dd with ~ 60 MB/s
this is still ~ x2 lower than from host, but x3
better than it was before :)
>

cool  :)

>
BTW could not found "GUI got ""Optimize for virt.
store" option"  in oVirt 3.5
>

Thanks Sahina for the inputs here.

--Humble


On Tue, May 13, 2014 at 7:27 PM, Vadims Korsaks  wrote:

> Citējot Humble Devassy Chirammal
>  :
> >
> >  |
> >  | Citējot Vijay Bellur  :
> >  | >  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
> >  | >  > HI!
> >  | >  >
> >  | >  > Created 2 node setup with oVirt 3.4 and
> >  | CentOS 6.5, for storage created
> >  | >  > 2 node replicated gluster (3.5) fs on same
> >  | hosts with oVirt.
> >  | >  > mount looks like this:
> >  | >  > 127.0.0.1:/gluster01 on
> >  | >  >
> >  |
> /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
> >  | type fuse.glusterfs
> >  | >  >
> >  |
> (rw,default_permissions,allow_other,max_read=131072)
> >  | >  >
> >  | >  > when i making gluster test with dd,
> something
> >  | like
> >  | >  > dd if=/dev/zero bs=1M count=2
> >  | >  >
> >  |
> of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
> >  | >  > i'm gettting speed ~ 110 MB/s, so this is
> >  | 1Gbps speed of ethernet adapter
> >  | >  >
> >  | >  > but with in VM created in oVirt speed is
> >  | lower than 20 MB/s
> >  | >  >
> >  | >  > why there is so huge difference?
> >  | >  > how can improve VMs disks speed?
> >  | >  >
> >  | >
> >  | >  What are your gluster volume settings?
> Have you
> >  | applied the following
> >  | >  performance tunables in gluster's virt
> profile:
> >  | >
> >  | >  eager-lock=enable
> >  | >  remote-dio=enable
> >  | >
> >  | >  Regards,
> >  | >  Vijay
> >  | >
> >  | setting were:
> >  | [root@centos155 ~]# gluster volume info gluster01
> >  |
> >  | Volume Name: gluster01
> >  | Type: Replicate
> >  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
> >  | Status: Started
> >  | Number of Bricks: 1 x 2 = 2
> >  | Transport-type: tcp
> >  | Bricks:
> >  | Brick1: 10.2.75.152:/mnt/gluster01/brick
> >  | Brick2: 10.2.75.155:/mnt/gluster01/brick
> >  | Options Reconfigured:
> >  | storage.owner-gid: 36
> >  | storage.owner-uid: 36
> >  |
> >  |
> >  | add your settings settings now it looks
> >  |
> >  | [root@centos155 ~]# gluster volume info gluster01
> >  |
> >  | Volume Name: gluster01
> >  | Type: Replicate
> >  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
> >  | Status: Started
> >  | Number of Bricks: 1 x 2 = 2
> >  | Transport-type: tcp
> >  | Bricks:
> >  | Brick1: 10.2.75.152:/mnt/gluster01/brick
> >  | Brick2: 10.2.75.155:/mnt/gluster01/brick
> >  | Options Reconfigured:
> >  | network.remote-dio: enable
> >  | cluster.eager-lock: enable
> >  | storage.owner-gid: 36
> >  | storage.owner-uid: 36
> >  |
> >  |
> >  | but this didn't affected performace in any
> big way
> >  | should hosts to be restarted?
> >  |
> >
> >  glusterfs storage domain configuration GUI got
> ""Optimize for virt. store" option which have to
> be enabled when configuring for virt store.
> >
> >
> Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
> >
> >  If the configuration is manual,  you need to
> set the group to 'virt' as shown below
> >
> >  #gluster volume set VOLNAME group virt
> >
> >  This will enable below options on gluster volume :
> >
> >  quick-read=off
> >  read-ahead=off
> >  io-cache=off
> >  stat-prefetch=off
> >  eager-lock=enable
> >  remote-dio=on
> >
> >
> >  Can you please make sure group has set properly ?
> >
> >  Also, invoke  "dd" with oflag=direct option and
> check whether it helps ..
> >
> >
> >  --Humble
>
> tnx a lot!! now it's much better - from VM i can
> get dd with ~ 60 MB/s
> this is still ~ x2 lower than from host, but x3
> better than it was before :)
>
> BTW could not found "GUI got ""Optimize for virt.
> store" option"  in oVirt 3.5
>
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-14 Thread Sahina Bose 


On 05/14/2014 02:36 PM, Vadims Korsaks wrote:

Citējot Sahina Bose  :
  
  On 05/13/2014 07:27 PM, Vadims Korsaks wrote:

  > Citējot Humble Devassy Chirammal
  >  :
  >>
  >> |
  >> | Citējot Vijay Bellur  :
  >> | > On 05/11/2014 02:04 AM, Vadims Korsaks

wrote:

  >> | > > HI!
  >> | > >
  >> | > > Created 2 node setup with oVirt 3.4 and
  >> | CentOS 6.5, for storage created
  >> | > > 2 node replicated gluster (3.5) fs on same
  >> | hosts with oVirt.
  >> | > > mount looks like this:
  >> | > > 127.0.0.1:/gluster01 on
  >> | > >
  >> |
  >

/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01

  >> | type fuse.glusterfs
  >> | > >
  >> |
  >

(rw,default_permissions,allow_other,max_read=131072)

  >> | > >
  >> | > > when i making gluster test with dd,
  > something
  >> | like
  >> | > > dd if=/dev/zero bs=1M count=2
  >> | > >
  >> |
  >

of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka

  >> | > > i'm gettting speed ~ 110 MB/s, so this is
  >> | 1Gbps speed of ethernet adapter
  >> | > >
  >> | > > but with in VM created in oVirt speed is
  >> | lower than 20 MB/s
  >> | > >
  >> | > > why there is so huge difference?
  >> | > > how can improve VMs disks speed?
  >> | > >
  >> | >
  >> | > What are your gluster volume settings?
  > Have you
  >> | applied the following
  >> | > performance tunables in gluster's virt
  > profile:
  >> | >
  >> | > eager-lock=enable
  >> | > remote-dio=enable
  >> | >
  >> | > Regards,
  >> | > Vijay
  >> | >
  >> | setting were:
  >> | [root@centos155 ~]# gluster volume info

gluster01

  >> |
  >> | Volume Name: gluster01
  >> | Type: Replicate
  >> | Volume ID:

436edaa3-ac8b-421f-aa35-68b5bd7064b6

  >> | Status: Started
  >> | Number of Bricks: 1 x 2 = 2
  >> | Transport-type: tcp
  >> | Bricks:
  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
  >> | Options Reconfigured:
  >> | storage.owner-gid: 36
  >> | storage.owner-uid: 36
  >> |
  >> |
  >> | add your settings settings now it looks
  >> |
  >> | [root@centos155 ~]# gluster volume info

gluster01

  >> |
  >> | Volume Name: gluster01
  >> | Type: Replicate
  >> | Volume ID:

436edaa3-ac8b-421f-aa35-68b5bd7064b6

  >> | Status: Started
  >> | Number of Bricks: 1 x 2 = 2
  >> | Transport-type: tcp
  >> | Bricks:
  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
  >> | Options Reconfigured:
  >> | network.remote-dio: enable
  >> | cluster.eager-lock: enable
  >> | storage.owner-gid: 36
  >> | storage.owner-uid: 36
  >> |
  >> |
  >> | but this didn't affected performace in any
  > big way
  >> | should hosts to be restarted?
  >> |
  >>
  >> glusterfs storage domain configuration GUI got
  > ""Optimize for virt. store" option which have to
  > be enabled when configuring for virt store.
  >>
  >>
  >

Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain

  >>
  >> If the configuration is manual, you need to
  > set the group to 'virt' as shown below
  >>
  >> #gluster volume set VOLNAME group virt
  >>
  >> This will enable below options on gluster

volume :

  >>
  >> quick-read=off
  >> read-ahead=off
  >> io-cache=off
  >> stat-prefetch=off
  >> eager-lock=enable
  >> remote-dio=on
  >>
  >>
  >> Can you please make sure group has set

properly ?

  >>
  >> Also, invoke "dd" with oflag=direct option and
  > check whether it helps ..
  >>
  >>
  >> --Humble
  > tnx a lot!! now it's much better - from VM i can
  > get dd with ~ 60 MB/s
  > this is still ~ x2 lower than from host, but x3
  > better than it was before :)
  >
  > BTW could not found "GUI got ""Optimize for virt.
  > store" option" in oVirt 3.5
  
  
  The option "Optimize for Virt store" is

available when you select a

  volume in Ovirt - both as a right click menu

option as well as a button

  in the top sub navigation bar.
  
  You also can check this option while creating a

gluster volume using the

  oVirt GUI
  
  

i have glusterfs as my master storage, but there
is nothing in volumes, empty. And i can't create
gluster volume, there is no choise in Data Center
and Volume Cluster.




To be able to manage gluster (i.e create volume, add bricks and peer 
probe hosts) from Ovirt UI, the cluster should have the "Enable gluster 
service" option checked. I think you may not have enabled this when you 
created the cluster. To use gluster volume as storage domain, this 
option is not required.


Hope this helps.


___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-14 Thread Vadims Korsaks 
Citējot Sahina Bose  :
>  
>  On 05/13/2014 07:27 PM, Vadims Korsaks wrote:
>  > Citējot Humble Devassy Chirammal
>  >  :
>  >>
>  >> |
>  >> | Citējot Vijay Bellur  :
>  >> | > On 05/11/2014 02:04 AM, Vadims Korsaks
wrote:
>  >> | > > HI!
>  >> | > >
>  >> | > > Created 2 node setup with oVirt 3.4 and
>  >> | CentOS 6.5, for storage created
>  >> | > > 2 node replicated gluster (3.5) fs on same
>  >> | hosts with oVirt.
>  >> | > > mount looks like this:
>  >> | > > 127.0.0.1:/gluster01 on
>  >> | > >
>  >> |
>  >
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>  >> | type fuse.glusterfs
>  >> | > >
>  >> |
>  >
(rw,default_permissions,allow_other,max_read=131072)
>  >> | > >
>  >> | > > when i making gluster test with dd,
>  > something
>  >> | like
>  >> | > > dd if=/dev/zero bs=1M count=2
>  >> | > >
>  >> |
>  >
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  >> | > > i'm gettting speed ~ 110 MB/s, so this is
>  >> | 1Gbps speed of ethernet adapter
>  >> | > >
>  >> | > > but with in VM created in oVirt speed is
>  >> | lower than 20 MB/s
>  >> | > >
>  >> | > > why there is so huge difference?
>  >> | > > how can improve VMs disks speed?
>  >> | > >
>  >> | >
>  >> | > What are your gluster volume settings?
>  > Have you
>  >> | applied the following
>  >> | > performance tunables in gluster's virt
>  > profile:
>  >> | >
>  >> | > eager-lock=enable
>  >> | > remote-dio=enable
>  >> | >
>  >> | > Regards,
>  >> | > Vijay
>  >> | >
>  >> | setting were:
>  >> | [root@centos155 ~]# gluster volume info
gluster01
>  >> |
>  >> | Volume Name: gluster01
>  >> | Type: Replicate
>  >> | Volume ID:
436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  >> | Status: Started
>  >> | Number of Bricks: 1 x 2 = 2
>  >> | Transport-type: tcp
>  >> | Bricks:
>  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  >> | Options Reconfigured:
>  >> | storage.owner-gid: 36
>  >> | storage.owner-uid: 36
>  >> |
>  >> |
>  >> | add your settings settings now it looks
>  >> |
>  >> | [root@centos155 ~]# gluster volume info
gluster01
>  >> |
>  >> | Volume Name: gluster01
>  >> | Type: Replicate
>  >> | Volume ID:
436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  >> | Status: Started
>  >> | Number of Bricks: 1 x 2 = 2
>  >> | Transport-type: tcp
>  >> | Bricks:
>  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  >> | Options Reconfigured:
>  >> | network.remote-dio: enable
>  >> | cluster.eager-lock: enable
>  >> | storage.owner-gid: 36
>  >> | storage.owner-uid: 36
>  >> |
>  >> |
>  >> | but this didn't affected performace in any
>  > big way
>  >> | should hosts to be restarted?
>  >> |
>  >>
>  >> glusterfs storage domain configuration GUI got
>  > ""Optimize for virt. store" option which have to
>  > be enabled when configuring for virt store.
>  >>
>  >>
>  >
Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
>  >>
>  >> If the configuration is manual, you need to
>  > set the group to 'virt' as shown below
>  >>
>  >> #gluster volume set VOLNAME group virt
>  >>
>  >> This will enable below options on gluster
volume :
>  >>
>  >> quick-read=off
>  >> read-ahead=off
>  >> io-cache=off
>  >> stat-prefetch=off
>  >> eager-lock=enable
>  >> remote-dio=on
>  >>
>  >>
>  >> Can you please make sure group has set
properly ?
>  >>
>  >> Also, invoke "dd" with oflag=direct option and
>  > check whether it helps ..
>  >>
>  >>
>  >> --Humble
>  > tnx a lot!! now it's much better - from VM i can
>  > get dd with ~ 60 MB/s
>  > this is still ~ x2 lower than from host, but x3
>  > better than it was before :)
>  >
>  > BTW could not found "GUI got ""Optimize for virt.
>  > store" option" in oVirt 3.5
>  
>  
>  The option "Optimize for Virt store" is
available when you select a
>  volume in Ovirt - both as a right click menu
option as well as a button
>  in the top sub navigation bar.
>  
>  You also can check this option while creating a
gluster volume using the
>  oVirt GUI
>  
>  
i have glusterfs as my master storage, but there
is nothing in volumes, empty. And i can't create
gluster volume, there is no choise in Data Center
and Volume Cluster.

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-13 Thread Sahina Bose 


On 05/13/2014 07:27 PM, Vadims Korsaks wrote:

Citējot Humble Devassy Chirammal
 :
   
  |

  | Citējot Vijay Bellur  :
  | >  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
  | >  > HI!
  | >  >
  | >  > Created 2 node setup with oVirt 3.4 and
  | CentOS 6.5, for storage created
  | >  > 2 node replicated gluster (3.5) fs on same
  | hosts with oVirt.
  | >  > mount looks like this:
  | >  > 127.0.0.1:/gluster01 on
  | >  >
  |

/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01

  | type fuse.glusterfs
  | >  >
  |

(rw,default_permissions,allow_other,max_read=131072)

  | >  >
  | >  > when i making gluster test with dd,

something

  | like
  | >  > dd if=/dev/zero bs=1M count=2
  | >  >
  |

of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka

  | >  > i'm gettting speed ~ 110 MB/s, so this is
  | 1Gbps speed of ethernet adapter
  | >  >
  | >  > but with in VM created in oVirt speed is
  | lower than 20 MB/s
  | >  >
  | >  > why there is so huge difference?
  | >  > how can improve VMs disks speed?
  | >  >
  | >
  | >  What are your gluster volume settings?

Have you

  | applied the following
  | >  performance tunables in gluster's virt

profile:

  | >
  | >  eager-lock=enable
  | >  remote-dio=enable
  | >
  | >  Regards,
  | >  Vijay
  | >
  | setting were:
  | [root@centos155 ~]# gluster volume info gluster01
  |
  | Volume Name: gluster01
  | Type: Replicate
  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
  | Status: Started
  | Number of Bricks: 1 x 2 = 2
  | Transport-type: tcp
  | Bricks:
  | Brick1: 10.2.75.152:/mnt/gluster01/brick
  | Brick2: 10.2.75.155:/mnt/gluster01/brick
  | Options Reconfigured:
  | storage.owner-gid: 36
  | storage.owner-uid: 36
  |
  |
  | add your settings settings now it looks
  |
  | [root@centos155 ~]# gluster volume info gluster01
  |
  | Volume Name: gluster01
  | Type: Replicate
  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
  | Status: Started
  | Number of Bricks: 1 x 2 = 2
  | Transport-type: tcp
  | Bricks:
  | Brick1: 10.2.75.152:/mnt/gluster01/brick
  | Brick2: 10.2.75.155:/mnt/gluster01/brick
  | Options Reconfigured:
  | network.remote-dio: enable
  | cluster.eager-lock: enable
  | storage.owner-gid: 36
  | storage.owner-uid: 36
  |
  |
  | but this didn't affected performace in any

big way

  | should hosts to be restarted?
  |
  
  glusterfs storage domain configuration GUI got

""Optimize for virt. store" option which have to
be enabled when configuring for virt store.
  


Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
  
  If the configuration is manual,  you need to

set the group to 'virt' as shown below
  
  #gluster volume set VOLNAME group virt
  
  This will enable below options on gluster volume :
  
  quick-read=off

  read-ahead=off
  io-cache=off
  stat-prefetch=off
  eager-lock=enable
  remote-dio=on
  
  
  Can you please make sure group has set properly ?
  
  Also, invoke  "dd" with oflag=direct option and

check whether it helps ..
  
  
  --Humble

tnx a lot!! now it's much better - from VM i can
get dd with ~ 60 MB/s
this is still ~ x2 lower than from host, but x3
better than it was before :)

BTW could not found "GUI got ""Optimize for virt.
store" option"  in oVirt 3.5



The option "Optimize for Virt store" is available when you select a 
volume in Ovirt - both as a right click menu option as well as a button 
in the top sub navigation bar.


You also can check this option while creating a gluster volume using the 
oVirt GUI





___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-13 Thread Vadims Korsaks 
Citējot Humble Devassy Chirammal
 :
>   
>  |
>  | Citējot Vijay Bellur  :
>  | >  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
>  | >  > HI!
>  | >  >
>  | >  > Created 2 node setup with oVirt 3.4 and
>  | CentOS 6.5, for storage created
>  | >  > 2 node replicated gluster (3.5) fs on same
>  | hosts with oVirt.
>  | >  > mount looks like this:
>  | >  > 127.0.0.1:/gluster01 on
>  | >  >
>  |
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>  | type fuse.glusterfs
>  | >  >
>  |
(rw,default_permissions,allow_other,max_read=131072)
>  | >  >
>  | >  > when i making gluster test with dd,
something
>  | like
>  | >  > dd if=/dev/zero bs=1M count=2
>  | >  >
>  |
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  | >  > i'm gettting speed ~ 110 MB/s, so this is
>  | 1Gbps speed of ethernet adapter
>  | >  >
>  | >  > but with in VM created in oVirt speed is
>  | lower than 20 MB/s
>  | >  >
>  | >  > why there is so huge difference?
>  | >  > how can improve VMs disks speed?
>  | >  >
>  | >
>  | >  What are your gluster volume settings?
Have you
>  | applied the following
>  | >  performance tunables in gluster's virt
profile:
>  | >
>  | >  eager-lock=enable
>  | >  remote-dio=enable
>  | >
>  | >  Regards,
>  | >  Vijay
>  | >
>  | setting were:
>  | [root@centos155 ~]# gluster volume info gluster01
>  |
>  | Volume Name: gluster01
>  | Type: Replicate
>  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  | Status: Started
>  | Number of Bricks: 1 x 2 = 2
>  | Transport-type: tcp
>  | Bricks:
>  | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  | Options Reconfigured:
>  | storage.owner-gid: 36
>  | storage.owner-uid: 36
>  |
>  |
>  | add your settings settings now it looks
>  |
>  | [root@centos155 ~]# gluster volume info gluster01
>  |
>  | Volume Name: gluster01
>  | Type: Replicate
>  | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  | Status: Started
>  | Number of Bricks: 1 x 2 = 2
>  | Transport-type: tcp
>  | Bricks:
>  | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  | Options Reconfigured:
>  | network.remote-dio: enable
>  | cluster.eager-lock: enable
>  | storage.owner-gid: 36
>  | storage.owner-uid: 36
>  |
>  |
>  | but this didn't affected performace in any
big way
>  | should hosts to be restarted?
>  |
>  
>  glusterfs storage domain configuration GUI got
""Optimize for virt. store" option which have to
be enabled when configuring for virt store.
>  
> 
Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
>  
>  If the configuration is manual,  you need to
set the group to 'virt' as shown below
>  
>  #gluster volume set VOLNAME group virt
>  
>  This will enable below options on gluster volume :
>  
>  quick-read=off
>  read-ahead=off
>  io-cache=off
>  stat-prefetch=off
>  eager-lock=enable
>  remote-dio=on
>  
>  
>  Can you please make sure group has set properly ?
>  
>  Also, invoke  "dd" with oflag=direct option and
check whether it helps ..
>  
>  
>  --Humble

tnx a lot!! now it's much better - from VM i can
get dd with ~ 60 MB/s
this is still ~ x2 lower than from host, but x3
better than it was before :)

BTW could not found "GUI got ""Optimize for virt.
store" option"  in oVirt 3.5

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-13 Thread Humble Chirammal 




| 
| Citējot Vijay Bellur  :
| >  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
| >  > HI!
| >  >
| >  > Created 2 node setup with oVirt 3.4 and
| CentOS 6.5, for storage created
| >  > 2 node replicated gluster (3.5) fs on same
| hosts with oVirt.
| >  > mount looks like this:
| >  > 127.0.0.1:/gluster01 on
| >  >
| /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
| type fuse.glusterfs
| >  >
| (rw,default_permissions,allow_other,max_read=131072)
| >  >
| >  > when i making gluster test with dd, something
| like
| >  > dd if=/dev/zero bs=1M count=2
| >  >
| of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
| >  > i'm gettting speed ~ 110 MB/s, so this is
| 1Gbps speed of ethernet adapter
| >  >
| >  > but with in VM created in oVirt speed is
| lower than 20 MB/s
| >  >
| >  > why there is so huge difference?
| >  > how can improve VMs disks speed?
| >  >
| >
| >  What are your gluster volume settings? Have you
| applied the following
| >  performance tunables in gluster's virt profile:
| >
| >  eager-lock=enable
| >  remote-dio=enable
| >
| >  Regards,
| >  Vijay
| >
| setting were:
| [root@centos155 ~]# gluster volume info gluster01
| 
| Volume Name: gluster01
| Type: Replicate
| Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
| Status: Started
| Number of Bricks: 1 x 2 = 2
| Transport-type: tcp
| Bricks:
| Brick1: 10.2.75.152:/mnt/gluster01/brick
| Brick2: 10.2.75.155:/mnt/gluster01/brick
| Options Reconfigured:
| storage.owner-gid: 36
| storage.owner-uid: 36
| 
| 
| add your settings settings now it looks
| 
| [root@centos155 ~]# gluster volume info gluster01
| 
| Volume Name: gluster01
| Type: Replicate
| Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
| Status: Started
| Number of Bricks: 1 x 2 = 2
| Transport-type: tcp
| Bricks:
| Brick1: 10.2.75.152:/mnt/gluster01/brick
| Brick2: 10.2.75.155:/mnt/gluster01/brick
| Options Reconfigured:
| network.remote-dio: enable
| cluster.eager-lock: enable
| storage.owner-gid: 36
| storage.owner-uid: 36
| 
| 
| but this didn't affected performace in any big way
| should hosts to be restarted?
| 

glusterfs storage domain configuration GUI got ""Optimize for virt. store" 
option which have to be enabled when configuring for virt store.

Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain

If the configuration is manual,  you need to set the group to 'virt' as shown 
below

#gluster volume set VOLNAME group virt

This will enable below options on gluster volume :

quick-read=off
read-ahead=off
io-cache=off
stat-prefetch=off
eager-lock=enable
remote-dio=on


Can you please make sure group has set properly ?

Also, invoke  "dd" with oflag=direct option and check whether it helps ..


--Humble

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Humble Devassy Chirammal 
|
| Citējot Vijay Bellur  :
| >  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
| >  > HI!
| >  >
| >  > Created 2 node setup with oVirt 3.4 and
| CentOS 6.5, for storage created
| >  > 2 node replicated gluster (3.5) fs on same
| hosts with oVirt.
| >  > mount looks like this:
| >  > 127.0.0.1:/gluster01 on
| >  >
| /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
| type fuse.glusterfs
| >  >
| (rw,default_permissions,allow_other,max_read=131072)
| >  >
| >  > when i making gluster test with dd, something
| like
| >  > dd if=/dev/zero bs=1M count=2
| >  >
| of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
| >  > i'm gettting speed ~ 110 MB/s, so this is
| 1Gbps speed of ethernet adapter
| >  >
| >  > but with in VM created in oVirt speed is
| lower than 20 MB/s
| >  >
| >  > why there is so huge difference?
| >  > how can improve VMs disks speed?
| >  >
| >
| >  What are your gluster volume settings? Have you
| applied the following
| >  performance tunables in gluster's virt profile:
| >
| >  eager-lock=enable
| >  remote-dio=enable
| >
| >  Regards,
| >  Vijay
| >
| setting were:
| [root@centos155 ~]# gluster volume info gluster01
|
| Volume Name: gluster01
| Type: Replicate
| Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
| Status: Started
| Number of Bricks: 1 x 2 = 2
| Transport-type: tcp
| Bricks:
| Brick1: 10.2.75.152:/mnt/gluster01/brick
| Brick2: 10.2.75.155:/mnt/gluster01/brick
| Options Reconfigured:
| storage.owner-gid: 36
| storage.owner-uid: 36
|
|
| add your settings settings now it looks
|
| [root@centos155 ~]# gluster volume info gluster01
|
| Volume Name: gluster01
| Type: Replicate
| Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
| Status: Started
| Number of Bricks: 1 x 2 = 2
| Transport-type: tcp
| Bricks:
| Brick1: 10.2.75.152:/mnt/gluster01/brick
| Brick2: 10.2.75.155:/mnt/gluster01/brick
| Options Reconfigured:
| network.remote-dio: enable
| cluster.eager-lock: enable
| storage.owner-gid: 36
| storage.owner-uid: 36
|
|
| but this didn't affected performace in any big way
| should hosts to be restarted?
|

glusterfs storage domain configuration GUI got ""Optimize for virt. store"
option which have to be enabled when configuring for virt store.

Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain

If the configuration is manual,  you need to set the group to 'virt' as
shown below

#gluster volume set VOLNAME group virt

This will enable below options on gluster volume :

quick-read=off
read-ahead=off
io-cache=off
stat-prefetch=off
eager-lock=enable
remote-dio=on


Can you please make sure group has set properly ?

Also, invoke  "dd" with oflag=direct option and check whether it helps ..


--Humble
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Jason Brooks 


- Original Message -
> From: "Gianluca Cecchi" 
> To: "Paul Robert Marino" 
> Cc: "users" 
> Sent: Monday, May 12, 2014 5:33:41 PM
> Subject: Re: [ovirt-users] gluster performance oVirt 3.4
> 
> On Mon, May 12, 2014 at 8:38 PM, Paul Robert Marino
> wrote:
> 
> > On the Gluster site there is a QEMU repo I'll send you the link latter
> > today. But essentially CentOS doesn't include the Gluster client or
> > libraries so they can't compile against it.
> > I'm not sure why CentOS and Scientific Linux don't include it but I think
> > it might just be an over site since Gluster 3.4 is new set of packages
> > which were added in the latest release of RHEL 6.
> > In truth you can simply unpack the source RPM and rebuild it with Gluster
> > support its not difficult but I don't remember the flags you need to pass
> > the rpmbuild command off the top of my head. That said I'd probably use the
> > ones off the Gluster site any way.
> > If you are using Gluster 3.5 the ones included in RHEL are incompatible
> > because Gluster still has large API changes between minor releases and they
> > were compiled against 3.4.
> >
> > Also Gluster 3.5 is a brand new release so I wouldn't rule out the
> > possibility of a bug. So if the Gluster enabled QEMU rpms don't help you
> > may need to inquire on the Gluster mailing list.
> >
> >
> If I remember correctly, due to problems with snapshots (now solved I
> think) and with live migration (not yet solved) the developers hard coded
> the fact that the  xml domain definition is the suboptimal one.
> So, even if you change gluster repo, the qemu command line generated by
> oVirt will be the same, so without the use of libgfapi.

I recently tested with F20 hosts and virt pkgs from the fedora-virt-preview 
repo, and the libgfapi support remained disabled.

The changelog for libvirt 1.2.2 mentions a gluster/qemu/snapshot fix, I'd
hoped this would do the trick, but I couldn't figure out how to re-enable
libgfapi to test it...

Jason

> 
> Gianluca
> 
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
> 
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Gianluca Cecchi 
On Mon, May 12, 2014 at 8:38 PM, Paul Robert Marino wrote:

> On the Gluster site there is a QEMU repo I'll send you the link latter
> today. But essentially CentOS doesn't include the Gluster client or
> libraries so they can't compile against it.
> I'm not sure why CentOS and Scientific Linux don't include it but I think
> it might just be an over site since Gluster 3.4 is new set of packages
> which were added in the latest release of RHEL 6.
> In truth you can simply unpack the source RPM and rebuild it with Gluster
> support its not difficult but I don't remember the flags you need to pass
> the rpmbuild command off the top of my head. That said I'd probably use the
> ones off the Gluster site any way.
> If you are using Gluster 3.5 the ones included in RHEL are incompatible
> because Gluster still has large API changes between minor releases and they
> were compiled against 3.4.
>
> Also Gluster 3.5 is a brand new release so I wouldn't rule out the
> possibility of a bug. So if the Gluster enabled QEMU rpms don't help you
> may need to inquire on the Gluster mailing list.
>
>
If I remember correctly, due to problems with snapshots (now solved I
think) and with live migration (not yet solved) the developers hard coded
the fact that the  xml domain definition is the suboptimal one.
So, even if you change gluster repo, the qemu command line generated by
oVirt will be the same, so without the use of libgfapi.

Gianluca
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Paul Robert Marino 
On the Gluster site there is a QEMU repo I'll send you the link latter today. But essentially CentOS doesn't include the Gluster client or libraries so they can't compile against it.I'm not sure why CentOS and Scientific Linux don't include it but I think it might just be an over site since Gluster 3.4 is new set of packages which were added in the latest release of RHEL 6.In truth you can simply unpack the source RPM and rebuild it with Gluster support its not difficult but I don't remember the flags you need to pass the rpmbuild command off the top of my head. That said I'd probably use the ones off the Gluster site any way. If you are using Gluster 3.5 the ones included in RHEL are incompatible because Gluster still has large API changes between minor releases and they were compiled against 3.4. Also Gluster 3.5 is a brand new release so I wouldn't rule out the possibility of a bug. So if the Gluster enabled QEMU rpms don't help you may need to inquire on the Gluster mailing list.-- Sent from my HP Pre3On May 12, 2014 8:58, Tobias Honacker  wrote: I've got the same issue using the same versions as Korsaks, using CentOS 6.5, too.I could launch vms with gluster block backend driver using the standard package of libvirt from centos repo.

but ovirt does not run the VM with the qemu GFAPI integration, the path of the disk using the fuse mount.



      

              

                              

    or am i wrong?On Mon, May 12, 2014 at 7:41 AM, Vadims Korsaks  wrote:

Underlying FS is XFS
GlusterFS - glusterfs-3.5.0-2.el6
I'm using CentOS, if this is problem could RHEL
packages be used? why CentOS packages are compiled
without native glusterfs support?

Citējot Paul Robert Marino  :
>  What's the underlying filesystem for gluster is
it XFS?
>  What version of gluster are you using?
>  What distro are you using and if its not RHEL
or Fedora are you using a version of QEMU with
gluster support compiled in keep in mind the
versions with CentOS and Scientific Linux do not
include Gluster native support compiled in.
>
>
>
>  -- Sent from my HP Pre3
>
>   On May 11, 2014 5:40, Vadims Korsaks
 wrote:
>
>  Citējot Vijay Bellur  :
>  > On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
>  > > HI!
>  > >
>  > > Created 2 node setup with oVirt 3.4 and
>  CentOS 6.5, for storage created
>  > > 2 node replicated gluster (3.5) fs on same
>  hosts with oVirt.
>  > > mount looks like this:
>  > > 127.0.0.1:/gluster01 on
>  > >
>
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>  type fuse.glusterfs
>  > >
>
(rw,default_permissions,allow_other,max_read=131072)
>  > >
>  > > when i making gluster test with dd, something
>  like
>  > > dd if=/dev/zero bs=1M count=2
>  > >
>
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  > > i'm gettting speed ~ 110 MB/s, so this is
>  1Gbps speed of ethernet adapter
>  > >
>  > > but with in VM created in oVirt speed is
>  lower than 20 MB/s
>  > >
>  > > why there is so huge difference?
>  > > how can improve VMs disks speed?
>  > >
>  >
>  > What are your gluster volume settings? Have you
>  applied the following
>  > performance tunables in gluster's virt profile:
>  >
>  > eager-lock=enable
>  > remote-dio=enable
>  >
>  > Regards,
>  > Vijay
>  >
>  setting were:
>  [root@centos155 ~]# gluster volume info gluster01
>
>  Volume Name: gluster01
>  Type: Replicate
>  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  Status: Started
>  Number of Bricks: 1 x 2 = 2
>  Transport-type: tcp
>  Bricks:
>  Brick1: 10.2.75.152:/mnt/gluster01/brick
>  Brick2: 10.2.75.155:/mnt/gluster01/brick
>  Options Reconfigured:
>  storage.owner-gid: 36
>  storage.owner-uid: 36
>
>
>  add your settings settings now it looks
>
>  [root@centos155 ~]# gluster volume info gluster01
>
>  Volume Name: gluster01
>  Type: Replicate
>  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  Status: Started
>  Number of Bricks: 1 x 2 = 2
>  Transport-type: tcp
>  Bricks:
>  Brick1: 10.2.75.152:/mnt/gluster01/brick
>  Brick2: 10.2.75.155:/mnt/gluster01/brick
>  Options Reconfigured:
>  network.remote-dio: enable
>  cluster.eager-lock: enable
>  storage.owner-gid: 36
>  storage.owner-uid: 36
>
>
>  but this didn't affected performace in any big way
>  should hosts to be restarted?
>
>  ___
>  Users mailing list
>  Users@ovirt.org
>  http://lists.ovirt.org/mailman/listinfo/users

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Vadims Korsaks 
Citējot Gianluca Cecchi  :
> On Mon, May 12, 2014 at 2:58 PM, Tobias
Honacker  wrote:
> >   I've got the same issue using the same
versions as Korsaks, using CentOS 6.5, too. 
> > I could launch vms with gluster block backend
driver using the standard package of libvirt from
centos repo.
> >  but ovirt does not run the VM with the qemu
GFAPI integration, the path of the disk using the
fuse mount.
> >  
>[snip] 
> >
> >  or am i wrong?
> >  
> >  
> 
>  This same question asked many times latest months.
>  If you search through archives we remained here:
> 
http://lists.ovirt.org/pipermail/users/2014-April/023825.html
>  
>  BTW, Itamar, are there any bug trackers for
this still remaining problems with live migration?
>  Could we put anything on the wiki? If so,
where, so that I can fill this up?
>  
>  Gianluca

ok i'm new with gluster, so, please, can anyone
explain why dd to gluster from host itself gets
110MB/s, looks like 1Gbps ethernet adapter
limitation and from VM only 20MB/s ? 5x (or more
with 10Gbps) it's huge difference.

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Itamar Heim 

On 05/12/2014 09:09 AM, Gianluca Cecchi wrote:

On Mon, May 12, 2014 at 2:58 PM, Tobias Honacker mailto:tob...@honacker.info>> wrote:

I've got the same issue using the same versions as Korsaks, using
CentOS 6.5, too.
I could launch vms with gluster block backend driver using the
standard package of libvirt from centos repo.
but ovirt does not run the VM with the qemu GFAPI integration, the
path of the disk using the fuse mount.

[snip]


or am i wrong?



This same question asked many times latest months.
If you search through archives we remained here:
http://lists.ovirt.org/pipermail/users/2014-April/023825.html

BTW, Itamar, are there any bug trackers for this still remaining
problems with live migration?
Could we put anything on the wiki? If so, where, so that I can fill this up?



I'd put it under ovirt.org/Troubleshooting (I think we have such a 
page), pointing to "Troubleshooting_LiveMigration" page


___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Gianluca Cecchi 
On Mon, May 12, 2014 at 2:58 PM, Tobias Honacker wrote:

> I've got the same issue using the same versions as Korsaks, using CentOS
> 6.5, too.
> I could launch vms with gluster block backend driver using the standard
> package of libvirt from centos repo.
> but ovirt does not run the VM with the qemu GFAPI integration, the path
> of the disk using the fuse mount.
>
> [snip]

>
> or am i wrong?
>
>
>
This same question asked many times latest months.
If you search through archives we remained here:
http://lists.ovirt.org/pipermail/users/2014-April/023825.html

BTW, Itamar, are there any bug trackers for this still remaining problems
with live migration?
Could we put anything on the wiki? If so, where, so that I can fill this up?

Gianluca
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-12 Thread Tobias Honacker 
I've got the same issue using the same versions as Korsaks, using CentOS
6.5, too.
I could launch vms with gluster block backend driver using the standard
package of libvirt from centos repo.
but ovirt does not run the VM with the qemu GFAPI integration, the path of
the disk using the fuse mount.


  
  

  
  
  
  
  



or am i wrong?


On Mon, May 12, 2014 at 7:41 AM, Vadims Korsaks  wrote:

> Underlying FS is XFS
> GlusterFS - glusterfs-3.5.0-2.el6
> I'm using CentOS, if this is problem could RHEL
> packages be used? why CentOS packages are compiled
> without native glusterfs support?
>
> Citējot Paul Robert Marino  :
> >  What's the underlying filesystem for gluster is
> it XFS?
> >  What version of gluster are you using?
> >  What distro are you using and if its not RHEL
> or Fedora are you using a version of QEMU with
> gluster support compiled in keep in mind the
> versions with CentOS and Scientific Linux do not
> include Gluster native support compiled in.
> >
> >
> >
> >  -- Sent from my HP Pre3
> >
> >   On May 11, 2014 5:40, Vadims Korsaks
>  wrote:
> >
> >  Citējot Vijay Bellur  :
> >  > On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
> >  > > HI!
> >  > >
> >  > > Created 2 node setup with oVirt 3.4 and
> >  CentOS 6.5, for storage created
> >  > > 2 node replicated gluster (3.5) fs on same
> >  hosts with oVirt.
> >  > > mount looks like this:
> >  > > 127.0.0.1:/gluster01 on
> >  > >
> >
> /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
> >  type fuse.glusterfs
> >  > >
> >
> (rw,default_permissions,allow_other,max_read=131072)
> >  > >
> >  > > when i making gluster test with dd, something
> >  like
> >  > > dd if=/dev/zero bs=1M count=2
> >  > >
> >
> of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
> >  > > i'm gettting speed ~ 110 MB/s, so this is
> >  1Gbps speed of ethernet adapter
> >  > >
> >  > > but with in VM created in oVirt speed is
> >  lower than 20 MB/s
> >  > >
> >  > > why there is so huge difference?
> >  > > how can improve VMs disks speed?
> >  > >
> >  >
> >  > What are your gluster volume settings? Have you
> >  applied the following
> >  > performance tunables in gluster's virt profile:
> >  >
> >  > eager-lock=enable
> >  > remote-dio=enable
> >  >
> >  > Regards,
> >  > Vijay
> >  >
> >  setting were:
> >  [root@centos155 ~]# gluster volume info gluster01
> >
> >  Volume Name: gluster01
> >  Type: Replicate
> >  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
> >  Status: Started
> >  Number of Bricks: 1 x 2 = 2
> >  Transport-type: tcp
> >  Bricks:
> >  Brick1: 10.2.75.152:/mnt/gluster01/brick
> >  Brick2: 10.2.75.155:/mnt/gluster01/brick
> >  Options Reconfigured:
> >  storage.owner-gid: 36
> >  storage.owner-uid: 36
> >
> >
> >  add your settings settings now it looks
> >
> >  [root@centos155 ~]# gluster volume info gluster01
> >
> >  Volume Name: gluster01
> >  Type: Replicate
> >  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
> >  Status: Started
> >  Number of Bricks: 1 x 2 = 2
> >  Transport-type: tcp
> >  Bricks:
> >  Brick1: 10.2.75.152:/mnt/gluster01/brick
> >  Brick2: 10.2.75.155:/mnt/gluster01/brick
> >  Options Reconfigured:
> >  network.remote-dio: enable
> >  cluster.eager-lock: enable
> >  storage.owner-gid: 36
> >  storage.owner-uid: 36
> >
> >
> >  but this didn't affected performace in any big way
> >  should hosts to be restarted?
> >
> >  ___
> >  Users mailing list
> >  Users@ovirt.org
> >  http://lists.ovirt.org/mailman/listinfo/users
>
> ___
> Users mailing list
> Users@ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-11 Thread Vadims Korsaks 
Underlying FS is XFS
GlusterFS - glusterfs-3.5.0-2.el6
I'm using CentOS, if this is problem could RHEL
packages be used? why CentOS packages are compiled
without native glusterfs support?

Citējot Paul Robert Marino  :
>  What's the underlying filesystem for gluster is
it XFS?
>  What version of gluster are you using?
>  What distro are you using and if its not RHEL
or Fedora are you using a version of QEMU with
gluster support compiled in keep in mind the
versions with CentOS and Scientific Linux do not
include Gluster native support compiled in.
>  
>  
>  
>  -- Sent from my HP Pre3
>  
>   On May 11, 2014 5:40, Vadims Korsaks
 wrote:
>  
>  Citējot Vijay Bellur  :
>  > On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
>  > > HI!
>  > >
>  > > Created 2 node setup with oVirt 3.4 and
>  CentOS 6.5, for storage created
>  > > 2 node replicated gluster (3.5) fs on same
>  hosts with oVirt.
>  > > mount looks like this:
>  > > 127.0.0.1:/gluster01 on
>  > >
> 
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>  type fuse.glusterfs
>  > >
> 
(rw,default_permissions,allow_other,max_read=131072)
>  > >
>  > > when i making gluster test with dd, something
>  like
>  > > dd if=/dev/zero bs=1M count=2
>  > >
> 
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  > > i'm gettting speed ~ 110 MB/s, so this is
>  1Gbps speed of ethernet adapter
>  > >
>  > > but with in VM created in oVirt speed is
>  lower than 20 MB/s
>  > >
>  > > why there is so huge difference?
>  > > how can improve VMs disks speed?
>  > >
>  >
>  > What are your gluster volume settings? Have you
>  applied the following
>  > performance tunables in gluster's virt profile:
>  >
>  > eager-lock=enable
>  > remote-dio=enable
>  >
>  > Regards,
>  > Vijay
>  >
>  setting were:
>  [root@centos155 ~]# gluster volume info gluster01
>  
>  Volume Name: gluster01
>  Type: Replicate
>  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  Status: Started
>  Number of Bricks: 1 x 2 = 2
>  Transport-type: tcp
>  Bricks:
>  Brick1: 10.2.75.152:/mnt/gluster01/brick
>  Brick2: 10.2.75.155:/mnt/gluster01/brick
>  Options Reconfigured:
>  storage.owner-gid: 36
>  storage.owner-uid: 36
>  
>  
>  add your settings settings now it looks
>  
>  [root@centos155 ~]# gluster volume info gluster01
>  
>  Volume Name: gluster01
>  Type: Replicate
>  Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  Status: Started
>  Number of Bricks: 1 x 2 = 2
>  Transport-type: tcp
>  Bricks:
>  Brick1: 10.2.75.152:/mnt/gluster01/brick
>  Brick2: 10.2.75.155:/mnt/gluster01/brick
>  Options Reconfigured:
>  network.remote-dio: enable
>  cluster.eager-lock: enable
>  storage.owner-gid: 36
>  storage.owner-uid: 36
>  
>  
>  but this didn't affected performace in any big way
>  should hosts to be restarted?
>  
>  ___
>  Users mailing list
>  Users@ovirt.org
>  http://lists.ovirt.org/mailman/listinfo/users

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-11 Thread Paul Robert Marino 
What's the underlying filesystem for gluster is it XFS?What version of gluster are you using?What distro are you using and if its not RHEL or Fedora are you using a version of QEMU with gluster support compiled in keep in mind the versions with CentOS and Scientific Linux do not include Gluster native support compiled in.-- Sent from my HP Pre3On May 11, 2014 5:40, Vadims Korsaks  wrote: Citējot Vijay Bellur  :>  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:>  > HI!>  >>  > Created 2 node setup with oVirt 3.4 andCentOS 6.5, for storage created>  > 2 node replicated gluster (3.5) fs on samehosts with oVirt.>  > mount looks like this:>  > 127.0.0.1:/gluster01 on>  >/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01type fuse.glusterfs>  >(rw,default_permissions,allow_other,max_read=131072)>  >>  > when i making gluster test with dd, somethinglike>  > dd if=/dev/zero bs=1M count=2>  >of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka>  > i'm gettting speed ~ 110 MB/s, so this is1Gbps speed of ethernet adapter>  >>  > but with in VM created in oVirt speed islower than 20 MB/s>  >>  > why there is so huge difference?>  > how can improve VMs disks speed?>  >>  >  What are your gluster volume settings? Have youapplied the following>  performance tunables in gluster's virt profile:>  >  eager-lock=enable>  remote-dio=enable>  >  Regards,>  Vijay>setting were:[root@centos155 ~]# gluster volume info gluster01Volume Name: gluster01Type: ReplicateVolume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6Status: StartedNumber of Bricks: 1 x 2 = 2Transport-type: tcpBricks:Brick1: 10.2.75.152:/mnt/gluster01/brickBrick2: 10.2.75.155:/mnt/gluster01/brickOptions Reconfigured:storage.owner-gid: 36storage.owner-uid: 36add your settings settings now it looks[root@centos155 ~]# gluster volume info gluster01Volume Name: gluster01Type: ReplicateVolume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6Status: StartedNumber of Bricks: 1 x 2 = 2Transport-type: tcpBricks:Brick1: 10.2.75.152:/mnt/gluster01/brickBrick2: 10.2.75.155:/mnt/gluster01/brickOptions Reconfigured:network.remote-dio: enablecluster.eager-lock: enablestorage.owner-gid: 36storage.owner-uid: 36but this didn't affected performace in any big wayshould hosts to be restarted?___Users mailing listUsers@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-11 Thread Vadims Korsaks 
Citējot Vijay Bellur  :
>  On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
>  > HI!
>  >
>  > Created 2 node setup with oVirt 3.4 and
CentOS 6.5, for storage created
>  > 2 node replicated gluster (3.5) fs on same
hosts with oVirt.
>  > mount looks like this:
>  > 127.0.0.1:/gluster01 on
>  >
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
type fuse.glusterfs
>  >
(rw,default_permissions,allow_other,max_read=131072)
>  >
>  > when i making gluster test with dd, something
like
>  > dd if=/dev/zero bs=1M count=2
>  >
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  > i'm gettting speed ~ 110 MB/s, so this is
1Gbps speed of ethernet adapter
>  >
>  > but with in VM created in oVirt speed is
lower than 20 MB/s
>  >
>  > why there is so huge difference?
>  > how can improve VMs disks speed?
>  >
>  
>  What are your gluster volume settings? Have you
applied the following
>  performance tunables in gluster's virt profile:
>  
>  eager-lock=enable
>  remote-dio=enable
>  
>  Regards,
>  Vijay
>
setting were:
[root@centos155 ~]# gluster volume info gluster01

Volume Name: gluster01
Type: Replicate
Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: 10.2.75.152:/mnt/gluster01/brick
Brick2: 10.2.75.155:/mnt/gluster01/brick
Options Reconfigured:
storage.owner-gid: 36
storage.owner-uid: 36


add your settings settings now it looks

[root@centos155 ~]# gluster volume info gluster01

Volume Name: gluster01
Type: Replicate
Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: 10.2.75.152:/mnt/gluster01/brick
Brick2: 10.2.75.155:/mnt/gluster01/brick
Options Reconfigured:
network.remote-dio: enable
cluster.eager-lock: enable
storage.owner-gid: 36
storage.owner-uid: 36


but this didn't affected performace in any big way
should hosts to be restarted?

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-11 Thread Vadims Korsaks 
   On 05/11/2014 02:04 AM, Vadims Korsaks wrote: > HI! > > Created 2 node setup with oVirt 3.4 and CentOS 6.5, for storage created > 2 node replicated gluster (3.5) fs on same hosts with oVirt. > mount looks like this: > 127.0.0.1:/gluster01 on > /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01 type fuse.glusterfs > (rw,default_permissions,allow_other,max_read=131072) > > when i making gluster test with dd, something like > dd if=/dev/zero bs=1M count=2 > of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka > i'm gettting speed ~ 110 MB/s, so this is 1Gbps speed of ethernet adapter > > but with in VM created in oVirt speed is lower than 20 MB/s > > why there is so huge difference? > how can improve VMs disks speed? >  What are your gluster volume settings? Have you applied the following performance tunables in gluster's virt profile:  eager-lock=enable remote-dio=enable  Regards, Vijay  setting were:[root@centos155 ~]#  gluster volume info gluster01 Volume Name: gluster01Type: ReplicateVolume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6Status: StartedNumber of Bricks: 1 x 2 = 2Transport-type: tcpBricks:Brick1: 10.2.75.152:/mnt/gluster01/brickBrick2: 10.2.75.155:/mnt/gluster01/brickOptions Reconfigured:storage.owner-gid: 36storage.owner-uid: 36 add your settings settings now it looks [root@centos155 ~]#  gluster volume info gluster01 Volume Name: gluster01Type: ReplicateVolume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6Status: StartedNumber of Bricks: 1 x 2 = 2Transport-type: tcpBricks:Brick1: 10.2.75.152:/mnt/gluster01/brickBrick2: 10.2.75.155:/mnt/gluster01/brickOptions Reconfigured:network.remote-dio: enablecluster.eager-lock: enablestorage.owner-gid: 36storage.owner-uid: 36but this didn't affected performace in any big wayshould hosts to be restarted?

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

Re: [ovirt-users] gluster performance oVirt 3.4

2014-05-11 Thread Vijay Bellur 

On 05/11/2014 02:04 AM, Vadims Korsaks wrote:

HI!

Created 2 node setup with oVirt 3.4 and CentOS 6.5, for storage created
2 node replicated gluster (3.5) fs on same hosts with oVirt.
mount looks like this:
127.0.0.1:/gluster01 on
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01 type fuse.glusterfs
(rw,default_permissions,allow_other,max_read=131072)

when i making gluster test with dd, something like
dd if=/dev/zero bs=1M count=2
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
i'm gettting speed ~ 110 MB/s, so this is 1Gbps speed of ethernet adapter

but with in VM created in oVirt speed is lower than 20 MB/s

why there is so huge difference?
how can improve VMs disks speed?



What are your gluster volume settings? Have you applied the following 
performance tunables in gluster's virt profile:


eager-lock=enable
remote-dio=enable

Regards,
Vijay

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

[ovirt-users] gluster performance oVirt 3.4

2014-05-10 Thread Vadims Korsaks 
HI!Created 2 node setup with oVirt 3.4 and CentOS 6.5, for storage created 2 node replicated gluster (3.5) fs on same hosts with oVirt.mount looks like this:127.0.0.1:/gluster01 on /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01 type fuse.glusterfs (rw,default_permissions,allow_other,max_read=131072)when i making gluster test with dd, something like dd if=/dev/zero bs=1M count=2 of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kakai'm gettting speed ~ 110 MB/s, so this is 1Gbps speed of ethernet adapterbut with in VM created in oVirt speed is lower than 20 MB/swhy there is so huge difference? how can improve VMs disks speed?

___
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users