Re: [Gluster-users] Slow performance of gluster volume

2017-09-12 Thread Abi Askushi
> To: "Ben Turner" <btur...@redhat.com> >> > Cc: "Krutika Dhananjay" <kdhan...@redhat.com>, "gluster-user" < >> gluster-users@gluster.org> >> > Sent: Monday, September 11, 2017 1:40:42 AM >> > Subject: Re: [G

Re: [Gluster-users] Slow performance of gluster volume

2017-09-11 Thread Dmitri Chebotarov
To: "Ben Turner" <btur...@redhat.com> > > Cc: "Krutika Dhananjay" <kdhan...@redhat.com>, "gluster-user" < > gluster-users@gluster.org> > > Sent: Monday, September 11, 2017 1:40:42 AM > > Subject: Re: [Gluster-users] Slow perfo

Re: [Gluster-users] Slow performance of gluster volume

2017-09-11 Thread Ben Turner
to hear! > > - Original Message - > > From: "Abi Askushi" <rightkickt...@gmail.com> > > To: "Krutika Dhananjay" <kdhan...@redhat.com> > > Cc: "gluster-user" <gluster-users@gluster.org> > > Sent: Friday, September 8, 20

Re: [Gluster-users] Slow performance of gluster volume

2017-09-10 Thread Abi Askushi
ur...@redhat.com> wrote: Great to hear! - Original Message - > From: "Abi Askushi" <rightkickt...@gmail.com> > To: "Krutika Dhananjay" <kdhan...@redhat.com> > Cc: "gluster-user" <gluster-users@gluster.org> > Sent: Frida

Re: [Gluster-users] Slow performance of gluster volume

2017-09-10 Thread Ben Turner
Great to hear! - Original Message - > From: "Abi Askushi" <rightkickt...@gmail.com> > To: "Krutika Dhananjay" <kdhan...@redhat.com> > Cc: "gluster-user" <gluster-users@gluster.org> > Sent: Friday, September 8, 2017 7:01:00 P

Re: [Gluster-users] Slow performance of gluster volume

2017-09-10 Thread Ben Turner
- Original Message - > From: "Abi Askushi" <rightkickt...@gmail.com> > To: "Krutika Dhananjay" <kdhan...@redhat.com> > Cc: "gluster-user" <gluster-users@gluster.org> > Sent: Tuesday, September 5, 2017 5:02:46 AM > Subject:

Re: [Gluster-users] Slow performance of gluster volume

2017-09-08 Thread Abi Askushi
Following changes resolved the perf issue: Added the option /etc/glusterfs/glusterd.vol : option rpc-auth-allow-insecure on restarted glusterd Then set the volume option: gluster volume set vms server.allow-insecure on I am reaching now the max network bandwidth and performance of VMs is quite

Re: [Gluster-users] Slow performance of gluster volume

2017-09-06 Thread Abi Askushi
I tried to follow step from https://wiki.centos.org/SpecialInterestGroup/Storage to install latest gluster on the first node. It installed 3.10 and not 3.11. I am not sure how to install 3.11 without compiling it. Then when tried to start the gluster on the node the bricks were reported down (the

Re: [Gluster-users] Slow performance of gluster volume

2017-09-06 Thread Krutika Dhananjay
Do you see any improvement with 3.11.1 as that has a patch that improves perf for this kind of a workload Also, could you disable eager-lock and check if that helps? I see that max time is being spent in acquiring locks. -Krutika On Wed, Sep 6, 2017 at 1:38 PM, Abi Askushi

Re: [Gluster-users] Slow performance of gluster volume

2017-09-06 Thread Abi Askushi
Hi Krutika, Is it anything in the profile indicating what is causing this bottleneck? In case i can collect any other info let me know. Thanx On Sep 5, 2017 13:27, "Abi Askushi" wrote: Hi Krutika, Attached the profile stats. I enabled profiling then ran some dd

Re: [Gluster-users] Slow performance of gluster volume

2017-09-05 Thread Abi Askushi
Hi Krutika, Attached the profile stats. I enabled profiling then ran some dd tests. Also 3 Windows VMs are running on top this volume but did not do any stress testing on the VMs. I have left the profiling enabled in case more time is needed for useful stats. Thanx On Tue, Sep 5, 2017 at 12:48

Re: [Gluster-users] Slow performance of gluster volume

2017-09-05 Thread Krutika Dhananjay
OK my understanding is that with preallocated disks the performance with and without shard will be the same. In any case, please attach the volume profile[1], so we can see what else is slowing things down. -Krutika [1] -

Re: [Gluster-users] Slow performance of gluster volume

2017-09-05 Thread Abi Askushi
Hi Krutika, I already have a preallocated disk on VM. Now I am checking performance with dd on the hypervisors which have the gluster volume configured. I tried also several values of shard-block-size and I keep getting the same low values on write performance. Enabling client-io-threads also

Re: [Gluster-users] Slow performance of gluster volume

2017-09-04 Thread Krutika Dhananjay
I'm assuming you are using this volume to store vm images, because I see shard in the options list. Speaking from shard translator's POV, one thing you can do to improve performance is to use preallocated images. This will at least eliminate the need for shard to perform multiple steps as part of

[Gluster-users] Slow performance of gluster volume

2017-09-04 Thread Abi Askushi
Hi all, I have a gluster volume used to host several VMs (managed through oVirt). The volume is a replica 3 with arbiter and the 3 servers use 1 Gbit network for the storage. When testing with dd (dd if=/dev/zero of=testfile bs=1G count=1 oflag=direct) out of the volume (e.g. writing at /root/)