Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-11 Thread Kyle Johnson
Sure, I'd be happy to supply some more details. See below. On 11/10/2016 01:17 AM, Nithya Balachandran wrote: > > > On 8 November 2016 at 20:21, Kyle Johnson > wrote: > > Hey there, > > We have a number of processes which daily walk

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-10 Thread Mohammed Rafi K C
On 11/10/2016 09:05 PM, Raghavendra G wrote: > > > On Thu, Nov 10, 2016 at 8:57 PM, Vijay Bellur > wrote: > > On Thu, Nov 10, 2016 at 3:17 AM, Nithya Balachandran > > wrote: > > > >

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-10 Thread Raghavendra G
On Thu, Nov 10, 2016 at 8:57 PM, Vijay Bellur wrote: > On Thu, Nov 10, 2016 at 3:17 AM, Nithya Balachandran > wrote: > > > > > > On 8 November 2016 at 20:21, Kyle Johnson wrote: > >> > >> Hey there, > >> > >> We have a number of

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-10 Thread Nithya Balachandran
On 8 November 2016 at 20:21, Kyle Johnson wrote: > Hey there, > > We have a number of processes which daily walk our entire directory tree > and perform operations on the found files. > > Pre-gluster, this processes was able to complete within 24 hours of > starting. After

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-09 Thread Raghavendra G
On Thu, Nov 10, 2016 at 12:58 PM, Gandalf Corvotempesta < gandalf.corvotempe...@gmail.com> wrote: > Il 10 nov 2016 08:22, "Raghavendra > ha scritto: > > > > Kyle, > > > > Thanks for your your response :). This really helps. From 13s to 0.23s > seems like huge

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-09 Thread Gandalf Corvotempesta
Il 10 nov 2016 08:22, "Raghavendra ha scritto: > > Kyle, > > Thanks for your your response :). This really helps. From 13s to 0.23s seems like huge improvement. >From 13 minutes to 23 seconds, not from 13 seconds :) ___

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-09 Thread Raghavendra G
Kyle, Thanks for your your response :). This really helps. From 13s to 0.23s seems like huge improvement. regards, Raghavendra On Tue, Nov 8, 2016 at 8:21 PM, Kyle Johnson wrote: > Hey there, > > We have a number of processes which daily walk our entire directory tree >

Re: [Gluster-devel] [Gluster-users] Feedback on DHT option "cluster.readdir-optimize"

2016-11-09 Thread Kyle Johnson
Hey there, We have a number of processes which daily walk our entire directory tree and perform operations on the found files. Pre-gluster, this processes was able to complete within 24 hours of starting. After outgrowing that single server and moving to a gluster setup (two bricks, two