On Thu, Apr 20, 2017 at 1:24 PM, Amudhan P wrote:
> Hi Pranith,
>
> > 1) At the moment heals happen in parallel only for files not
> directories. i.e. same shd process doesn't heal 2 directories at a time.
> But it > can do as many file heals as shd-max-threads option. That could
> be the reaso
Hi Pranith,
> 1) At the moment heals happen in parallel only for files not directories.
i.e. same shd process doesn't heal 2 directories at a time. But it > can
do as many file heals as shd-max-threads option. That could be the reason
why Amudhan faced better performance after a while, but > it
Some thoughts based on this mail thread:
1) At the moment heals happen in parallel only for files not directories.
i.e. same shd process doesn't heal 2 directories at a time. But it can do
as many file heals as shd-max-threads option. That could be the reason why
Amudhan faced better performance af
>Is this by design ? Is it tuneable ? 10MB/s/brick is too low for us.
>We will use 10GB ethernet, healing 10MB/s/brick would be a bottleneck.
That is the maximum if you are using EC volumes, I don't know about
other volume configurations.
With 3.9.0 parallel self heal of EC volumes should be faste
ot;
> *Sent: *Tuesday, April 18, 2017 3:29:38 PM
> *Subject: *Re: [Gluster-users] How to Speed UP heal process in Glusterfs
> 3.10.1
>
>
> >I was asking about reading data in same disperse set like 8+2 disperse
> config if one disk is replaced and when heal is in process a
I have seen in testing environment read speed degrades when the same file
was in process of heal. like normal read speed of the file would be 40MB
but when you read same during heal is in process goes down to 10MB approx.
my file size varies from 4KB to 30GB files and Avg 15 files created in the
n
2017-04-18 9:36 GMT+02:00 Serkan Çoban :
> Nope, healing speed is 10MB/sec/brick, each brick heals with this
> speed, so one brick or one server each will heal in one week...
Is this by design ? Is it tuneable ? 10MB/s/brick is too low for us.
We will use 10GB ethernet, healing 10MB/s/brick would
-
From: "Serkan Çoban"
To: "Amudhan P"
Cc: "Gluster Users"
Sent: Tuesday, April 18, 2017 3:29:38 PM
Subject: Re: [Gluster-users] How to Speed UP heal process in Glusterfs 3.10.1
>I was asking about reading data in same disperse set like 8+2 disperse config
>I was asking about reading data in same disperse set like 8+2 disperse
config if one disk is replaced and when heal is in process and when client
reads data which is available in rest of the 9 disks.
My use case is write heavy, we barely read data, so I do not know if read
speed degrades during h
I actually used this (find /mnt/gluster -d -exec getfattr -h -n
trusted.ec.heal {} \; > /dev/null
) command on a specific folder to trigger heal but it was also not showing
any difference in speed.
I was asking about reading data in same disperse set like 8+2 disperse
config if one disk is replace
>But is this normal? Gluster need about 7-8 days to heal 6TB ?
This is the case with my configuration and version of gluster. With
3.9 parallel self heal feature introduced, it will help to decrease
these times.
>In case of a server failure, you need some weeks to heal ?
Nope, healing speed is 10MB
2017-04-18 9:17 GMT+02:00 Serkan Çoban :
> In my case I see 6TB data was healed within 7-8 days with above command
> running.
But is this normal? Gluster need about 7-8 days to heal 6TB ?
In case of a server failure, you need some weeks to heal ?
___
Gl
You can increase heal speed by running below command from a client:
find /mnt/gluster -d -exec getfattr -h -n trusted.ec.heal {} \; > /dev/null
You can write a script with different folders to make it parallel.
In my case I see 6TB data was healed within 7-8 days with above command running.
>did
Serkan,
I have initially changed shd-max-thread 1 to 2 saw a little difference and
changing it to 4 & 8. doesn't make any difference.
disk write speed was about <1MB and data passed in thru network for healing
node from other node were 4MB combined.
Also, I tried ls -l from mount point to the fol
Normally I see 8-10MB/sec/brick heal speed with gluster 3.7.11.
I tested parallel heal for disperse with version 3.9.0 and see that it
increase the heal speed to 20-40MB/sec
I tested with shd-max-threads 2,4,8 and saw that best performance
achieved with 2 or 4 threads.
you can try to start with 2 a
After 6 days have passed and till now 89% (3.3 TB) of data heal completed.
now read speed of healed data is normal now.
heal operation still going on.
On Thu, Apr 13, 2017 at 12:13 PM, Amudhan P wrote:
> Hi,
>
> I am using 3.10.1 with EC disperse volume 8+2 (10 nodes each has
> one brick). on
Hi,
I am using 3.10.1 with EC disperse volume 8+2 (10 nodes each has
one brick). one of the disks has failed in the set. replaced disk and heal
process started.
48 Hours have been crossed out of 3.5TB only 688GB of data is healed. how
to speed up heal process?.
Also when I read data which is ava
17 matches
Mail list logo
