Re: [Gluster-devel] missing files

2015-02-18 Thread Shyam
@gluster.org Sent: 2/11/2015 10:02:09 PM Subject: Re: [Gluster-devel] missing files On 02/11/2015 08:28 AM, David F. Robinson wrote: My base filesystem has 40-TB and the tar takes 19 minutes. I copied over 10-TB and it took the tar extraction from 1-minute to 7-minutes. My suspicion

Re: [Gluster-devel] missing files

2015-02-17 Thread David F. Robinson
: [Gluster-devel] missing files On 02/11/2015 08:28 AM, David F. Robinson wrote: My base filesystem has 40-TB and the tar takes 19 minutes. I copied over 10-TB and it took the tar extraction from 1-minute to 7-minutes. My suspicion is that it is related to number of files and not necessarily file

Re: [Gluster-devel] missing files

2015-02-12 Thread Pranith Kumar Karampuri
On 02/12/2015 03:05 PM, Pranith Kumar Karampuri wrote: On 02/12/2015 09:14 AM, Justin Clift wrote: On 12 Feb 2015, at 03:02, Shyam srang...@redhat.com wrote: On 02/11/2015 08:28 AM, David F. Robinson wrote: My base filesystem has 40-TB and the tar takes 19 minutes. I copied over 10-TB and

Re: [Gluster-devel] missing files

2015-02-12 Thread Pranith Kumar Karampuri
On 02/12/2015 09:14 AM, Justin Clift wrote: On 12 Feb 2015, at 03:02, Shyam srang...@redhat.com wrote: On 02/11/2015 08:28 AM, David F. Robinson wrote: My base filesystem has 40-TB and the tar takes 19 minutes. I copied over 10-TB and it took the tar extraction from 1-minute to 7-minutes.

Re: [Gluster-devel] missing files

2015-02-12 Thread David F. Robinson
Sent: 2/12/2015 10:46:14 AM Subject: Re: [Gluster-devel] missing files On 02/12/2015 06:22 AM, Pranith Kumar Karampuri wrote: On 02/12/2015 03:05 PM, Pranith Kumar Karampuri wrote: On 02/12/2015 09:14 AM, Justin Clift wrote: On 12 Feb 2015, at 03:02, Shyam srang...@redhat.com wrote: On 02

Re: [Gluster-devel] missing files

2015-02-12 Thread Shyam
On 02/12/2015 11:18 AM, David F. Robinson wrote: Shyam, You asked me to stop/start the slow volume to see if it fixed the timing issue. I stopped/started homegfs_backup (the production volume with 40+ TB) and it didn't make it faster. I didn't stop/start the fast volume to see if it made it

Re: [Gluster-devel] missing files

2015-02-12 Thread Justin Clift
On 12 Feb 2015, at 11:22, Pranith Kumar Karampuri pkara...@redhat.com wrote: snip Just to increase confidence performed one more test. Stopped the volumes and re-started. Now on both the volumes, the numbers are almost same: Oh. So it's a problem that turns up after a certain amount of

Re: [Gluster-devel] missing files

2015-02-12 Thread David F. Robinson
...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org; David F. Robinson david.robin...@corvidtec.com Sent: 2/12/2015 6:22:23 AM Subject: Re: [Gluster-devel] missing files On 02/12/2015 03:05 PM, Pranith Kumar Karampuri wrote: On 02/12/2015 09:14 AM, Justin Clift wrote: On 12 Feb 2015, at 03:02

Re: [Gluster-devel] missing files

2015-02-12 Thread David F. Robinson
-- Original Message -- From: Shyam srang...@redhat.com To: David F. Robinson david.robin...@corvidtec.com; Pranith Kumar Karampuri pkara...@redhat.com; Justin Clift jus...@gluster.org Cc: Gluster Devel gluster-devel@gluster.org Sent: 2/12/2015 11:26:51 AM Subject: Re: [Gluster-devel

Re: [Gluster-devel] missing files

2015-02-12 Thread David F. Robinson
Karampuri pkara...@redhat.com; Justin Clift jus...@gluster.org Cc: Gluster Devel gluster-devel@gluster.org Sent: 2/12/2015 11:26:51 AM Subject: Re: [Gluster-devel] missing files On 02/12/2015 11:18 AM, David F. Robinson wrote: Shyam, You asked me to stop/start the slow volume to see

Re: [Gluster-devel] missing files

2015-02-11 Thread David F. Robinson
My base filesystem has 40-TB and the tar takes 19 minutes. I copied over 10-TB and it took the tar extraction from 1-minute to 7-minutes. My suspicion is that it is related to number of files and not necessarily file size. Shyam is looking into reproducing this behavior on a redhat system.

Re: [Gluster-devel] missing files

2015-02-11 Thread David F. Robinson
Don't think it is the underlying file system. /data/brickxx is the underlying xfs. Performance to this is fine. When I created a volume it just puts the data in /data/brick/test2. The underlying filesystem shouldn't know/care that it is in a new directory. Also, if I create a

Re: [Gluster-devel] missing files

2015-02-11 Thread Xavier Hernandez
Some time ago I had a similar performance problem (with 3.4 if I remember correctly): a just created volume started to work fine, but after some time using it performance was worse. Removing all files from the volume didn't improve the performance again. The only way I had to recover a

Re: [Gluster-devel] missing files

2015-02-05 Thread Pranith Kumar Karampuri
...@gluster.org; Gluster Devel gluster-devel@gluster.org Sent: 2/5/2015 5:14:22 AM Subject: Re: [Gluster-devel] missing files Is the failure repeatable ? with the same directories ? It's very weird that the directories appear on the volume when you do an 'ls' on the bricks. Could it be that you

Re: [Gluster-devel] missing files

2015-02-05 Thread David F. Robinson
...@gmail.com; Pranith Kumar Karampuri pkara...@redhat.com Cc: gluster-us...@gluster.org gluster-us...@gluster.org; Gluster Devel gluster-devel@gluster.org Sent: 2/5/2015 5:14:22 AM Subject: Re: [Gluster-devel] missing files Is the failure repeatable ? with the same directories ? It's very weird

Re: [Gluster-devel] missing files

2015-02-05 Thread Xavier Hernandez
Subject: Re: [Gluster-devel] missing files On 02/04/2015 01:30 AM, David F. Robinson wrote: Sorry. Thought about this a little more. I should have been clearer. The files were on both bricks of the replica, not just one side. So, both bricks had to have been up... The files/directories just don't

Re: [Gluster-devel] missing files

2015-02-04 Thread David F. Robinson
gluster-us...@gluster.org; Gluster Devel gluster-devel@gluster.org Sent: 2/4/2015 6:03:45 AM Subject: Re: [Gluster-devel] missing files On 02/04/2015 01:30 AM, David F. Robinson wrote: Sorry. Thought about this a little more. I should have been clearer. The files were on both bricks

Re: [Gluster-devel] missing files

2015-02-04 Thread Xavier Hernandez
: [Gluster-devel] missing files It sounds to me like the files were only copied to one replica, werent there for the initial for the initial ls which triggered a self heal, and were there for the last ls because they were healed. Is there any chance that one of the replicas was down during the rsync

[Gluster-devel] missing files

2015-02-03 Thread David F. Robinson
I rsync'd 20-TB over to my gluster system and noticed that I had some directories missing even though the rsync completed normally. The rsync logs showed that the missing files were transferred. I went to the bricks and did an 'ls -al /data/brick*/homegfs/dir/*' the files were on the bricks.

Re: [Gluster-devel] missing files

2015-02-03 Thread David F. Robinson
@gluster.org; gluster-us...@gluster.org gluster-us...@gluster.org Sent: 2/3/2015 7:12:34 PM Subject: Re: [Gluster-devel] missing files It sounds to me like the files were only copied to one replica, werent there for the initial for the initial ls which triggered a self heal, and were

Re: [Gluster-devel] missing files

2015-02-03 Thread Benjamin Turner
It sounds to me like the files were only copied to one replica, werent there for the initial for the initial ls which triggered a self heal, and were there for the last ls because they were healed. Is there any chance that one of the replicas was down during the rsync? It could be that you lost

Re: [Gluster-devel] missing files

2015-02-03 Thread David F. Robinson
...@gluster.org Sent: 2/3/2015 7:12:34 PM Subject: Re: [Gluster-devel] missing files It sounds to me like the files were only copied to one replica, werent there for the initial for the initial ls which triggered a self heal, and were there for the last ls because they were healed. Is there any