Re: [Gluster-devel] [Gluster-users] missing files

2015-02-08 Thread Justin Clift
, Ben Turner btur...@redhat.com Sent: Friday, February 6, 2015 3:27:53 PM Subject: Re: [Gluster-devel] [Gluster-users] missing files On 6 Feb 2015, at 02:05, Benjamin Turner bennytu...@gmail.com wrote: I think that the multi threaded epoll changes that _just_ landed in master will help resolve

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-08 Thread Niels de Vos
, gluster-us...@gluster.org, Gluster Devel gluster-devel@gluster.org, Ben Turner btur...@redhat.com Sent: Friday, February 6, 2015 3:27:53 PM Subject: Re: [Gluster-devel] [Gluster-users] missing files On 6 Feb 2015, at 02:05, Benjamin Turner bennytu...@gmail.com wrote: I think

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-08 Thread Ben Turner
- Original Message - From: Ben Turner btur...@redhat.com To: David F. Robinson david.robin...@corvidtec.com Cc: Pranith Kumar Karampuri pkara...@redhat.com, Xavier Hernandez xhernan...@datalab.es, Benjamin Turner bennytu...@gmail.com, gluster-us...@gluster.org, Gluster Devel

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-08 Thread Ben Turner
:27:53 PM Subject: Re: [Gluster-devel] [Gluster-users] missing files On 6 Feb 2015, at 02:05, Benjamin Turner bennytu...@gmail.com wrote: I think that the multi threaded epoll changes that _just_ landed in master will help resolve this, but they are so new I haven't been able to test

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-08 Thread Ben Turner
- Original Message - From: David F. Robinson david.robin...@corvidtec.com To: Ben Turner btur...@redhat.com Cc: Pranith Kumar Karampuri pkara...@redhat.com, Xavier Hernandez xhernan...@datalab.es, Benjamin Turner bennytu...@gmail.com, gluster-us...@gluster.org, Gluster Devel

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-06 Thread David F. Robinson
: Benjamin Turner bennytu...@gmail.com; gluster-us...@gluster.org; Gluster Devel gluster-devel@gluster.org Sent: 2/6/2015 3:33:42 PM Subject: Re: [Gluster-devel] [Gluster-users] missing files - Original Message - From: Justin Clift jus...@gluster.org To: Benjamin Turner bennytu...@gmail.com

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread David F. Robinson
It was a mix of files from very small to very large. And many terabytes of data. Approx 20tb David (Sent from mobile) === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax]

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread David F. Robinson
Should I run my rsync with --block-size = something other than the default? Is there an optimal value? I think 128k is the max from my quick search. Didn't dig into it throughly though. David (Sent from mobile) === David F. Robinson, Ph.D. President - Corvid

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread David F. Robinson
I'll send you the emails I sent Pranith with the logs. What causes these disconnects? David (Sent from mobile) === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax]

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread David F. Robinson
Isn't rsync what geo-rep uses? David (Sent from mobile) === David F. Robinson, Ph.D. President - Corvid Technologies 704.799.6944 x101 [office] 704.252.1310 [cell] 704.799.7974 [fax] david.robin...@corvidtec.com http://www.corvidtechnologies.com On Feb

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread Benjamin Turner
Correct! I have seen(back in the day, its been 3ish years since I have seen it) having say 50+ volumes each with a geo rep session take system load levels to the point where pings couldn't be serviced within the ping timeout. So it is known to happen but there has been alot of work in the geo

Re: [Gluster-devel] [Gluster-users] missing files

2015-02-05 Thread David F. Robinson
copy that. Thanks for looking into the issue. David -- Original Message -- From: Benjamin Turner bennytu...@gmail.com To: David F. Robinson david.robin...@corvidtec.com Cc: Ben Turner btur...@redhat.com; Pranith Kumar Karampuri pkara...@redhat.com; Xavier Hernandez