Re: [Gluster-devel] Proposal for Gluster Compliance Feature

2014-08-07 Thread Joseph Fernandes
Hi All, We have the feature page for Gluster compliance & Archive in gluster.org http://www.gluster.org/community/documentation/index.php/Features/gluster_compliance_archive Would like thank Luis, Vivek, Jeff, Dan, Vijay and Kaleb for the valuable reviews/comments/discussions that helped in ref

[Gluster-devel] Nightly RPM builds for GlusterFS 3.6 are available

2014-08-07 Thread Niels de Vos
On Wed, Aug 06, 2014 at 12:11:07PM -0400, Justin Clift wrote: > - Original Message - > > Reminder!!! > > > > The weekly Gluster Community meeting is in 1 hour, in > > #gluster-meeting on IRC. > > > > This is a completely public meeting, everyone is encouraged > > to attend and be a part o

[Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Ravishankar N
Manual resolution of split-brains [1] has been a tedious task involving understanding and modifying AFR's changelog extended attributes. To simplify and to an extent automate this task, we are proposing a new CLI command with which the user can specify what the source brick/file is, and aut

Re: [Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Pranith Kumar Karampuri
On 08/07/2014 02:05 PM, Ravishankar N wrote: Manual resolution of split-brains [1] has been a tedious task involving understanding and modifying AFR's changelog extended attributes. To simplify and to an extent automate this task, we are proposing a new CLI command with which the user can s

Re: [Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Ravishankar N
On 08/07/2014 02:09 PM, Pranith Kumar Karampuri wrote: On 08/07/2014 02:05 PM, Ravishankar N wrote: Manual resolution of split-brains [1] has been a tedious task involving understanding and modifying AFR's changelog extended attributes. To simplify and to an extent automate this task, we are

Re: [Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Niels de Vos
On Thu, Aug 07, 2014 at 02:05:34PM +0530, Ravishankar N wrote: > > Manual resolution of split-brains [1] has been a tedious task > involving understanding and modifying AFR's changelog extended > attributes. To simplify and to an extent automate this task, we are > proposing a new CLI command with

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Niels de Vos
On Wed, Aug 06, 2014 at 06:57:46PM -0700, Harshavardhana wrote: > FYI > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192420 Nice! Is there a plan to propose glusterfs as a FreeBSD port too? Thanks, Niels ___ Gluster-devel mailing list Gluster-de

Re: [Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Ravishankar N
On 08/07/2014 03:06 PM, Niels de Vos wrote: On Thu, Aug 07, 2014 at 02:05:34PM +0530, Ravishankar N wrote: Manual resolution of split-brains [1] has been a tedious task involving understanding and modifying AFR's changelog extended attributes. To simplify and to an extent automate this task, we

Re: [Gluster-devel] Automated split-brain resolution

2014-08-07 Thread Niels de Vos
On Thu, Aug 07, 2014 at 03:17:11PM +0530, Ravishankar N wrote: > On 08/07/2014 03:06 PM, Niels de Vos wrote: > >On Thu, Aug 07, 2014 at 02:05:34PM +0530, Ravishankar N wrote: > >>Manual resolution of split-brains [1] has been a tedious task > >>involving understanding and modifying AFR's changelog

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Emmanuel Dreyfus
Niels de Vos wrote: > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192420 > Nice! Is there a plan to propose glusterfs as a FreeBSD port too? That remind me I did not commit NetBSD's package for cmockery. I just did it. -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz m...@netbsd.org

[Gluster-devel] multiple write file on mount a volume

2014-08-07 Thread Gong XiaoHui
Hi I mount a GlusterFS volume to the path ”/mnt/ext3_rv”, I use “cp” command to copy different srcFiles to the same dstFile “/mnt/ext3_rv/test.iso” at one time, after copy, the dstFile”test.iso” is not any of my srcFiles, how to resolve the multiple write problem. Any response is apprec

Re: [Gluster-devel] Fw: Re: Corvid gluster testing

2014-08-07 Thread David F. Robinson
Just to clarify a little, there are two cases where I was evaluating performance. 1) The first case that Pranith was working involved 20-nodes with 4-processors on each node for a total of 80-processors. Each processor does its own independent i/o. These files are roughly 100-200MB each and

Re: [Gluster-devel] Fw: Re: Corvid gluster testing

2014-08-07 Thread David F. Robinson
My apologies. I did some additional testing and realized that my timing wasn't right. I believe that after I do the write, NFS caches the data and until I close and flush the file, the timing isn't correct. I believe the appropriate timing is now 38-seconds for NFS and 60-seconds for gluster.

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Justin Clift
- Original Message - > FYI > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192420 Cool. :) + Justin -- GlusterFS - http://www.gluster.org An open source, distributed file system scaling to several petabytes, and handling thousands of clients. My personal twitter: twitter.com/re

Re: [Gluster-devel] Academic project in Distributed systems

2014-08-07 Thread Justin Clift
- Original Message - > Hello, > > I'm Vipul. I'm currently in my final year of computer engineering and would > like some guidance on choosing an academic project to spend 2-3 months > working on it. I've got a little experience in some internal Glusterfs > components. But overall, I'm int

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Ravishankar N
On 08/07/2014 12:22 PM, Emmanuel Dreyfus wrote: Hi NetBSD now passes most of tests/basic/afr, but I still have a failure here in tests/basic/aft/self-heal.t. This command gets "" and cause a failure later in "check heal has happened in the correct direction": GFID=$(gf_get_gfid_xattr $B1/br

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Emmanuel Dreyfus
Ravishankar N wrote: > This is a mistake in the testcase, it has to be GFID=$(gf_get_gfid_xattr > $B0/brick1/file) . Would you like to send a patch to fix it? Sure, Shall I replace all occurences of $B1 by $B0? There is a B1 definition in tests/snapshot.rc: tests/snapshot.rc:if [ "$B1" = ""

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Ravishankar N
On 08/07/2014 10:35 PM, Emmanuel Dreyfus wrote: Ravishankar N wrote: This is a mistake in the testcase, it has to be GFID=$(gf_get_gfid_xattr $B0/brick1/file) . Would you like to send a patch to fix it? Sure, Shall I replace all occurences of $B1 by $B0? There is a B1 definition in tests/snap

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Harshavardhana
On Thu, Aug 7, 2014 at 2:41 AM, Niels de Vos wrote: > On Wed, Aug 06, 2014 at 06:57:46PM -0700, Harshavardhana wrote: >> FYI >> >> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=192420 > > Nice! Is there a plan to propose glusterfs as a FreeBSD port too? > Yes, that is currently being handled

Re: [Gluster-devel] Fw: Re: Corvid gluster testing

2014-08-07 Thread Anand Avati
David, Is it possible to profile the app to understand the block sizes used for performing write() (using strace, source code inspection etc)? The block sizes reported by gluster volume profile is measured on the server side and is subject to some aggregation by the client side write-behind xlator.

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Emmanuel Dreyfus
Harshavardhana wrote: > Thanks to Manu we are able to get some regression tests running. NetBSD now completes basic/afr. Do you have other successes? -- Emmanuel Dreyfus http://hcpnet.free.fr/pubz m...@netbsd.org ___ Gluster-devel mailing list Gluste

Re: [Gluster-devel] Fw: Re: Corvid gluster testing

2014-08-07 Thread David F. Robinson
I could give you the size of the data done with each "write" statement in our fortran code if that is helpful. It is a fortran code with write statements inside a do-loop. I can give you the size of the writes along with the number if writes if that is helpful. > You could also enable the io-s

Re: [Gluster-devel] Cmockery2 --> "patch-ready" at FreeBSD ports for inclusion

2014-08-07 Thread Harshavardhana
On Thu, Aug 7, 2014 at 12:41 PM, Emmanuel Dreyfus wrote: > Harshavardhana wrote: > >> Thanks to Manu we are able to get some regression tests running. > > NetBSD now completes basic/afr. Do you have other successes? > > Yes 'meta.t' and bunch of other things work properly. There are many bugs tha

[Gluster-devel] Transparent encryption and authentication in distributed systems with non-trusted servers

2014-08-07 Thread Edward Shishkin
Hello everyone, Here we provide some basic backgrounds in addition to the manpages at http://www.gluster.org/community/documentation/index.php?title=Features/disk-encryption Comments, questions, any your experience are welcome. Thanks, Edward. Transparent encryption and authentic

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Emmanuel Dreyfus
Ravishankar N wrote: > Don't think that is needed. B1 could be a valid argument. CC'ing Avra > just to be sure. Um, we also have $B2 to $B6, which are sometime correctly defined, sometime not. The places where definition exist suggest we should have B$i=/d/backends/$i -- Emmanuel Dreyfus http

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Emmanuel Dreyfus
Emmanuel Dreyfus wrote: > Um, we also have $B2 to $B6, which are sometime correctly defined, > sometime not. The places where definition exist suggest we should have > B$i=/d/backends/$i And what about basic/mgmt_v3-locks.t ? It uses $B1, $B2, $B3, $H1, $H2 and $H3 without ever defining them. P

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Emmanuel Dreyfus
Emmanuel Dreyfus wrote: > And what about basic/mgmt_v3-locks.t ? > It uses $B1, $B2, $B3, $H1, $H2 and $H3 without ever defining them. > Perhaps this is why that specific test randomly fails? I was wrong, this is defined in cluster.rc: eval "H$i=${CLUSTER_PFX}.$i"; (...) eval "B$i=$B0/$i"; Thi

[Gluster-devel] FreeBSD vote enabled as part of smoke tests

2014-08-07 Thread Harshavardhana
FreeBSD can vote as part of smoke tests, just like NetBSD. Happy Porting! -- Religious confuse piety with mere ritual, the virtuous confuse regulation with outcomes ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Ravishankar N
On 08/08/2014 08:52 AM, Emmanuel Dreyfus wrote: Emmanuel Dreyfus wrote: And what about basic/mgmt_v3-locks.t ? It uses $B1, $B2, $B3, $H1, $H2 and $H3 without ever defining them. Perhaps this is why that specific test randomly fails? I was wrong, this is defined in cluster.rc: eval "H$i=${CLU

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Ravishankar N
On 08/08/2014 11:01 AM, Avra Sengupta wrote: On 08/08/2014 10:07 AM, Ravishankar N wrote: On 08/08/2014 08:52 AM, Emmanuel Dreyfus wrote: Emmanuel Dreyfus wrote: And what about basic/mgmt_v3-locks.t ? It uses $B1, $B2, $B3, $H1, $H2 and $H3 without ever defining them. Perhaps this is why tha

Re: [Gluster-devel] $B1 in tests

2014-08-07 Thread Avra Sengupta
On 08/08/2014 10:07 AM, Ravishankar N wrote: On 08/08/2014 08:52 AM, Emmanuel Dreyfus wrote: Emmanuel Dreyfus wrote: And what about basic/mgmt_v3-locks.t ? It uses $B1, $B2, $B3, $H1, $H2 and $H3 without ever defining them. Perhaps this is why that specific test randomly fails? I was wrong,