[Gluster-devel] Language Bindings and Data Serialization in Gluster

2013-02-14 Thread Brad Childs
I'm working on a hadoop/gluster integration.  First, whoever wrote the initial map/reduce gluster DFS layer did a great job.  Same with the FUSE layer--  FUSE alone solves a lot of problems. However, some of the hadoop architectures require cross language (java) bindings with gluster (c). Other

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread Dave Chinner
On Thu, Feb 14, 2013 at 05:01:10PM -0500, J. Bruce Fields wrote: > On Thu, Feb 14, 2013 at 05:10:02PM +1100, Dave Chinner wrote: > > On Wed, Feb 13, 2013 at 05:20:52PM -0500, Theodore Ts'o wrote: > > > Telldir() and seekdir() are basically implementation horrors for any > > > file system that is us

Re: [Gluster-devel] Is it safe to use synctask_{wake, yield} outside of __wake and __yield macros?

2013-02-14 Thread Anand Avati
On Wed, Feb 13, 2013 at 8:37 PM, krish wrote: > The strategy is to defer yield'ing of the task till a mgmt operation is > sent to all the peers. > > If I understand it right, the following theorem is true, > - A function which begins execution in a synctask (ie. thread from > syncenv's thread po

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread J. Bruce Fields
On Thu, Feb 14, 2013 at 05:10:02PM +1100, Dave Chinner wrote: > On Wed, Feb 13, 2013 at 05:20:52PM -0500, Theodore Ts'o wrote: > > Telldir() and seekdir() are basically implementation horrors for any > > file system that is using anything other than a simple array of > > directory entries ala the V

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread J. Bruce Fields
On Wed, Feb 13, 2013 at 04:05:01PM -0800, Anand Avati wrote: > On Wed, Feb 13, 2013 at 3:44 PM, Theodore Ts'o wrote: > > > > I suspect this would seriously screw over Gluster, though, and this > > wouldn't be a solution for NFSv3, since NFS needs long-lived directory > > cookies, and not the short

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread J. Bruce Fields
On Wed, Feb 13, 2013 at 06:44:30PM -0500, Theodore Ts'o wrote: > On Wed, Feb 13, 2013 at 06:05:11PM -0500, J. Bruce Fields wrote: > > > > Would it be possible to make something work like, for example, a 31-bit > > hash plus an offset into a hash bucket? > > > > I have trouble thinking about this,

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread Dave Chinner
On Wed, Feb 13, 2013 at 05:20:52PM -0500, Theodore Ts'o wrote: > Telldir() and seekdir() are basically implementation horrors for any > file system that is using anything other than a simple array of > directory entries ala the V7 Unix file system or the BSD FFS. For any > file system which is usi

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread Dave Chinner
On Thu, Feb 14, 2013 at 03:59:17AM +, Myklebust, Trond wrote: > > -Original Message- > > From: J. Bruce Fields [mailto:bfie...@fieldses.org] > > Sent: Wednesday, February 13, 2013 4:34 PM > > To: Myklebust, Trond > > Cc: Theodore Ts'o; linux-e...@vger.kernel.org; sand...@redhat.com; > >

Re: [Gluster-devel] regressions due to 64-bit ext4 directory cookies

2013-02-14 Thread Dave Chinner
On Wed, Feb 13, 2013 at 04:40:35PM +0100, Bernd Schubert wrote: > >The general advise (even before this Bug) is that XFS should be used, > >which is not affected with this problem (yet?). > > Hmm, well, always depends on the workload. XFS won't suffer from this collision bug, for 2 reasons. The f

Re: [Gluster-devel] Regarding volume store cleanup at the time of 'volume delete'

2013-02-14 Thread Niels de Vos
On Wed, Feb 13, 2013 at 09:47:20PM -0500, Krutika Dhananjay wrote: > How about "marking" a volume as deleted by setting an > extended attribute on the /var/lib/glusterd/vols/ > directory, effectively making glusterd perform the following actions for > deleting a volume: > > a. Setting the extende

[Gluster-devel] memory corruption in 3.4.0alpha

2013-02-14 Thread Emmanuel Dreyfus
More reports on 3.4.0alpha I had a glusterfsd crash on GF_FREE (iosstat->filename). The memory referenced is still valid, and looking at the code I do not see any room for double free or free from static storage. I suspect an unrelated heap corruption. Program terminated with signal 11, Segmentat

Re: [Gluster-devel] GlusterFS 3.4 Alpha Release

2013-02-14 Thread Emmanuel Dreyfus
After working for a few hours, I have glusterd wrecking itslef on a node. I already reported that for 3.4.0qa8, but at that time it happened only on an amd64 machine, while now I get it on an i386. Kernel trace shows no activity from glusterd. Attaching it with gdb raise a pthrerad related asserti