Re: [Gluster-users] Parallel cp?

2012-02-06 Thread David Gabriel Simas
- Original Message - > On Sun, Feb 5, 2012 at 4:41 AM, Brian Candler > wrote: > > I reckon that to quickly copy one glusterfs volume to another, I > > will need a > > multi-threaded 'cp'.  That is, something which will take the list > > of files > > from readdir() and copy batches of N o

Re: [Gluster-users] Parallel cp?

2012-02-06 Thread Brian Candler
On Mon, Feb 06, 2012 at 04:39:15PM +0530, Anand Avati wrote: > > Is there something comparable a client can do on the mountpoint to get a > > list of the component bricks in a volume? > > You can do the getfattr on a directory (say the mount point directory) > and get the list of all bricks. Than

Re: [Gluster-users] Parallel cp?

2012-02-06 Thread Anand Avati
On Sun, Feb 5, 2012 at 10:34 PM, Brian Candler wrote: > On Sun, Feb 05, 2012 at 05:30:40PM +0530, Anand Avati wrote: >> > Alternatively: is it possible to determine for each file which brick it >> > resides on? >> >> Yes, there is the virtual extended attribute >> "trusted.glusterfs.pathinfo" whic

Re: [Gluster-users] Parallel cp?

2012-02-06 Thread Brian Candler
On Mon, Feb 06, 2012 at 08:21:40AM +0100, Daniel Müller wrote: > Don' t you run your bricks in replication mode? So you do not have to copy > anything by hand or batch. That's not what I mean. There are times when I need to make a one-off copy of a subset of the files (say one subdirectory of a vo

Re: [Gluster-users] Parallel cp?

2012-02-05 Thread Daniel Müller
-boun...@gluster.org [mailto:gluster-users-boun...@gluster.org] Im Auftrag von Brian Candler Gesendet: Sonntag, 5. Februar 2012 00:12 An: gluster-users@gluster.org Betreff: [Gluster-users] Parallel cp? I reckon that to quickly copy one glusterfs volume to another, I will need a multi-threaded 'cp&

Re: [Gluster-users] Parallel cp?

2012-02-05 Thread Brian Candler
On Sun, Feb 05, 2012 at 05:30:40PM +0530, Anand Avati wrote: > > Alternatively: is it possible to determine for each file which brick it > > resides on? > > Yes, there is the virtual extended attribute > "trusted.glusterfs.pathinfo" which gives you the location (hostname) > of a file. # getfattr

Re: [Gluster-users] Parallel cp?

2012-02-05 Thread Sabuj Pattanayek
On Sun, Feb 5, 2012 at 6:00 AM, Anand Avati wrote: > On Sun, Feb 5, 2012 at 4:41 AM, Brian Candler wrote: >> I reckon that to quickly copy one glusterfs volume to another, I will need a >> multi-threaded 'cp'.  That is, something which will take the list of files >> from readdir() and copy batche

Re: [Gluster-users] Parallel cp?

2012-02-05 Thread Anand Avati
On Sun, Feb 5, 2012 at 4:41 AM, Brian Candler wrote: > I reckon that to quickly copy one glusterfs volume to another, I will need a > multi-threaded 'cp'.  That is, something which will take the list of files > from readdir() and copy batches of N of them in parallel.  This is so I can > keep all

[Gluster-users] Parallel cp?

2012-02-04 Thread Brian Candler
I reckon that to quickly copy one glusterfs volume to another, I will need a multi-threaded 'cp'. That is, something which will take the list of files from readdir() and copy batches of N of them in parallel. This is so I can keep all the component spindles busy. Question 1: does such a thing ex