Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-19 Thread Frank Van Damme
Op 03-05-11 17:55, Brandon High schreef: -H: Hard links If you're going to this for 2 TB of data, remember to expand your swap space first (or have tons of memory). Rsync will need it to store every inode number in the directory. -- No part of this copyright message may be reproduced, read or

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-19 Thread Daniel Rock
On Thu, 19 May 2011 15:39:50 +0200, Frank Van Damme wrote: Op 03-05-11 17:55, Brandon High schreef: -H: Hard links If you're going to this for 2 TB of data, remember to expand your swap space first (or have tons of memory). Rsync will need it to store every inode number in the directory.

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-06 Thread Ian Collins
On 05/ 5/11 10:02 PM, Joerg Schilling wrote: Ian Collinsi...@ianshome.com wrote: *ufsrestore works fine on ZFS filesystems (although I haven't tried it with any POSIX ACLs on the original ufs filesystem, which would probably simply get lost). star -copy -no-fsync is typically 30%

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-05 Thread Joerg Schilling
Erik Trimble erik.trim...@oracle.com wrote: rsync is indeed slower than star; so far as I can tell, this is due almost exclusively to the fact that rsync needs to build an in-memory table of all work being done *before* it starts to copy. After that, it copies at about the same rate as

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-05 Thread Joerg Schilling
Ian Collins i...@ianshome.com wrote: *ufsrestore works fine on ZFS filesystems (although I haven't tried it with any POSIX ACLs on the original ufs filesystem, which would probably simply get lost). star -copy -no-fsync is typically 30% faster that ufsdump | ufsrestore. Does it

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Joerg Schilling
Freddie Cash fjwc...@gmail.com wrote: On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton dan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? rsync, with --whole-file --inplace (and other options),

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Andrew Gabriel
Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? I use 'ufsdump | ufsrestore'*. I would also suggest try setting 'sync=disabled' during the operation, and reverting it afterwards. Certainly, fastfs (a

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Joerg Schilling
Andrew Gabriel andrew.gabr...@oracle.com wrote: Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? I use 'ufsdump | ufsrestore'*. I would also suggest try setting 'sync=disabled' during the operation,

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Brandon High
On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling joerg.schill...@fokus.fraunhofer.de wrote: But this is most likely slower than star and does rsync support sparse files? 'rsync -ASHXavP' -A: ACLs -S: Sparse files -H: Hard links -X: Xattrs -a: archive mode; equals -rlptgoD (no -H,-A,-X) You

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Erik Trimble
On 5/3/2011 8:55 AM, Brandon High wrote: On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling joerg.schill...@fokus.fraunhofer.de wrote: But this is most likely slower than star and does rsync support sparse files? 'rsync -ASHXavP' -A: ACLs -S: Sparse files -H: Hard links -X: Xattrs -a: archive

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Ian Collins
On 05/ 4/11 01:35 AM, Joerg Schilling wrote: Andrew Gabrielandrew.gabr...@oracle.com wrote: Dan Shelton wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? I use 'ufsdump | ufsrestore'*. I would also suggest try

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Freddie Cash
On Tue, May 3, 2011 at 12:36 PM, Erik Trimble erik.trim...@oracle.com wrote: On 5/3/2011 8:55 AM, Brandon High wrote: On Tue, May 3, 2011 at 5:47 AM, Joerg Schilling joerg.schill...@fokus.fraunhofer.de  wrote: But this is most likely slower than star and does rsync support sparse files?

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-05-03 Thread Brandon High
On Tue, May 3, 2011 at 12:36 PM, Erik Trimble erik.trim...@oracle.com wrote: rsync is indeed slower than star; so far as I can tell, this is due almost exclusively to the fact that rsync needs to build an in-memory table of all work being done *before* it starts to copy. After that, it copies

[zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Dan Shelton
Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? Thanks. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Freddie Cash
On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton dan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? rsync, with --whole-file --inplace (and other options), works well for the initial copy. rsync, with

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Joerg Schilling
Dan Shelton dan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? Try star -copy Note that due to the problems on ZFS to deal with stable states, I recommend to use -no-fsync and it may of

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Ian Collins
On 04/30/11 06:00 AM, Freddie Cash wrote: On Fri, Apr 29, 2011 at 10:53 AM, Dan Sheltondan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? rsync, with --whole-file --inplace (and other options),

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Brandon High
On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton dan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? Setting 'sync=disabled' for the initial copy will help, since it will make all writes asynchronous.

Re: [zfs-discuss] Faster copy from UFS to ZFS

2011-04-29 Thread Richard Elling
On Apr 29, 2011, at 1:37 PM, Brandon High wrote: On Fri, Apr 29, 2011 at 10:53 AM, Dan Shelton dan.shel...@oracle.com wrote: Is anyone aware of any freeware program that can speed up copying tons of data (2 TB) from UFS to ZFS on same server? Setting 'sync=disabled' for the initial copy