rsync erroring out when syncing a large tree

2004-08-10 Thread Mark Watts
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I'm trying to sync a mandrakelinux tree (~120GB) but it bombs out after a while with this error: rsync: connection unexpectedly closed (289336107 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) rsync:

bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread victor
I get this error when I try to copy a directory with a lot of files: bash: /usr/local/bin/rsync: Argument list too long The exact command is: /usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/* [EMAIL PROTECTED]:/mail/spool/imap/user/wex.

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread YOSHIFUJI Hideaki / 吉藤英明
In article [EMAIL PROTECTED] (at Tue, 10 Aug 2004 14:41:54 +0300), victor [EMAIL PROTECTED] says: I get this error when I try to copy a directory with a lot of files: bash: /usr/local/bin/rsync: Argument list too long The exact command is: /usr/local/bin/rsync -rsh=/usr/bin/rsh -r

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Mark Watts
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I get this error when I try to copy a directory with a lot of files: bash: /usr/local/bin/rsync: Argument list too long The exact command is: /usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/*

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Jan-Benedict Glaw
On Tue, 2004-08-10 14:41:54 +0300, victor [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: I get this error when I try to copy a directory with a lot of files: bash: /usr/local/bin/rsync: Argument list too long The exact command is: /usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete

bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread victor
Thank you. I will try the first sugestion. However, can you explain me why this command works? /usr/local/bin/rsync -r --delete --perms --owner --group /mail/spool/imap/user [EMAIL PROTECTED]:/mail/spool/imap In /mail/spool/imap/user I have a lot of subdirectories with 1000 files. What I mean is

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Jan-Benedict Glaw
On Tue, 2004-08-10 16:17:59 +0300, victor [EMAIL PROTECTED] wrote in message [EMAIL PROTECTED]: However, can you explain me why this command works? /usr/local/bin/rsync -r --delete --perms --owner --group /mail/spool/imap/user [EMAIL PROTECTED]:/mail/spool/imap In /mail/spool/imap/user I have

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Tim Conway
You want everything in wex into wex on the remote. Gotcha. Let's take a simple case. wex contains a b c d e. /usr/local/bin/rsync -rsh=/usr/bin/rsh -r --delete --perms --owner --group /mail/spool/imap/user/wex/* [EMAIL PROTECTED]:/mail/spool/imap/user/wex on the commandline becomes

Re: bash: /usr/local/bin/rsync: Argument list too long

2004-08-10 Thread Wayne Davison
On Tue, Aug 10, 2004 at 04:17:59PM +0300, victor wrote: I will try the first sugestion [to run multiple rsync commands]. Don't do that. Read Tim Conway's reply instead. You probably just want to drop the '*' from your command (and leave the trailing '/'). ..wayne.. -- To unsubscribe or

out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread James Bagley Jr
Hello, I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: snip ERROR: out of memory in receive_file_entry rsync error: error allocating core memory buffers (code 22) at util.c(116) rsync: connection unexpectedly closed

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread Widyono
On Tue, Aug 10, 2004 at 11:36:26AM -0700, James Bagley Jr wrote: Hello, I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: ERROR: out of memory in receive_file_entry rsync error: error allocating core memory

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread James Bagley Jr
On Tue, 10 Aug 2004, Widyono wrote: I've rsync'ed 7413719 files successfully (2.6.2 on RH7.2 server, Fermi SL3.0.1 client), 680GB. When I do the top level directory all at once, there are several points where it locks up the server for minutes at a time (directories with large #'s of files,

rsync to a destination 8TB problem...

2004-08-10 Thread Matt Miller
I am trying to use a large (10TB) reiserfs filesystem as an rsync target. The filesystem is on top of lvm2 (pretty sure this doesn't matter, but just in case.) I get the following error when trying to sync a modest set of files to that 10TB target (just syncing /etc for now): rsync:

Re: out of memory in receive_file_entry rsync-2.6.2

2004-08-10 Thread Eberhard Moenkeberg
Hi, On Tue, 10 Aug 2004, James Bagley Jr wrote: I've had some problems using rsync to transfer directories with more than 3 million files. Here's the error message from rsync: snip ERROR: out of memory in receive_file_entry rsync error: error allocating core memory buffers (code 22) at

Re: rsync erroring out when syncing a large tree

2004-08-10 Thread Wayne Davison
On Tue, Aug 10, 2004 at 11:28:04AM +0100, Mark Watts wrote: rsync: connection unexpectedly closed (289336107 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) This error just means that the other side went away for some reason. What you need to figure

Re: rsync to a destination 8TB problem...

2004-08-10 Thread Matt Miller
Actually... a cp -r has the same issues... anyone seen this? BTW, I'm on SuSE 9.1 (personal) with the 2.6 kernel, lvm2, reiserfs, 2G RAM, 2G swap matt On Aug 10, 2004, at 4:41 PM, Matt Miller wrote: I am trying to use a large (10TB) reiserfs filesystem as an rsync target. The filesystem is on

CVS update: rsync/patches

2004-08-10 Thread Wayne Davison
Date: Tue Aug 10 17:21:53 2004 Author: wayned Update of /data/cvs/rsync/patches In directory dp.samba.org:/tmp/cvs-serv14140 Modified Files: compare-dest.diff Log Message: Fixed failing hunk. Revisions: compare-dest.diff 1.17 = 1.18

CVS update: rsync

2004-08-10 Thread Wayne Davison
Date: Tue Aug 10 18:15:33 2004 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv27120 Modified Files: exclude.c Log Message: A minor improvement in check_one_exclude(). Revisions: exclude.c 1.83 = 1.84

CVS update: rsyncweb

2004-08-10 Thread Wayne Davison
Date: Tue Aug 10 21:43:48 2004 Author: wayned Update of /data/cvs/rsyncweb In directory dp.samba.org:/tmp/cvs-serv13170 Modified Files: issues.html Log Message: More improvements in debugging hints. Revisions: issues.html 1.11 = 1.12