bad error message? .. main.c code 23 .. caused by sgid on dir

2008-05-28 Thread James G. Sack (jim)
This is to suggest a possible improvement in an error message.

On a recent rsync transfer I see a message like

> rsync: failed to set permissions on ".../somedir": Permission denied (13)
for several dirs that have the sgid bit set

There seems to be a retry pass, because all the messages are repeated.
And then there is (perhaps a summary) line
 > rsync error: some files could not be transferred (code 23) at
main.c(977) [sender=2.6.9]

I used a "-Cavz" option string, so it's understandable that it would
try. The destination user is non-root and the group-owner is not in the
destination system anyway (nor is its gid), so it's understandable there
would be failures.

Perhaps I will try replacing the "-a" with "-rlptoD" (no -g), but I am
not really concerned with solving my problem so much as suggesting that
the summary error message
   "..some files could not be transferred.."
is misleading and might be improved: the dirs in question were
transferred just fine, including files (and subdirs). Perhaps there
needs to be separate counters on errors on transfer, delete, and
perm-setting? And the error message could then be made more specific.

I am not a subscriber, so kindly cc me on replies, if that is
convenient. (Thanks)

Regards,
..jim (and thanks forever for rsync!)
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: "Invalid argument" error when moving sockets to backup dir

2008-05-22 Thread Wayne Davison
On Thu, May 22, 2008 at 02:57:56PM -0500, Jordan Russell wrote:
> Under 3.0.x, rsync sometimes prints an "Invalid argument" error when
> moving sockets to the backup directory (--backup-dir):

Thanks for pointing this out.  I have checked in a fix for this into the
git repository.  You can see the diff by clicking on the "commitdiff"
link in gitweb:

http://git.samba.org/?p=rsync.git

..wayne..
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: "Invalid argument" error when moving sockets to backup dir

2008-05-22 Thread Jordan Russell
Jordan Russell wrote:
> Under 3.0.x, rsync sometimes prints an "Invalid argument" error when
> moving sockets to the backup directory (--backup-dir):

Steps to reproduce (on Fedora 9, with rsync 3.0.2 or 3.0.3pre2):


1. Create a subdirectory named "src" with 13 zero-byte files and a socket:

total 8
drwxr-xr-x 2 root root 4096 May 22 16:11 .
drwxr-xr-x 3 root root 4096 May 22 16:11 ..
-rw-r--r-- 1 root root0 May 22 15:50 file01
-rw-r--r-- 1 root root0 May 22 15:50 file02
-rw-r--r-- 1 root root0 May 22 15:51 file03
-rw-r--r-- 1 root root0 May 22 15:51 file04
-rw-r--r-- 1 root root0 May 22 15:52 file05
-rw-r--r-- 1 root root0 May 22 15:52 file06
-rw-r--r-- 1 root root0 May 22 15:53 file07
-rw-r--r-- 1 root root0 May 22 15:53 file08
-rw-r--r-- 1 root root0 May 22 15:53 file09
-rw-r--r-- 1 root root0 May 22 15:53 file10
-rw-r--r-- 1 root root0 May 22 15:54 file11
-rw-r--r-- 1 root root0 May 22 15:54 file12
-rw-r--r-- 1 root root0 May 22 15:58 file13
srwxr-xr-x 1 root root0 May 20 10:19 socket


2. Initially copy "src" to "dest":

# rsync -avHx --delete --backup --backup-dir=../backupdir src/ dest
sending incremental file list
created directory dest
./
file01
file02
file03
file04
file05
file06
file07
file08
file09
file10
file11
file12
file13
socket

sent 725 bytes  received 265 bytes  1980.00 bytes/sec
total size is 0  speedup is 0.00


3. Move "socket" out of "src":

# mv src/socket .


4. Run rsync again:

# rsync -avHx --delete --backup --backup-dir=../backupdir src/ dest
sending incremental file list
./
rsync: mknod "/_test/dest/../backupdir/socket" failed: Invalid argument (22)
rsync: stat "/_test/dest/../backupdir/socket" failed: No such file or
directory (2)
deleting socket

sent 187 bytes  received 15 bytes  404.00 bytes/sec
total size is 0  speedup is 0.00
rsync error: some files could not be transferred (code 23) at
main.c(1031) [sender=3.0.2]


-- 
Jordan Russell
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


"Invalid argument" error when moving sockets to backup dir

2008-05-22 Thread Jordan Russell
Local end (receiving): 3.0.2, 3.0.3pre2
Remote end (sending): 2.6.9

Under 3.0.x, rsync sometimes prints an "Invalid argument" error when
moving sockets to the backup directory (--backup-dir):

rsync: mknod "/backup/machine/../machine-before-4/var/run/audit_events"
failed: Invalid argument (22)

The problem appears to be that, at least with sockets, keep_backup() is
calling do_mknod() with garbage in the third parameter (dev).

When I add some debug output to do_mknod():

  printf("mknod pathname=%s, mode=%d, dev=%llu\n", pathname, mode, dev);
  int mknodres = mknod(pathname, mode, dev);
  printf("mknod result: %d, errno=%d\n", mknodres, errno);
  return mknodres;

3.0.2 and 3.0.3pre2 show:

mknod pathname=../machine-before-4/var/run/audit_events, mode=49645,
dev=89016461384865329
mknod result: -1, errno=22
rsync: mknod "/backup/machine/../machine-before-4/var/run/audit_events"
failed: Invalid argument (22)

while 2.6.9 shows:

mknod pathname=../machine-before-4/var/run/audit_events, mode=49645, dev=0
mknod result: -1, errno=2
mknod pathname=../machine-before-4/var/run/audit_events, mode=49645, dev=0
mknod result: 0, errno=2

and no error messages.

-- 
Jordan Russell
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5458] -a -X throws error when processing fifo, even if --no-D is specified

2008-05-10 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5458


[EMAIL PROTECTED] changed:

   What|Removed |Added

 CC||[EMAIL PROTECTED]




--- Comment #1 from [EMAIL PROTECTED]  2008-05-10 23:25 CST ---
ls -l of the fifo:

prwx--   1 jpf  staff  0 May 10 18:55 fifo

the script runs as root, and accesses the target machines over ssh.
authentication is via host keys.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5458] New: -a -X throws error when processing fifo, even if --no-D is specified

2008-05-10 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5458

   Summary: -a -X  throws error when processing fifo, even if --no-D
is specified
   Product: rsync
   Version: 3.0.1
  Platform: x86
OS/Version: Mac OS X
Status: NEW
  Severity: normal
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


i have a backup script which runs on a central "server" and uses rsync to pull
data across the lan from target hosts.  all machines are running osx 10.5.2
(intel), and the same version of rsync (3.0.1, from macports).  the script has
been working fine generally for quite some time.  however, recently as part of
a project, i created a named pipe in a backup target dir on my laptop.  when i
made my weekly sanity check of the backup script's log, i discovered the
following error:

rsync: get_xattr_names: llistxattr("tmp/sf_daemon/fifo",1024) failed: Operation
not permitted (1)
rsync error: some files could not be transferred (code 23) at main.c(1497)
[generator=3.0.1]

in some cases (where very large numbers of files in the same target hierarchy
were involved), this error also appears to have prevented the copying of some
other, unrelated files which i would have expected to have been backed up.  i
have evidence of this, but haven't tried to reproduce that specific effect.

although i found this somewhat disturbing, i've come to expect some xattr
flakiness using rsync on osx, so, since i don't need the fifo to be backed up
anyway, i thought in the interests of time that i would just use --no-D to
exclude any such files from the backup, and thus work around the error.

however, that didn't seem to work either ... so here we are.  if you want, i
can send you the whole script, etc., but that may be overkill (let me know). 
in the meanwhile, this is the offending command (copied from the log file):

   executing /opt/local/bin/rsync
-a
--no-D
--delete
--no-whole-file
--out-format=%o %12b %n
-X
-8
-e
ssh
--rsync-path=/opt/local/bin/rsync
--exclude=.*
crow://Users/jpf/tmp
/Volumes/truth/backup/daily/crow/CLASS.5/Users/jpf

i haven't tried backing up the fifo with -X turned off because i care less
about backing up a fifo than i do about picking up the osx-specific metadata
that still lurks in some files' resource forks ... 

here's the output of rsync --version:

spock(root):/var/log/backup# rsync --version
rsync  version 3.0.1  protocol version 30
Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others.
Web site: http://rsync.samba.org/
Capabilities:
64-bit files, 32-bit inums, 32-bit timestamps, 64-bit long ints,
socketpairs, hardlinks, symlinks, IPv6, batchfiles, inplace,
append, ACLs, xattrs, iconv, symtimes

rsync comes with ABSOLUTELY NO WARRANTY.  This is free software, and you
are welcome to redistribute it under certain conditions.  See the GNU
General Public Licence for details.


if you want more details, or the whole script package, please let me know at
the reporter address.

thanks,
-jf


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error: timeout in data send/receive (code 30) at /home/lapo/packaging/tmp/rsync-2.6.3/io.c(153)

2008-05-10 Thread Wayne Davison
On Thu, May 08, 2008 at 08:59:41AM -0700, arguellodw wrote:
> rsync error: timeout in data send/receive (code 30) at
> /home/lapo/packaging/tmp/rsync-2.6.3/io.c(153)

You are reaching your idle-time timeout.  Either make it larger (e.g.
--timeout=360) or upgrade to a newer rsync version that has support for
keep-alive messages in the protocol and see if that helps.

..wayne..
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error: timeout in data send/receive (code 30) at /home/lapo/packaging/tmp/rsync-2.6.3/io.c(153)

2008-05-09 Thread arguellodw

As an update to this problem, it seems that rsync has no problem
updating/transferring the directory tree (every day, new data is added in a
date directory structure at the remote site).  So when I rsync, I get the
new folders, but the error message always pops up before data files are
transferred over.
-- 
View this message in context: 
http://www.nabble.com/rsync-error%3A-timeout-in-data-send-receive-%28code-30%29-at--home-lapo-packaging-tmp-rsync-2.6.3-io.c%28153%29-tp17127523p17151640.html
Sent from the Samba - rsync mailing list archive at Nabble.com.

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error: timeout in data send/receive (code 30) at /home/lapo/packaging/tmp/rsync-2.6.3/io.c(153)

2008-05-08 Thread arguellodw

We are rsync'ing from an xp box running cygwin to a redhat box, using a Perl
script that fist calls for an ssh tunnel, then calls rsync through local
host.

ssh -P -f -L 8740:remote.host.ip:873 [EMAIL PROTECTED] -p 22 sleep 25

rsync -vrtz -v --timeout=180 --exclude-from=exludefiles
rsync://localhost:8740/   
==
This has worked for quite a while on a daily cron job.  We can still open
the ssh tunnel without any problem.  After the tunnel is open and we run
rsync, we get the following error messages:

rsync error: timeout in data send/receive (code 30) at
/home/lapo/packaging/tmp/rsync-2.6.3/io.c(153)
rsync: connection unexpectedly closed (598306 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
rsync: connection unexpectedly closed (598306 bytes read so far)
rsync error: error in rsync protocol data stream (code 12) at io.c(165)
==
Then it returns to the command prompt.  The number of 'bytes read so far' is
not constant on the different times we've tried rsync'ing, but this number
does stay around 590kB.

Does anybody have any ideas?
-- 
View this message in context: 
http://www.nabble.com/rsync-error%3A-timeout-in-data-send-receive-%28code-30%29-at--home-lapo-packaging-tmp-rsync-2.6.3-io.c%28153%29-tp17127523p17127523.html
Sent from the Samba - rsync mailing list archive at Nabble.com.

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


unexplained error (code 130) at rsync.c(271)

2008-05-07 Thread Martin Magnusson
I'm using rsync 2.6.9 and rsnapshot 1.2.9 on Ubuntu 8.04. When using
rsnapshot to backup a remote computer over ssh, I get the message

rsync error: unexplained error (code 130) at rsync.c(271) [generator=2.6.9]
ERROR: /usr/bin/rsync returned 130 while processing [EMAIL PROTECTED]:/

I looked at the source for rsync 2.6.9, and line 271 in rsync.c is just
a comment. Furthermore, it is in the function void finish_transfer(), so
I don't see how it could return 130.

Does anybody know in which cases rsync might return 130, and what it means?


-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5442] setting times to symlinks which do not point to existing files causes error reports

2008-05-06 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5442


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||WORKSFORME




--- Comment #1 from [EMAIL PROTECTED]  2008-05-06 09:52 CST ---
Rsync only tries to set times on symlinks if the lutimes() function exists.  On
my version of OS X (Panther) the setting of the time on a symlink worked fine. 
If your system says it has lutimes() but it doesn't work, comment out the
HAVE_LUTIMES in config.h and recompile.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5442] New: setting times to symlinks which do not point to existing files causes error reports

2008-05-06 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5442

   Summary: setting times to symlinks which do not point to existing
files causes error reports
   Product: rsync
   Version: 3.0.3
  Platform: All
OS/Version: Mac OS X
Status: NEW
  Severity: normal
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


When changing times on a symlink in Mac OS X, the system actually sets the
times on the symlink destination file. If the destination file does not exist,
syscall returns error.

This behaviour causes rsync to report many "failed to set times on" errors when
source/destination directories contain symlinks which do not point to existing
files. It would be nice if (on Mac OS X only) setting of times to symlinks
would be appropriately guarded or not executed at all since it does not behave
correctly.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5418] New: rsync error: error allocating core memory buffers (code 22)

2008-04-25 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5418

   Summary: rsync error: error allocating core memory buffers (code
22)
   Product: rsync
   Version: 3.0.2
  Platform: Other
OS/Version: AIX
Status: NEW
  Severity: major
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


I am using rsync 3.0.2 (on both ends) to copy a source tree from Mac OS (Intel)
to AIX (Power 5).

My command is

rsync --rsync-path=/work/default/eschnett/rsync-3.0.2/bin/rsync --rsh ssh
--archive --hard-links --sparse --verbose --progress --partial --stats
--compress --exclude _darcs --exclude CVS --exclude doxygen --exclude ".#*"
--exclude .DS_Store --exclude .git --exclude .svn --exclude "*~" --delete
--delete-excluded CONTRIBUTORS COPYRIGHT Makefile arrangements src lib
.gitignore AEIArrangements AEIPhysics bbhfactory bin cactus.config carpet
carpet-stable carpet-stable-2 carpet-stable-3 kranc parfiles
[EMAIL PROTECTED]:/work/default/eschnett/Calpha

After checking about 8000 files, I receive the error

sending incremental file list
rsync: connection unexpectedly closed (794 bytes received so far) [sender]
rsync error: error allocating core memory buffers (code 22) at io.c(635)
[sender=3.0.2]

With two additional --verbose options, the last screen output is

recv_generator(arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC1.dump,8043)
arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC1.dump
is uptodate
send_files(8043,
arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC1.dump)
recv_generator(arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC10.dump,8044)
arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC10.dump
is uptodate
send_files(8044,
arrangements/AEIDevelopment/BbhIData/src/BbhCollabInitialData/t7600/Nid_gyy_SphereC10.dump)

Here the transmission hangs.  When I abort with ctrl-C, I receive

^CKilled by signal 2.
rsync error: unexplained error (code 255) at rsync.c(541) [sender=3.0.2]
_exit_cleanup(code=20, file=rsync.c, line=541): about to call exit(255)



This is a show-stopper for using rsync 3.0.1 and 3.0.2 on AIX.  I have no such
problems on other platforms which use Linux operating systems and Intel
processors.  My current work-around is to fall back to 2.6.2.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Rsync Failing with an error code 23

2008-04-23 Thread Kenny Votava
I am getting the following when i am trying to rsync two directories on 
the same nfs server.


../bin/rsync -aHq --force --delete --bwlimit=0 ../data2/ ../data
rsync: rename 
"/opt/pivot/pivotlink3/virtual/sanvita/http/data/.RX_LVL_HH_Inc_Amt10_14_9MM.dat.0.P9Iy08" 
-> "RX_LVL_HH_Inc_Amt10_14_9MM.dat.0": No such file or directory (2)

rsync error: some files could not be transferred (code 23) at main.c(702)

-Kenny
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Rsync Error Code 23

2008-04-18 Thread Wayne Davison
On Thu, Apr 17, 2008 at 12:57:27PM -0600, Kenneth Seal wrote:
> I have tried running my script in verbose mode -vv but I really don't
> want to read all 1000+ lines of output to look for the error code.

Errors should be output to stderr, and it isn't required that you have
even one -v specified to see errors.  You should be able to redirect
stderr (file-handle 2) like this:

rsync -av src/ dest/ 2>/tmp/rsync-$$.txt

That should give you the errors in whatever file you like.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Rsync Error Code 23

2008-04-17 Thread Kenneth Seal

Hi,

Is it possible to log rsync error messages and read them in console  
(Mac OS 10.5 Utility), or perhaps a text file? I have tried running my  
script in verbose mode -vv but I really don't want to read all 1000+  
lines of output to look for the error code.


Currently my script looks something like this:

rsync -aE --delete --progress ~/(Entire Home Directory) /Volumes/(My  
backup drive)


Thanks,
Ken
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error: some files could not be transferred -- How to ignore

2008-04-10 Thread Matt McCutchen
On Tue, 2008-04-08 at 21:27 -0600, Kenneth Seal wrote:
> In my case, rsync displays the error code "rsync error: some files  
> could not be transferred (code 23)" and it kills my script. Do you  
> have any advice on how would I go about writing, researching etc. a  
> script to tell rsync to ignore such errors?

If I were you, I would try to fix the code 23 instead of ignoring it!
Rsync exits with code 23 when at least one non-fatal error occurs that
may affect the correctness of the transfer.  Perhaps the errors
currently causing the code 23 are unimportant, but if you ignore code
23, you risk missing more important errors in the future (e.g., the
nonexistence of a source argument).

Look for the specific error messages in the output that are causing the
code 23.  If it isn't immediately obvious how to fix them, post them to
the list and I'll take a look.  Or if you don't care about copying the
offending files, you can --exclude them.

Matt


signature.asc
Description: This is a digitally signed message part
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error: some files could not be transferred -- How to ignore

2008-04-09 Thread Kyle Crawford


On Apr 8, 2008, at 11:27 PM, Kenneth Seal <[EMAIL PROTECTED]> wrote:


Hi Wayne,

I read your thread online at http://lists.samba.org/archive/rsync/2005-June/012847.html 
 and I am having a similar problem.


In my case, rsync displays the error code "rsync error: some files  
could not be transferred (code 23)" and it kills my script. Do you  
have any advice on how would I go about writing, researching etc. a  
script to tell rsync to ignore such errors?


I am using the bash shell in Mac OS 10.5.2. Any help would be much  
appreciated.


Many thanks,
Ken
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


The result code of a command is stored in a special variable named $?

Check the value of that variable in an if statement immediately after  
the rsync line in your script


If the value is 0 then there were no errors.  If the value is 23, then  
you could log a warning or not. If there is any other value in $? ,  
then you have another problem.


If we could see the relevant lines of your script we might be able to  
provide more help.


Also you control whether your script succeeds or fails based on the  
last line in your script.


If you want it to succeed, the last line would be

exit 0

Google for advanced bash scripting guide for more info.

Kyle
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error: some files could not be transferred -- How to ignore

2008-04-09 Thread Kenneth Seal

Hi Wayne,

I read your thread online at http://lists.samba.org/archive/rsync/2005-June/012847.html 
 and I am having a similar problem.


In my case, rsync displays the error code "rsync error: some files  
could not be transferred (code 23)" and it kills my script. Do you  
have any advice on how would I go about writing, researching etc. a  
script to tell rsync to ignore such errors?


I am using the bash shell in Mac OS 10.5.2. Any help would be much  
appreciated.


Many thanks,
Ken
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error

2008-04-04 Thread Daniel Maher
On Fri, 4 Apr 2008 17:11:25 +0530 "Kaushal Shriyan"
<[EMAIL PROTECTED]> wrote:

> hi steven
> 
> I am getting the below error now
> 
> building file list ... rsync: pop_dir "/root" failed: Permission
> denied (13) rsync error: errors selecting input/output files, dirs
> (code 3) at flist.c(1356) [sender=2.6.9]

Check the permissions on the directory, and ensure that the user which
rsync is running as can access that directory.


-- 
Daniel Maher 


signature.asc
Description: PGP signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error

2008-04-04 Thread Kaushal Shriyan
On Fri, Apr 4, 2008 at 4:51 PM, Steven Hartland <[EMAIL PROTECTED]> wrote:
> Log file is likely locked.
>
>  - Original Message - From: "Kaushal Shriyan"
> <[EMAIL PROTECTED]>
>
>
>
> > hi
> >
> > I have the script http://pastebin.com/d4b062d28 and the roots cron
> > entry are as below
> >
> > 30 2 * * * su sms /usr/local/bin/testrsync_mysql.sh
> >
> > I am getting the below error
> >
> > building file list ... rsync: opendir "/var/lib/mysql/wordpress"
> > failed: Permission denied (13) done mysql/ib_logfile0
> > mysql/ib_logfile1
> > Killed by signal 2.
> > rsync error: unexplained error (code 255) at rsync.c(276) [sender=2.6.9]
> >
> > Any clue as what is happening
> >
>
>
>  
>  This e.mail is private and confidential between Multiplay (UK) Ltd. and the
> person or entity to whom it is addressed. In the event of misdirection, the
> recipient is prohibited from using, copying, printing or otherwise
> disseminating it or any information contained in it.
>  In the event of misdirection, illegible or incomplete transmission please
> telephone +44 845 868 1337
>  or return the E.mail to [EMAIL PROTECTED]
>
>

hi steven

I am getting the below error now

building file list ... rsync: pop_dir "/root" failed: Permission
denied (13) rsync error: errors selecting input/output files, dirs
(code 3) at flist.c(1356) [sender=2.6.9]

Thanks and Regards

Kaushal
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error

2008-04-04 Thread Steven Hartland

Log file is likely locked.

- Original Message - 
From: "Kaushal Shriyan" <[EMAIL PROTECTED]>

hi

I have the script http://pastebin.com/d4b062d28 and the roots cron
entry are as below

30 2 * * * su sms /usr/local/bin/testrsync_mysql.sh

I am getting the below error

building file list ... rsync: opendir "/var/lib/mysql/wordpress"
failed: Permission denied (13) done mysql/ib_logfile0
mysql/ib_logfile1
Killed by signal 2.
rsync error: unexplained error (code 255) at rsync.c(276) [sender=2.6.9]

Any clue as what is happening




This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 


In the event of misdirection, illegible or incomplete transmission please 
telephone +44 845 868 1337
or return the E.mail to [EMAIL PROTECTED]

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error

2008-04-04 Thread Kaushal Shriyan
hi

I have the script http://pastebin.com/d4b062d28 and the roots cron
entry are as below

30 2 * * * su sms /usr/local/bin/testrsync_mysql.sh

I am getting the below error

building file list ... rsync: opendir "/var/lib/mysql/wordpress"
failed: Permission denied (13) done mysql/ib_logfile0
mysql/ib_logfile1
Killed by signal 2.
rsync error: unexplained error (code 255) at rsync.c(276) [sender=2.6.9]

Any clue as what is happening

Thanks and Regards

Kaushal
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: 3.0.0pre2 error on module, fine on subdir

2008-04-01 Thread Erik Jan Tromp
On Sat, 29 Mar 2008 23:08:32 -0700
Wayne Davison <[EMAIL PROTECTED]> wrote:

> On Sat, Mar 29, 2008 at 04:18:57PM -0400, Erik Jan Tromp wrote:
> > I've done some experimenting locally & narrowed things down. In
> > essense,  I'm tripping over subtle changes in daemon exclude
> > behaviour.
> 
> Thanks for figuring out what was going wrong.  Rsync should not allow
> the exclusion of a "." dir by a name-matching rule (e.g. ".*" or
> "*/"), so I have fixed this in the latest code.
> 
> ..wayne..

Just a quick followup on this. I've updated to pre3 & reverted my
rsyncd.conf to its original state. Everything's working fine. Great
work!

Erik

-- 
"Failure is not an option. (It comes bundled with Windows.)"
"If at first you don't succeed, redefine success."

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: 3.0.0pre2 error on module, fine on subdir

2008-03-29 Thread Wayne Davison
On Sat, Mar 29, 2008 at 04:18:57PM -0400, Erik Jan Tromp wrote:
> I've done some experimenting locally & narrowed things down. In essense, 
> I'm tripping over subtle changes in daemon exclude behaviour.

Thanks for figuring out what was going wrong.  Rsync should not allow
the exclusion of a "." dir by a name-matching rule (e.g. ".*" or "*/"),
so I have fixed this in the latest code.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: 3.0.0pre2 error on module, fine on subdir

2008-03-29 Thread Erik Jan Tromp
On Fri, 28 Mar 2008 19:04:27 -0400
Erik Jan Tromp <[EMAIL PROTECTED]> wrote:

> Just tripped over this one today.
> 
> $ rsync --no-motd rsync://alphageek.dyndns.org/slackware
> rsync: link_stat "." (in slackware) failed: No such file or directory (2)
> rsync error: some files could not be transferred (code 23) at main.c(1498) 
> [receiver=3.0.1pre2]
> 
> $ rsync --no-motd rsync://alphageek.dyndns.org/slackware/slackware-current
> drwxr-xr-x4096 2008/03/26 01:30:27 slackware-current

I've done some experimenting locally & narrowed things down. In essense, 
I'm tripping over subtle changes in daemon exclude behaviour. The 
following is a rundown of what I have & how I worked around the changes.

rsyncd.conf snippets (old, gives the previously mentioned error):

[slackware]
comment = Slackware mirror (trees only: use [slackware-iso] for isos)
lock file = /var/lock/rsyncd.slackware.lock
max connections = 2
path = /path/to/slackware
exclude = /.* /slackware-*-iso

[slackware-iso]
comment = Slackware mirror (isos only: use [slackware] for trees)
lock file = /var/lock/rsyncd.slackware-iso.lock
max connections = 2
path = /path/to/slackware
exclude = /.* /slackware-*.? /slackware-current

layout in /path/to/slackware/ (dirs suffixed with '/' to differentiate 
them from regular files):

slackware-8.1/
slackware-8.1-iso/
slackware-9.0/
slackware-9.0-iso/
slackware-9.1/
slackware-9.1-iso/
slackware-10.0/
slackware-10.0-iso/
slackware-10.1/
slackware-10.1-iso/
slackware-10.2/
slackware-10.2-iso/
slackware-11.0/
slackware-11.0-iso/
slackware-12.0/
slackware-12.0-iso/
slackware-current/
.hidden/(not its real name. development stuff)
.*.??   (--temp-dir points here for pulling updates)

The workaround is almost anticlimactic. All it took was to change each 
module's '/.*' exclude to '/.?*'.

While experimenting, I found another module with the same problem.

rsyncd.conf snippet (old, gives the previously mentioned error):

[sligdo]
comment = Slackware via Jigdo
path = /path/to/sligdo
exclude = index.shtml */*/ *.meta

layout in /path/to/sligdo/ (dirs suffixed with '/' to differentiate them 
from regular files):

slackware-8.1/
slackware-8.1/-00-00/
slackware-9.0/
slackware-9.0/-00-00/
slackware-9.1/
slackware-9.1/-00-00/
slackware-10.0/
slackware-10.0/-00-00/
slackware-10.1/
slackware-10.1/-00-00/
slackware-10.2/
slackware-10.2/2005-09-13/
slackware-11.0/
slackware-11.0/2006-10-02/
slackware-12.0/
slackware-12.0/2007-07-02/
index.shtml
jigdo-file
slackware-mirrors.jigdo
sligdo
sligdo-create

Each of the slackware-$VERSION/ & slackware-$VERSION/-MM-DD/ 
directories contain one or more file triplets named

slackware-$VERSION-$ISONAME.jigdo
slackware-$VERSION-$ISONAME.meta
slackware-$VERSION-$ISONAME.template

where I want only the slackware-$VERSION/ .jigdo/.template pairs & 
most of the toplevel regular files available for public access. What I 
don't want available are the slackware-$VERSION/-MM-DD/ dirs & 
contents as well as the toplevel index.shtml.

Working around  this was't quite as elegant. I needed to change the 
'*/*/' exclude to '*/??*/'.

Erik

-- 
"Failure is not an option. (It comes bundled with Windows.)"
"If at first you don't succeed, redefine success."

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


3.0.0pre2 error on module, fine on subdir

2008-03-28 Thread Erik Jan Tromp
Just tripped over this one today.

$ rsync --no-motd rsync://alphageek.dyndns.org/slackware
rsync: link_stat "." (in slackware) failed: No such file or directory (2)
rsync error: some files could not be transferred (code 23) at main.c(1498) 
[receiver=3.0.1pre2]

$ rsync --no-motd rsync://alphageek.dyndns.org/slackware/slackware-current
drwxr-xr-x4096 2008/03/26 01:30:27 slackware-current

What strikes me as quite odd is that I also have full backups pulled daily 
using modules referencing '/' on my machines (with a port other than 873/tcp 
for added obfuscation) & they're apparently working without error.

Erik

-- 
"Failure is not an option. (It comes bundled with Windows.)"
"If at first you don't succeed, redefine success."

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-26 Thread Matt McCutchen
On Wed, 2008-03-26 at 12:34 +, Chris G wrote:
> On Wed, Mar 26, 2008 at 08:23:42AM -0400, Matt McCutchen wrote:
> > Only mtime is used in the decision of whether a file needs to be
> > transferred, so -t is enough.  I personally find it clearer to list the
> > things I do want preserved rather than pass -a and subtract the things I
> > don't want preserved.
> > 
> So just -rt will minimise the time taken by not checksumming the files
> every time?  That'll do me nicely if so.

Yes.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-26 Thread Chris G
On Wed, Mar 26, 2008 at 08:23:42AM -0400, Matt McCutchen wrote:
> On Tue, 2008-03-25 at 15:29 +0100, Paul Slootman wrote:
> > On Tue 25 Mar 2008, Chris G wrote:
> > > On Tue, Mar 25, 2008 at 02:32:34PM +0100, Paul Slootman wrote:
> > > > On Tue 25 Mar 2008, Chris G wrote:
> > > > > > 
> > > > > > BTW, is there a reason why you're doing -r and not -a ?
> > > > > > 
> > > > > I don't want some of the options that -a gives me, in particular not
> > > > > the -D and -l.
> > > > 
> > > > That's what the -no-* things are for. You could use -a -no-D -no-l
> > > > 
> > > Maybe, but it's simpler just to put -r, does all I want!  :-)
> > 
> > Well, it'll transfer your files, but it will read and checksum every
> > file each time you run the rsync command, instead of being able to skip
> > files that are unchanged. It can't see which files are unchanged as
> > you're not setting mtime, perms, user/group ownerships.  Hence it's much
> > more efficient in the long run to use at least the -tpgo options.
> 
> Only mtime is used in the decision of whether a file needs to be
> transferred, so -t is enough.  I personally find it clearer to list the
> things I do want preserved rather than pass -a and subtract the things I
> don't want preserved.
> 
So just -rt will minimise the time taken by not checksumming the files
every time?  That'll do me nicely if so.

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-26 Thread Matt McCutchen
On Tue, 2008-03-25 at 15:29 +0100, Paul Slootman wrote:
> On Tue 25 Mar 2008, Chris G wrote:
> > On Tue, Mar 25, 2008 at 02:32:34PM +0100, Paul Slootman wrote:
> > > On Tue 25 Mar 2008, Chris G wrote:
> > > > > 
> > > > > BTW, is there a reason why you're doing -r and not -a ?
> > > > > 
> > > > I don't want some of the options that -a gives me, in particular not
> > > > the -D and -l.
> > > 
> > > That's what the -no-* things are for. You could use -a -no-D -no-l
> > > 
> > Maybe, but it's simpler just to put -r, does all I want!  :-)
> 
> Well, it'll transfer your files, but it will read and checksum every
> file each time you run the rsync command, instead of being able to skip
> files that are unchanged. It can't see which files are unchanged as
> you're not setting mtime, perms, user/group ownerships.  Hence it's much
> more efficient in the long run to use at least the -tpgo options.

Only mtime is used in the decision of whether a file needs to be
transferred, so -t is enough.  I personally find it clearer to list the
things I do want preserved rather than pass -a and subtract the things I
don't want preserved.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-26 Thread Chris G
On Tue, Mar 25, 2008 at 12:41:25PM +0100, Paul Slootman wrote:
> On Tue 25 Mar 2008, Chris G wrote:
> 
> > I'm getting this error message and I don't really understand what
> > rsync is trying to tell me:-
> > 
> > rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such file or 
> > directory (2)
> > rsync error: some files could not be transferred (code 23) at 
> > main.c(977) [sender=2.6.9]
> > 
> > Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
> > does exist and is readable by the user running rsync.
> > 
> > Oh, this is rsync 3.0.0 and the command line is:-
> > 
> > rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
> > /rdiffBackup/gradwell/Mail/ /home/chris/MailArchive
> 
Last nights cron run produced no errors so, presumably, it must have
been some sort of transient condition that provoked the error.

As a result of the ensuing thread I will consider changing to using -a
though.

Thanks all.

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Paul Slootman
On Tue 25 Mar 2008, Chris G wrote:
> On Tue, Mar 25, 2008 at 02:32:34PM +0100, Paul Slootman wrote:
> > On Tue 25 Mar 2008, Chris G wrote:
> > > > 
> > > > BTW, is there a reason why you're doing -r and not -a ?
> > > > 
> > > I don't want some of the options that -a gives me, in particular not
> > > the -D and -l.
> > 
> > That's what the -no-* things are for. You could use -a -no-D -no-l
> > 
> Maybe, but it's simpler just to put -r, does all I want!  :-)

Well, it'll transfer your files, but it will read and checksum every
file each time you run the rsync command, instead of being able to skip
files that are unchanged. It can't see which files are unchanged as
you're not setting mtime, perms, user/group ownerships.  Hence it's much
more efficient in the long run to use at least the -tpgo options.


Paul Slootman
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Chris G
On Tue, Mar 25, 2008 at 02:32:34PM +0100, Paul Slootman wrote:
> On Tue 25 Mar 2008, Chris G wrote:
> > > 
> > > BTW, is there a reason why you're doing -r and not -a ?
> > > 
> > I don't want some of the options that -a gives me, in particular not
> > the -D and -l.
> 
> That's what the -no-* things are for. You could use -a -no-D -no-l
> 
Maybe, but it's simpler just to put -r, does all I want!  :-)

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Paul Slootman
On Tue 25 Mar 2008, Chris G wrote:
> > 
> > BTW, is there a reason why you're doing -r and not -a ?
> > 
> I don't want some of the options that -a gives me, in particular not
> the -D and -l.

That's what the -no-* things are for. You could use -a -no-D -no-l


Paul Slootman
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Chris G
On Tue, Mar 25, 2008 at 01:31:37PM +0100, Paul Slootman wrote:
> On Tue 25 Mar 2008, Chris G wrote:
> > On Tue, Mar 25, 2008 at 12:41:25PM +0100, Paul Slootman wrote:
> > > On Tue 25 Mar 2008, Chris G wrote:
> > > 
> > > > I'm getting this error message and I don't really understand what
> > > > rsync is trying to tell me:-
> > > > 
> > > > rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such 
> > > > file or directory (2)
> > > > rsync error: some files could not be transferred (code 23) at 
> > > > main.c(977) [sender=2.6.9]
> > > > 
> > > > Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
> > > > does exist and is readable by the user running rsync.
> > > > 
> > > > Oh, this is rsync 3.0.0 and the command line is:-
> > > > 
> > > > rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
> > > > /rdiffBackup/gradwell/Mail/ /home/chris/MailArchive
> > > 
> > > Does /rdiffBackup/gradwell/Mail/ exist below /home/chris/MailArchive/ ?
> > > 
> > No:-
> 
> Oops, sorry, I don't know what I was thinking...
> (before my 1st mug of coffee, I think :-)
> 
> 
> > chris$ ls /home/chris/MailArchive/
> > boating  friends   holidays   isbd money selling software  
> > vehicles
> > family   gardenhouseHome  jobs personal  sentmail telecoms  work
> > france   hardware  internet   leisure  ridingshopping  trimble
> > 
> > chris$ ls /rdiffBackup/gradwell/Mail/
> > In  Tm   family  friends  hardware  houseHome  isbd  leisure 
> > personal  selling   software  vehicles
> > Li  boating  france  garden   holidays  internet   jobs  money riding   
> >  shopping  telecoms  work
> 
> Could you do an "ls -la /rdiffBackup/gradwell/Mail/" ? and perhaps also
> without the trailing slash.

It's the same with and without the trailing /.

chris$ ls -la /rdiffBackup/gradwell/Mail
total 104
drwxr-xr-x 26 chris chris 4096 2007-12-23 18:56 .
drwxr-xr-x 26 chris chris 4096 2008-03-24 17:46 ..
drwx--  8 chris chris 4096 2008-02-24 19:15 In
drwx-- 37 chris chris 4096 2008-02-26 12:37 Li
drwx-- 11 chris chris 4096 2008-03-05 12:05 Tm
drwx--  5 chris chris 4096 2007-12-12 23:16 boating
drwx-- 14 chris chris 4096 2007-12-12 23:22 family
drwx-- 14 chris chris 4096 2008-01-29 13:47 france
drwx-- 47 chris chris 4096 2007-12-12 23:20 friends
drwx--  8 chris chris 4096 2007-12-12 23:16 garden
drwx-- 13 chris chris 4096 2007-12-14 13:21 hardware
drwx--  8 chris chris 4096 2007-12-12 23:26 holidays
drwx-- 13 chris chris 4096 2007-12-12 23:18 houseHome
drwx-- 10 chris chris 4096 2007-12-12 23:15 internet
drwx-- 30 chris chris 4096 2008-03-10 09:58 isbd
drwx-- 21 chris chris 4096 2007-12-12 23:13 jobs
drwx--  3 chris chris 4096 2007-12-12 23:22 leisure
drwx--  9 chris chris 4096 2007-12-13 09:17 money
drwx--  6 chris chris 4096 2007-12-12 23:18 personal
drwx-- 28 chris chris 4096 2007-12-12 23:18 riding
drwx--  7 chris chris 4096 2007-12-12 23:18 selling
drwx-- 20 chris chris 4096 2008-03-24 10:35 shopping
    drwx--  7 chris chris 4096 2007-12-12 23:28 software
drwx--  8 chris chris 4096 2007-12-12 23:18 telecoms
drwx--  8 chris chris 4096 2007-12-12 23:12 vehicles
drwx--  4 chris chris 4096 2007-12-12 23:22 work

> Also running rsync with multiple -v options may help show what's wrong.

I have just tried from the command line and got no error, the error
was from a cron run lat night.  I have added some -v to the crontab
and we'll see if I get a repeat of the error tonight.

> 
> BTW, is there a reason why you're doing -r and not -a ?
> 
I don't want some of the options that -a gives me, in particular not
the -D and -l.

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Paul Slootman
On Tue 25 Mar 2008, Chris G wrote:
> On Tue, Mar 25, 2008 at 12:41:25PM +0100, Paul Slootman wrote:
> > On Tue 25 Mar 2008, Chris G wrote:
> > 
> > > I'm getting this error message and I don't really understand what
> > > rsync is trying to tell me:-
> > > 
> > > rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such file 
> > > or directory (2)
> > > rsync error: some files could not be transferred (code 23) at 
> > > main.c(977) [sender=2.6.9]
> > > 
> > > Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
> > > does exist and is readable by the user running rsync.
> > > 
> > > Oh, this is rsync 3.0.0 and the command line is:-
> > > 
> > > rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
> > > /rdiffBackup/gradwell/Mail/ /home/chris/MailArchive
> > 
> > Does /rdiffBackup/gradwell/Mail/ exist below /home/chris/MailArchive/ ?
> > 
> No:-

Oops, sorry, I don't know what I was thinking...
(before my 1st mug of coffee, I think :-)


> chris$ ls /home/chris/MailArchive/
> boating  friends   holidays   isbd money selling software  
> vehicles
> family   gardenhouseHome  jobs personal  sentmail telecoms  work
> france   hardware  internet   leisure  ridingshopping  trimble
> 
> chris$ ls /rdiffBackup/gradwell/Mail/
> In  Tm   family  friends  hardware  houseHome  isbd  leisure personal 
>  selling   software  vehicles
> Li  boating  france  garden   holidays  internet   jobs  money riding
> shopping  telecoms  work

Could you do an "ls -la /rdiffBackup/gradwell/Mail/" ? and perhaps also
without the trailing slash.
Also running rsync with multiple -v options may help show what's wrong.

BTW, is there a reason why you're doing -r and not -a ?


Paul Slootman
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Chris G
On Tue, Mar 25, 2008 at 12:41:25PM +0100, Paul Slootman wrote:
> On Tue 25 Mar 2008, Chris G wrote:
> 
> > I'm getting this error message and I don't really understand what
> > rsync is trying to tell me:-
> > 
> > rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such file or 
> > directory (2)
> > rsync error: some files could not be transferred (code 23) at 
> > main.c(977) [sender=2.6.9]
> > 
> > Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
> > does exist and is readable by the user running rsync.
> > 
> > Oh, this is rsync 3.0.0 and the command line is:-
> > 
> > rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
> > /rdiffBackup/gradwell/Mail/ /home/chris/MailArchive
> 
> Does /rdiffBackup/gradwell/Mail/ exist below /home/chris/MailArchive/ ?
> 
No:-

chris$ ls /home/chris/MailArchive/
boating  friends   holidays   isbd money selling software  vehicles
family   gardenhouseHome  jobs personal  sentmail telecoms  work
france   hardware  internet   leisure  ridingshopping  trimble

chris$ ls /rdiffBackup/gradwell/Mail/
In  Tm   family  friends  hardware  houseHome  isbd  leisure personal  
selling   software  vehicles
Li  boating  france  garden   holidays  internet   jobs  money riding
shopping  telecoms  work


-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: [EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Paul Slootman
On Tue 25 Mar 2008, Chris G wrote:

> I'm getting this error message and I don't really understand what
> rsync is trying to tell me:-
> 
> rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such file or 
> directory (2)
> rsync error: some files could not be transferred (code 23) at main.c(977) 
> [sender=2.6.9]
> 
> Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
> does exist and is readable by the user running rsync.
> 
> Oh, this is rsync 3.0.0 and the command line is:-
> 
> rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
> /rdiffBackup/gradwell/Mail/ /home/chris/MailArchive

Does /rdiffBackup/gradwell/Mail/ exist below /home/chris/MailArchive/ ?


Paul Slootman
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


[EMAIL PROTECTED]: Cron <[EMAIL PROTECTED]> rsync -r --exclude /In/ --exclude /Lirsync error message that I don't understand

2008-03-25 Thread Chris G
I'm getting this error message and I don't really understand what
rsync is trying to tell me:-

rsync: link_stat "/rdiffBackup/gradwell/Mail/." failed: No such file or 
directory (2)
rsync error: some files could not be transferred (code 23) at main.c(977) 
[sender=2.6.9]

Can anyone explain what it's saying please.  /rdiffBackup/gradwell/Mail/
does exist and is readable by the user running rsync.

Oh, this is rsync 3.0.0 and the command line is:-

rsync -r --exclude /In/ --exclude /Li/ --exclude /Tm/ 
/rdiffBackup/gradwell/Mail/ /home/chris/MailArchive

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: error allocating core memory buffers with certain iconv args

2008-03-13 Thread Wayne Davison
On Tue, Mar 11, 2008 at 03:00:25PM +0100, Giuliano Gavazzi wrote:
> rsync: writefd_unbuffered failed to  write 4 bytes [sender]: Broken pipe (32)

This just tells you that the receiver side went away, but we don't know
why it went away.  If it is crashing, try to get a core dump and report
the backtrace (with symbols).

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


error allocating core memory buffers with certain iconv args

2008-03-11 Thread Giuliano Gavazzi

rsync 3.0.0. MacOSX 10.5.1 Server/Intel.

Trying to detect files with funny chars in their name, as I cannot  
find them with "find", I use the error (Illegal byte sequence) given  
by rsync when the target charset cannot reproduce them.

While doing this I have met this error:

/usr/local/bin/rsync -an --rsync-path=/usr/local/bin/rsync -- 
iconv=UTF8-MAC,437  /db   /tmp/ rsync: writefd_unbuffered failed to  
write 4 bytes [sender]: Broken pipe (32)

rsync: connection unexpectedly closed (9 bytes received so far) [sender]
rsync error: error allocating core memory buffers (code 22) at  
io.c(600) [sender=3.0.0]



note that in /tmp/ there is nothing that has to do with the source  
tree (db).


A bit more detail from a vvv run:

[sender] make_file(db/archivi/[...],*,2)
rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken  
pipe (32)

server_recv(2) starting pid=26880
recv_file_name(db)
received 1 names
recv_file_list done
recv_file_name(db/archivi)
recv_file_name(db/def)
recv_file_name(db/disegni)
recv_file_name(db/prj)
recv_file_name(db/storici)
received 5 names
recv_file_list done
get_local_name count=6 /tmp/
generator starting pid=26880
delta-transmission disabled for local transfer or --whole-file
recv_generator(db,1)
recv_generator(db,2)
recv_generator(db/archivi,3)
recv_generator(db/def,4)
recv_generator(db/disegni,5)
recv_generator(db/prj,6)
recv_generator(db/storici,7)
recv_files(1) starting
rsync: connection unexpectedly closed (9 bytes received so far) [sender]
rsync error: error allocating core memory buffers (code 22) at  
io.c(600) [sender=3.0.0]

_exit_cleanup(code=12, file=io.c, line=600): about to call exit(22)


Giuliano

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error: protocol incompatibility (code 2) at rsync.c, using --iconv=. and (code 2) and rsync-3.0.0pre8

2008-02-10 Thread Matt McCutchen
On Thu, 2008-02-07 at 20:09 +0100, Edmond Dantes wrote:
> Running rsync on our intradisk Xscale Arm BigEndian MiniServer (NAS) 
> System is causing some problems running
> on special character files and crashing.
> Rsync is syncing running on a mounted samba share, syncing to the local 
> disk. It is started with the parameters
> --iconv=. what I suggest is the solution for syncing the attached file.
> 
> log output in /var/log/messages
> received request to transfer non-regular file: 1706 [sender]
> rsync error: protocol incompatibility (code 2) at rsync.c(297) 
> [sender=3.0.0pre8]
> 
> If running without the "--iconv=." option I get the following error
> rsync error: some files could not be transferred (code 23) at 
> main.c(1058) [sender=3.0.0pre8]
> caused by the attached document file.
> 
> I'm using libiconv-1.9.1 and a linux-2.4.31 Kernel System based on an 
> open embedded linux similar to openslug libc-2.3.90 system
> my rsync command line ist as follows:
> /sbin/rsync -v --log-file=/var/log/rsync.status.log --delete-before 
> --partial -y -ogt -vaxH /mnt/download /export/backup

The transfer is local from rsync's perspective, so --iconv=. is not
going to help because it converts filenames from the local machine's
encoding to itself.  Still, we should fix the crash with the --iconv=.
option.  And presumably you want to solve the problem without --iconv=.
so you can transfer the file.  So please re-run both commands (with and
without --iconv) with verbosity level 3 (-vvv) and post the complete
output of each.  (In particular, the code 23 message means nothing to me
without seeing the previous error message that led to it.)

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


FW: Error code 23, delete failed, error 0

2008-02-06 Thread Rob Bosch
Just as clarification, when I said the directory does not exist I mean that
is was properly deleted by the server/receiving side.  It appears as if
rsync did everything that it should but an error code of zero is being
returned and the exit code is set to 23, non-zero.

Full options:
-ruvvityz --compress-level=9 --links --ignore-case --ignore-errors --stats
--del --exclude-from=/cygdrive/c/DiffExclude.log

Patches:
Using the preallocate.diff and ignore-case.diff patches from the
rsync-patches tarball for 3.0.0pre8.

FYI, I was getting this issue on pre5 and still getting it with pre8.  

Rob

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Error code 23, delete failed, error 0

2008-02-06 Thread Rob Bosch
I'm getting errors in my rsync.logs using rsync3.0.0pre8 with the -vv
option.  The client is running on cygwin as the client, CentOS as the
server.  The error in the log is:

rsync: delete_file: rmdir(filepath) failed: No error (0) 

When I look on the server/receiving side the directory does not exist.  Just
trying to understand why this would cause a non-zero exit code.

Rob

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: various xattr problems. Was: Re: internal abbrev error! ?

2008-02-05 Thread Anthony Morton
That's the missing info I needed to fix the problem.  There was a  
call in the sender that was being run when it shouldn't have in dry- 
run mode.  The latest dev version (git, nightly, etc.) has this fixed.


And it looks like all the problems I was having are now resolved.   
Many thanks to all!


(I am now using the latest flags.diff, crtimes.diff and backup-dir- 
dels.diff from /ftp/rsync/patches - however I find I still need to  
change some instances of '--flags' to '--fileflags' in the former!)


Tony M.

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: various xattr problems. Was: Re: internal abbrev error! ?

2008-02-04 Thread Wayne Davison
On Mon, Feb 04, 2008 at 01:59:54AM +0100, Giuliano Gavazzi wrote:
> Running without -n transfers the file correctly.

That's the missing info I needed to fix the problem.  There was a call
in the sender that was being run when it shouldn't have in dry-run mode.
The latest dev version (git, nightly, etc.) has this fixed.

Thanks for your help!

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


various xattr problems. Was: Re: internal abbrev error! ?

2008-02-03 Thread Giuliano Gavazzi


On 13 Jan 2008, at 08:06, Wayne Davison wrote:


On Sat, Jan 12, 2008 at 08:29:43PM +, Max Lane wrote:

[receiver] internal abbrev error!


Aha, I fixed on on the sending side, but yours is on the receiving  
side.

I just checked-in a change that should hopefully fix that too.  If you
could give the latest dev version a try, I'd like to know if that  
fixes

it for you.  (See git, latest nightly tar file, etc.)

..wayne..


[Configuration: MacOSX 10.5.1 Intel. rsync from internal drive to  
external firewire 800.]


It appears that can this internal abbrev error (and others) still  
appear on the sending side with pre8 in a dry run (-n):


bash-3.2# date;  /usr/local/bin/rsync -avcinAX --stats --rsync-path=/ 
usr/local/bin/rsync \
--exclude='Library/Caches' --exclude='Library/Mail*' /BACKUPS/ 
albook.local/Users/a/ \

/Volumes/imega2/albookabackup/; date
Sun Feb  3 12:33:31 CET 2008
sending incremental file list
.d..ta. ./
>fc.t.. .DS_Store
[...]
.d..t.. .Trash/
>f+ .Trash/Complete GIOS PDF 2007 Catalogue.zip
[sender] internal abbrev error!
rsync error: error in rsync protocol data stream (code 12) at  
xattrs.c(565) [sender=3.0.0pre8]
rsync: writefd_unbuffered failed to write 82 bytes [generator]: Broken  
pipe (32)

Sun Feb  3 12:33:46 CET 2008



it happens on a file with xattrs:

xattr ".Trash/Complete GIOS PDF 2007 Catalogue.zip"
com.apple.metadata:kMDItemWhereFroms
com.apple.quarantine

Running without -n transfers the file correctly.
I stopped midway this last transfer to see if the dry run would error  
again on that same file, but it did not. It did however error at a  
different point with another error:


dry run:
[...]
>fc.t.. Documents/Downloads/.DS_Store
[sender] could not find xattr #13 for Documents/Downloads/ 
0182642479-0108.pdf
rsync error: error in rsync protocol data stream (code 12) at  
xattrs.c(561) [sender=3.0.0pre8]

Sun Feb  3 13:20:00 CET 2008

bash-3.2#   xattr -l Documents/Downloads/0182642479-0108.pdf
com.apple.FinderInfo:
   00 6E 00 63 00 65 00 73 00 00 00 00 00 00 00  
00.n.c.e.s
0010   00 00 00 00 00 00 00 00 00 00 00 00 00 00 00  
00


again a normal run transfers the file and a subsequent dry run does  
not give any error on that file.
However another problem appears, apparently triggered by the checksum  
option (-c): at apparently random and not necessarily big files, the  
process hangs.


Sorry to post on different issues at the same time...

Giuliano
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: internal abbrev error! ?

2008-01-29 Thread Matt McCutchen
On Sun, 2008-01-13 at 11:31 +, Max Lane wrote:
> I'm still getting the error with rsync-HEAD-20080113-0640GMT:
> 
> 
> sync: writefd_unbuffered failed to write 5 bytes [sender]: Broken pipe
> (32)
> [receiver] internal abbrev error! len=61 datum[0]=98 
> rsync: connection unexpectedly closed (52620 bytes received so far)
> [sender]
> rsync error: error in rsync protocol data stream (code 12) at
> io.c(600) [sender=3.0.0pre8]
> 
> 
> Note: I added rxa>datum_len and rxa->datum[0] to the abbrev error rprintf in 
> case that helps.

Max,

If you are still getting this error with the current development rsync,
I suggest that you file a bug and provide a tar or something of the
minimal collection of files that reproduces the problem.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5221] rsync error: partial transfer (code 23) at main.c(576)

2008-01-26 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5221


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||INVALID




--- Comment #2 from [EMAIL PROTECTED]  2008-01-26 16:25 CST ---
As Matt mentioned, the reason for the partial transfer is mentioned in an
earlier message.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5221] rsync error: partial transfer (code 23) at main.c(576)

2008-01-22 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5221





--- Comment #1 from [EMAIL PROTECTED]  2008-01-23 01:03 CST ---
Rsync prints the "code 23" message at the end of the run when at least one
non-fatal error occurred that may have affected the correctness of the run. 
Rsync should have printed another message to stderr stating the specific
problem; what was that message?

BTW, consider upgrading to a modern version of rsync.  The latest stable
version is 2.6.9.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5221] New: rsync error: partial transfer (code 23) at main.c(576)

2008-01-22 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5221

   Summary: rsync error: partial transfer (code 23) at main.c(576)
   Product: rsync
   Version: 2.6.3
  Platform: Sparc
OS/Version: SunOS
Status: NEW
  Severity: major
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


we get rsync error: partial transfer (code 23) at main.c(576)
please let us know the resolution for the same or this can be ignorable


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


RE: 4TB and "150 000 000" files out of memory error

2008-01-16 Thread Sylvain Gargasson
Ok Matt, Thank you very much

I have now two solutions:

Have bad performance and big SWAP

Or

Use little spited parts in a script

Thank you I always like have two choices.

Thanks for all Bye

Sylvain GARGASSON
Technicien
EUDASYS
60/62, Rue du Maréchal Foch
78000 VERSAILLES
Tél. : 01 39 25 66 66
Fax : 01 39 25 66 67

Céline Louis
Assistante
Tèl: +33 (0)1.39.25.66.79
Fax: +33 (0)1.39.25.66.67

Ce message contient des informations confidentielles couvertes par le secret 
professionnel. Si vous n'êtes pas le destinataire désigné, nous vous remercions 
de bien vouloir nous en aviser immédiatement et de nous retourner ce message ou 
de le détruire, sans faire un quelconque usage de son contenu, ni le 
communiquer ou le diffuser, ni en prendre aucune copie, électronique ou non.

La sécurité des envois de messages électroniques ne peut être assurée. Ces 
messages peuvent notamment être interceptés, modifiés, altérés, détruits, 
perdus, arriver tardivement ou partiellement, ou contenir des virus.

L'expéditeur ne saurait être tenu pour responsable des erreurs ou omissions qui 
résulteraient d'un envoi par message électronique. Si vous souhaitez vérifier 
l'authenticité du message et des fichiers joints, merci d'en solliciter une 
copie sur papier.


-Message d'origine-
De : Matt McCutchen [mailto:[EMAIL PROTECTED] 
Envoyé : mardi 15 janvier 2008 18:33
À : Sylvain Gargasson
Cc : rsync@lists.samba.org
Objet : RE: 4TB and "150 000 000" files out of memory error

On Tue, 2008-01-15 at 09:55 +0100, Sylvain Gargasson wrote:
> I work in a production and I not very happy from use pre-release version...
> 
> I have use FAQ and calculate I need 15GB of RAM or SWAP...
> 
> I can create big swap without problem but my client use Samba for share is 
> 150 Millions files and if I use all RAM I can have performance impact...
> 
> Do you know if I can use some command to directly use SWAP memory for rsync???

No.  If Linux had a ulimit for the amount of data a process can have in
RAM at once, that would be perfect, but unfortunately it doesn't.

Another option is to split the copy into smaller portions, each of which
can be done within the memory limit.  For example, if the size of your
source directory is split relatively evenly among a number of immediate
subdirectories, you could write a script to iterate over the source
subdirectories and copy each to the corresponding destination
subdirectory using a separate rsync run (possibly with an additional run
to do top-level deletions).

Matt


--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


RE: 4TB and "150 000 000" files out of memory error

2008-01-15 Thread Matt McCutchen
On Tue, 2008-01-15 at 09:55 +0100, Sylvain Gargasson wrote:
> I work in a production and I not very happy from use pre-release version...
> 
> I have use FAQ and calculate I need 15GB of RAM or SWAP...
> 
> I can create big swap without problem but my client use Samba for share is 
> 150 Millions files and if I use all RAM I can have performance impact...
> 
> Do you know if I can use some command to directly use SWAP memory for rsync???

No.  If Linux had a ulimit for the amount of data a process can have in
RAM at once, that would be perfect, but unfortunately it doesn't.

Another option is to split the copy into smaller portions, each of which
can be done within the memory limit.  For example, if the size of your
source directory is split relatively evenly among a number of immediate
subdirectories, you could write a script to iterate over the source
subdirectories and copy each to the corresponding destination
subdirectory using a separate rsync run (possibly with an additional run
to do top-level deletions).

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


RE: 4TB and "150 000 000" files out of memory error

2008-01-15 Thread Sylvain Gargasson
Hi Matt,

Thanks a lot,

I work in a production and I not very happy from use pre-release version...

I have use FAQ and calculate I need 15GB of RAM or SWAP...

I can create big swap without problem but my client use Samba for share is 150 
Millions files and if I use all RAM I can have performance impact...

Do you know if I can use some command to directly use SWAP memory for rsync???

Thanks in advance

Best regards

Sylvain GARGASSON
Technicien
EUDASYS
60/62, Rue du Maréchal Foch
78000 VERSAILLES
Tél. : 01 39 25 66 66
Fax : 01 39 25 66 67

Céline Louis
Assistante
Tèl: +33 (0)1.39.25.66.79
Fax: +33 (0)1.39.25.66.67

Ce message contient des informations confidentielles couvertes par le secret 
professionnel. Si vous n'êtes pas le destinataire désigné, nous vous remercions 
de bien vouloir nous en aviser immédiatement et de nous retourner ce message ou 
de le détruire, sans faire un quelconque usage de son contenu, ni le 
communiquer ou le diffuser, ni en prendre aucune copie, électronique ou non.

La sécurité des envois de messages électroniques ne peut être assurée. Ces 
messages peuvent notamment être interceptés, modifiés, altérés, détruits, 
perdus, arriver tardivement ou partiellement, ou contenir des virus.

L'expéditeur ne saurait être tenu pour responsable des erreurs ou omissions qui 
résulteraient d'un envoi par message électronique. Si vous souhaitez vérifier 
l'authenticité du message et des fichiers joints, merci d'en solliciter une 
copie sur papier.


-Message d'origine-
De : Matt McCutchen [mailto:[EMAIL PROTECTED] 
Envoyé : mardi 15 janvier 2008 03:16
À : Sylvain Gargasson
Cc : rsync@lists.samba.org
Objet : Re: 4TB and "150 000 000" files out of memory error

On Mon, 2008-01-14 at 17:05 +0100, Sylvain Gargasson wrote:
> I want use you product to migrate 4TB of data (in 150 millions files)
> 
> When rsync make the list of files it full my RAM and after my SWAP and my 
> server crash.

Use a development version of rsync 3.0.0, which has an incremental
recursion mode that avoids keeping a list of all the source files in
memory for the entire run.  The source code for the latest pre-release
of rsync 3.0.0 is at:

http://rsync.samba.org/ftp/rsync/rsync-3.0.0pre8.tar.gz

Matt


--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: 4TB and "150 000 000" files out of memory error

2008-01-14 Thread Matt McCutchen
On Mon, 2008-01-14 at 17:05 +0100, Sylvain Gargasson wrote:
> I want use you product to migrate 4TB of data (in 150 millions files)
> 
> When rsync make the list of files it full my RAM and after my SWAP and my 
> server crash.

Use a development version of rsync 3.0.0, which has an incremental
recursion mode that avoids keeping a list of all the source files in
memory for the entire run.  The source code for the latest pre-release
of rsync 3.0.0 is at:

http://rsync.samba.org/ftp/rsync/rsync-3.0.0pre8.tar.gz

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


4TB and "150 000 000" files out of memory error

2008-01-14 Thread Sylvain Gargasson
Hi all,

Thank you for your very useful product but I have a memory problem.

I want use you product to migrate 4TB of data (in 150 millions files)

When rsync make the list of files it full my RAM and after my SWAP and my 
server crash.

I have 4GB of RAM and 4GB of SWAP

Do you know what can I do??

Can I have an option to use an index on disk or something like this??

Thanks in advance

Sylvain GARGASSON
Technicien
EUDASYS

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: internal abbrev error! ?

2008-01-13 Thread Max Lane
On 13/01/2008, Wayne Davison <[EMAIL PROTECTED]> wrote:
>
> On Sat, Jan 12, 2008 at 08:29:43PM +, Max Lane wrote:
> > [receiver] internal abbrev error!
>
> Aha, I fixed on on the sending side, but yours is on the receiving side.
> I just checked-in a change that should hopefully fix that too.  If you
> could give the latest dev version a try, I'd like to know if that fixes
> it for you.  (See git, latest nightly tar file, etc.)


I'm still getting the error with rsync-HEAD-20080113-0640GMT:

sync: writefd_unbuffered failed to write 5 bytes [sender]: Broken pipe (32)
[receiver] internal abbrev error! len=61 datum[0]=98
rsync: connection unexpectedly closed (52620 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(600)
[sender=3.0.0pre8]

Note: I added rxa>datum_len and rxa->datum[0] to the abbrev error rprintf in
case that helps.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: internal abbrev error! ?

2008-01-12 Thread Wayne Davison
On Sat, Jan 12, 2008 at 08:29:43PM +, Max Lane wrote:
> [receiver] internal abbrev error!

Aha, I fixed on on the sending side, but yours is on the receiving side.
I just checked-in a change that should hopefully fix that too.  If you
could give the latest dev version a try, I'd like to know if that fixes
it for you.  (See git, latest nightly tar file, etc.)

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: internal abbrev error! ?

2008-01-12 Thread Max Lane
rsync: writefd_unbuffered failed to write 5 bytes [sender]: Broken pipe (32)
[receiver] internal abbrev error!
rsync error: error in rsync protocol data stream (code 12) at xattrs.c(565)
[receiver=3.0.0pre8]
rsync: connection unexpectedly closed (51836 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(600)
[sender=3.0.0pre8]
~


On 12/01/2008, Wayne Davison <[EMAIL PROTECTED]> wrote:
>
> On Wed, Jan 09, 2008 at 12:22:27PM -0800, Wayne Davison wrote:
> > I have an idea of what may be the problem, and will check into it
> > soon.
>
> The latest dev version now has this fixed, including git & nightly tar
> file.  Thanks for the report!
>
> ..wayne..


I'm still getting the error with pre8 :-(

rsync: writefd_unbuffered failed to write 5 bytes [sender]: Broken pipe (32)
[receiver] internal abbrev error!
rsync error: error in rsync protocol data stream (code 12) at xattrs.c(565)
[receiver=3.0.0pre8]
rsync: connection unexpectedly closed (51836 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(600)
[sender=3.0.0pre8]
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: internal abbrev error! ?

2008-01-12 Thread Wayne Davison
On Wed, Jan 09, 2008 at 12:22:27PM -0800, Wayne Davison wrote:
> I have an idea of what may be the problem, and will check into it
> soon.

The latest dev version now has this fixed, including git & nightly tar
file.  Thanks for the report!

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: internal abbrev error! ?

2008-01-09 Thread Wayne Davison
On Wed, Jan 09, 2008 at 09:41:33AM +, Max Lane wrote:
> Can someone explain what an internal abbrev error is?

The internal code that that is trying to request the contents of a large
xattr value from the sender is confusing the receiver somehow.  I have
an idea of what may be the problem, and will check into it soon.

..wayne..
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


internal abbrev error! ?

2008-01-09 Thread Max Lane
Hello,

I'm trying the latest rsync(3.0.0prev7) on Mac OS 10.5.1 and getting the
following error:

rsync: writefd_unbuffered failed to write 887 bytes [sender]: Broken pipe
(32)
recv_xattr_request: internal abbrev error!
rsync: connection unexpectedly closed (26242 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(600)
[sender=3.0.0pre7]

Can someone explain what an internal abbrev error is?

The rsync is to an attached firewire disk using:
  rsync --acls --xattrs --fake-super -a -v -exclude EXCLUDE
--link-dest=LINKDIR  SRCDIR  DESTDIR

Thanks in advance.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Backslash in filename causes error

2008-01-05 Thread Chris G
rsync: recv_generator: failed to stat
"/freecom/backup/www/html/chris/info/computer/hardware/networkStorage/freecom/objects\5151.pdf":
 Invalid argument

The file exists OK.

-- 
Chris Green
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: error code 10 when using ::

2008-01-04 Thread Paul Slootman
On Fri 04 Jan 2008, Gav wrote:
> 
> $ rsync -rtlzv 123.456.789.000::websites /var/local/websites
> 
> after about 2 minutes I get :-
> 
> rsync: failed to connect to 123.456.789.000: Connection timed out (110)
> rsync error: error in socket IO (code 10) at clientserver.c(104)
> [receiver=2.6.9]
> 
> I can ping the server IP address no problem 100%

The "Connection timed out" means that the rsync port on the targat is
unreachable (if the problem was that there was nothing listening on the
rsync port, then you would get "Connection refused" pretty quickly).
As you can ping the IP, then this indicates that there is some firewall
along the route that is blocking the rsync port (873). Hence you need to
resolve the firewall problems.


Paul Slootman
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


RE: error code 10 when using ::

2008-01-04 Thread Gav....
Hi All, finally got round to trying this again

> -Original Message-
> From: Matt McCutchen [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, 2 January 2008 12:46 AM
> To: Gav
> Cc: rsync@lists.samba.org
> Subject: Re: error code 10 when using ::
> 
> On Tue, 2008-01-01 at 17:44 +0900, Gav wrote:
> > This works :
> >
> > sudo rsync -rtlzv --delete [EMAIL PROTECTED]:/var/virtual/web
> > /usr/local/websites
> >
> > This does not :
> >
> > sudo rsync -rtlzv --delete [EMAIL PROTECTED]::websites
> > /usr/local/websites
> >
> > I created a [websites] section in a new /etc/rsyncd.conf file then
> restarted
> > xinetd.

...

> In addition to creating /etc/rsyncd.conf , you may need to add the rsync
> daemon as an xinetd service.  If you still can't get the daemon to work,
> please post the exact error message and your /etc/rsyncd.conf and xinetd
> configuration files so we can figure out what's wrong.

My xinetd.d/rsync file says :-

service rsync 
{
disable = no
socket_type = stream
wait = no
user = root
server = /usr/bin/rsync
server_args = --daemon
log_on_failure += USERID
}

My /etc/rsyncd.conf file says :-

[websites]
path = /path/to/websites
comment = Customer Websites

Client Connect details

$ rsync -rtlzv 123.456.789.000::websites /var/local/websites

after about 2 minutes I get :-

rsync: failed to connect to 123.456.789.000: Connection timed out (110)
rsync error: error in socket IO (code 10) at clientserver.c(104)
[receiver=2.6.9]

I can ping the server IP address no problem 100%

rsync --version reveals 2.6.3 on server

I haven't created a /var/log/rsync[d].log file so where else would I find
any logged errors from the server (if you need any).

Thanks for any help.

Gav...

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


RE: error code 10 when using ::

2008-01-02 Thread Gav....
Thanks everyone for your hints, I'll try and fix it later on.

The need for secure connection as pointed out is not really necessary as
they are public websites, the fact that I currently 'need' to enter root
passwords is the main concern. So going the route of SSH is the one if I
continue to need to use passwords, having an authorized_keys file (which I
have) should enable me to make it a automated process. However I think all
that is needed is to get ..

rsync -rtlzv --delete 123.456.789.000::websites /usr/local/websites

.. working without any passwords required would be ideal. I can then
restrict rsync to my ip address instead. Does the ip address restriction
work well ? will it stop the ordinary user from syncing my sites?. If
someone wants to hop on my connection and sniff the files being synced that
is not a worry if I am not needing to use passwords either end.

So, the next step is to ensure the daemon is running. The default rsync port
is listening I already checked that, I will check everything else later
today. Any other thoughts on my intentions, right, wrong ?

Thanks

Gav...

> -Original Message-
> From: Matt McCutchen [mailto:[EMAIL PROTECTED]
> Sent: Wednesday, 2 January 2008 12:46 AM
> To: Gav
> Cc: rsync@lists.samba.org
> Subject: Re: error code 10 when using ::
> 
> On Tue, 2008-01-01 at 17:44 +0900, Gav wrote:
> > This works :
> >
> > sudo rsync -rtlzv --delete [EMAIL PROTECTED]:/var/virtual/web
> > /usr/local/websites
> >
> > This does not :
> >
> > sudo rsync -rtlzv --delete [EMAIL PROTECTED]::websites
> > /usr/local/websites
> >
> > I created a [websites] section in a new /etc/rsyncd.conf file then
> restarted
> > xinetd.
> >
> > 3 questions if I can.
> >
> > 1. Why does the second one not work -- I get connecion timed out and
> error
> > in socket IO (code 10) for the second one, whereas the first one works.
> 
> In addition to creating /etc/rsyncd.conf , you may need to add the rsync
> daemon as an xinetd service.  If you still can't get the daemon to work,
> please post the exact error message and your /etc/rsyncd.conf and xinetd
> configuration files so we can figure out what's wrong.
> 
> > 2. Even the one that works requires me to enter my local root password
> and
> > then the remote root password. Is this secure enough?
> 
> You'll have to decide that for yourself.  SSH does encrypt the remote
> root password before sending it over the network.
> 
> > 3. To automate the process I need to remove the need for passwords, but
> I do
> > not want to create another account on the remote server as it is a web
> > server housing many clients sites. The above connections wont work
> without
> > me using [EMAIL PROTECTED] I suppose I should connect using SSH, is there 
> > an idiot
> > proof guide somewhere I can look at?
> 
> Try this:
> 
> http://troy.jdmz.net/rsync/index.html
> 
> Matt
> 
> 
> 
> --
> Internal Virus Database is out-of-date.
> Checked by AVG Free Edition.
> Version: 7.5.516 / Virus Database: 269.17.9 - Release Date: 12/25/2007
> 12:00 AM
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Daemon connection security [Re: error code 10 when using ::]

2008-01-01 Thread Matt McCutchen
On Wed, 2008-01-02 at 03:20 +0100, Olivier Thauvin wrote:
> IIRC, rsync protocol do not transfert password in clear text, but use a 
> challenge method to perform the password verification.
> 
> This mean either with rsync or ssh, the authentication is "secure". But 
> saying 
> both are secure is not enough, it depend the security level you want.
> 
> When you use ssh, all data are completely encrypted, you can use either ssh 
> key or password authentication.
> When you use rsync daemon, transfert are faster (no encryption eating CPU), 
> but anyone being on the network can snif traffic, then getting data.

To elaborate: Rsync daemon connections do not even have integrity
checking, so an attacker who controls the network could watch the
authentication happen and then take over the connection and perform his
own transfer.  Rsync daemon authentication assumes that clients can make
uninterceptible connections to the daemon; it simply provides a way to
restrict module access to a subset of those clients.  All the
challenge-response does is avoid the compromise of daemon passwords,
e.g., when an unredacted transcript of a connection is attached to a bug
report.

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: error code 10 when using ::

2008-01-01 Thread Olivier Thauvin
Le mardi 01 janvier 2008, Matt McCutchen a écrit :
> > 2. Even the one that works requires me to enter my local root password
> > and then the remote root password. Is this secure enough?
>
> You'll have to decide that for yourself.  SSH does encrypt the remote
> root password before sending it over the network.

IIRC, rsync protocol do not transfert password in clear text, but use a 
challenge method to perform the password verification.

This mean either with rsync or ssh, the authentication is "secure". But saying 
both are secure is not enough, it depend the security level you want.

When you use ssh, all data are completely encrypted, you can use either ssh 
key or password authentication.
When you use rsync daemon, transfert are faster (no encryption eating CPU), 
but anyone being on the network can snif traffic, then getting data.

So this choice depend  on what you need to protect (authentication only or 
also transferred data). For a www tree, we can assume all data will become 
public, and so hidding it is useless.

My 2cts.


signature.asc
Description: This is a digitally signed message part.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: error code 10 when using ::

2008-01-01 Thread Matt McCutchen
On Tue, 2008-01-01 at 17:44 +0900, Gav wrote:
> This works :
> 
> sudo rsync -rtlzv --delete [EMAIL PROTECTED]:/var/virtual/web
> /usr/local/websites
> 
> This does not :
> 
> sudo rsync -rtlzv --delete [EMAIL PROTECTED]::websites
> /usr/local/websites
> 
> I created a [websites] section in a new /etc/rsyncd.conf file then restarted
> xinetd.
> 
> 3 questions if I can.
> 
> 1. Why does the second one not work -- I get connecion timed out and error
> in socket IO (code 10) for the second one, whereas the first one works.

In addition to creating /etc/rsyncd.conf , you may need to add the rsync
daemon as an xinetd service.  If you still can't get the daemon to work,
please post the exact error message and your /etc/rsyncd.conf and xinetd
configuration files so we can figure out what's wrong.

> 2. Even the one that works requires me to enter my local root password and
> then the remote root password. Is this secure enough?

You'll have to decide that for yourself.  SSH does encrypt the remote
root password before sending it over the network.

> 3. To automate the process I need to remove the need for passwords, but I do
> not want to create another account on the remote server as it is a web
> server housing many clients sites. The above connections wont work without
> me using [EMAIL PROTECTED] I suppose I should connect using SSH, is there an 
> idiot
> proof guide somewhere I can look at?

Try this:

http://troy.jdmz.net/rsync/index.html

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


error code 10 when using ::

2008-01-01 Thread Gav....
Hi All,

This works :

sudo rsync -rtlzv --delete [EMAIL PROTECTED]:/var/virtual/web
/usr/local/websites

This does not :

sudo rsync -rtlzv --delete [EMAIL PROTECTED]::websites
/usr/local/websites

I created a [websites] section in a new /etc/rsyncd.conf file then restarted
xinetd.

3 questions if I can.

1. Why does the second one not work -- I get connecion timed out and error
in socket IO (code 10) for the second one, whereas the first one works.

2. Even the one that works requires me to enter my local root password and
then the remote root password. Is this secure enough?

3. To automate the process I need to remove the need for passwords, but I do
not want to create another account on the remote server as it is a web
server housing many clients sites. The above connections wont work without
me using [EMAIL PROTECTED] I suppose I should connect using SSH, is there an 
idiot
proof guide somewhere I can look at?

Thanks

Gav...
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error

2007-12-18 Thread Madhavan Chari
Hi,

I am doing a delta transmission through rsync from a SOURCE to TARGET
with same folder  name.

My config files looks as below:

HOSTTOBACKUP1=ctlrws002
SOURCE1=/opt/mscdr/
TARGET1=/opt/mscdr/


I am getting a error while running the cron job for the above config
and sh file as below

Error starts here:

write failed on IBMIHS/logs/access.log : Error 0

Received signal 30. (no core)
rsync: writefd_unbuffered failed to write 4092 bytes: phase "unknown":
Broken pipe
rsync error: error in rsync protocol data stream (code 12) at io.c(515)
Error ends here.

The IBMIHS is under /opt/mscdr folder in SOURCE. Please let me know as
what could be wrong in this case. How can the access.log be copied to
TARGET as well.

Thanks in advance.
Regards,
Madhavan Chari
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-12-15 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||FIXED




--- Comment #5 from [EMAIL PROTECTED]  2007-12-15 10:26 CST ---
Data suggests that this was a bug that was already fixed.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: error in rsync protocol data stream

2007-12-04 Thread Richard Jones

Richard Jones wrote:
Help. This one's defeated me so far. I'm tring to push files from from a 
local Ubuntu 6.06 server to a remote Ubuntu 6.06 server using rsync (v 
2.6.6 installed on both via apt-get). Every time I get the same eg:


Not much help so far :-( I've managed to isolate the problem somewhat, 
but am still baffled. I have 4 more-or-less identical setups which I 
have experimented with pushing files between. Two remote VPS servers can 
transfer files in either direction OK, and both can push files to my 
local server OK, but my local server cannot transfer files to either 
remote server. But it can transfer files to a local VMware server 
located on the same network.


From this I conclude there is something interfering with file transfers 
from my local network to the outside - a firewall perhaps? The rsync 
message can get across the divide, as it generates a remote response, 
but no files ever get transferred.


There is nothing obvious on the local server IP tables, but the router 
has some rules for port forwarding inbound port 22 to the local server. 
I don't see why it should prevent outbound rsync file transfer, since it 
doesn't block outbound mail, but is there something in the router config 
I should examine more closely?

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


error in rsync protocol data stream

2007-12-02 Thread Richard Jones
Help. This one's defeated me so far. I'm tring to push files from from a 
local Ubuntu 6.06 server to a remote Ubuntu 6.06 server using rsync (v 
2.6.6 installed on both via apt-get). Every time I get the same eg:


building file list ...
4 files to consider
./
Demo1.plt
  63459 100%7.32MB/s0:00:00  (1, 50.0% of 4)
Test.plt
   1280 100%  208.33kB/s0:00:00  (2, 75.0% of 4)
USA_wp.txt
  39032 100%2.66MB/s0:00:00  (3, 100.0% of 4)

.. very long pause ... then:
Read from remote host : Connection timed out
rsync: connection unexpectedly closed (84 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(434)

When there are new sub-directories involved, they get created OK on the 
remote server (proving we get a vaild connection), but no files get 
transfered. So I tried synch'ing just a single file, and found that a 
text file of a few kilobytes transferred OK, but once it reached a few 
tens of kilobytes, it no longer transferred and I got the behaviour above.


I did have denyhosts running, which caused problems by adding my IP 
address to hosts.deny, but I removed it and killed the process but it 
makes no difference.


There is a reference to this behaviour in the rsync FAQ (the transfer 
fails to finish), but I'm afraid I can't follow the information 
supplied. Presumably it *is* possible to rsync between 2 Ubuntu Dapper 
servers?

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-28 Thread Matt McCutchen
On Wed, 2007-11-28 at 02:29 -0800, Johan Huysmans wrote:
> I noticed it is working with the rysnc-3.0.0-pre5, or at least the protocol
> of it. Is it possible to use that protocol for the curren stable release.

No, the protocol is new in rsync-3.0.0* .

Matt

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-28 Thread Johan Huysmans

I noticed it is working with the rysnc-3.0.0-pre5, or at least the protocol
of it. Is it possible to use that protocol for the curren stable release.

Greetings Johan



Johan Huysmans wrote:
> 
> whoops forgot to mention the error i receive ;)
> 
> This message appears on the client side:
> rsync: writefd_unbuffered failed to write 4092 bytes [generator]: 
> Connection reset by peer (104)
> rsync error: error in rsync protocol data stream (code 12) at io.c(1122) 
> [generator=2.6.9]
> rsync error: received SIGUSR1 (code 19) at main.c(1182) [receiver=2.6.9]
> 
> Fabian Cenedese wrote:
>> At 11:57 15.11.2007 +0100, you wrote:
>>   
>>> Hi All,
>>>
>>> I have a problem when transferring files from a rsyncd.  This is my
>>> setup:
>>> 
>>
>> What is the error you get?
>>
>> bye  Fabi
>>
>>
>>   
> -- 
> To unsubscribe or change options:
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
> 
> 

-- 
View this message in context: 
http://www.nabble.com/rsync-error-when-sending-lot%27s-of-small-files-tf4811248.html#a13989618
Sent from the Samba - rsync mailing list archive at Nabble.com.

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-11-27 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108





--- Comment #4 from [EMAIL PROTECTED]  2007-11-27 09:18 CST ---
Trying with rsync 3.0.0pre5 built locally, I get:

hunter[32]$ rsync -aAH --delete . /tmp/gwk
rsync: ACLs are not supported on this client
rsync error: syntax or usage error (code 1) at main.c(1441) [client=3.0.0pre5]

So... I run w/o -A, and then it succeeds.

Now... if I run the Ubuntu version (2.6.9) w/o -A, then it _also_ succeeds. :-)

So in the end the segfault was just a funny way of telling me it did not
have ACL support?  Bah.  (I don't need ACL support.  I had simply copied
the invocation incantation somewhere else.)

Thanks for the help.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-11-27 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108





--- Comment #3 from [EMAIL PROTECTED]  2007-11-27 07:45 CST ---
To get the symbols: https://wiki.ubuntu.com/DebuggingProgramCrash .  I found
this by Googling "ubuntu debug info" and following a few links.

The "free" suggests that the crash you are seeing may actually be the same one
discussed in the thread I linked, which has been fixed in the development
version of rsync.  Please try again with the latest development version of
rsync.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-11-27 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108





--- Comment #2 from [EMAIL PROTECTED]  2007-11-27 02:06 CST ---
hunter[15]$ gdb rsync
GNU gdb 6.6-debian
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu"...
(no debugging symbols found)
Using host libthread_db library "/lib/libthread_db.so.1".
(gdb) set follow-fork-mode ask
Undefined item: "ask".
(gdb) set follow-fork-mode ask
Undefined item: "ask".
(gdb) catch fork
Catchpoint 1 (fork)
(gdb) r  -aAH --delete . /tmp/gwk
Starting program: /usr/bin/rsync -aAH --delete . /tmp/gwk
(no debugging symbols found)
(no debugging symbols found)
(no debugging symbols found)
(no debugging symbols found)
(no debugging symbols found)

Catchpoint 1 (forked process 8329), 0x2b808e33b3ab in fork () from
/lib/libc.so.6
(gdb) set follow-fork-mode child
(gdb) c
Continuing.
(no debugging symbols found)
(no debugging symbols found)
(no debugging symbols found)
(no debugging symbols found)
[Switching to process 8329]

Catchpoint 1 (forked process 8334), 0x2b808e33b3ab in fork () from
/lib/libc.so.6
(gdb) set follow-fork-mode parent
(gdb) c
Continuing.

Program received signal SIGSEGV, Segmentation fault.
0x2b808e3166ab in free () from /lib/libc.so.6
(gdb) where
#0  0x2b808e3166ab in free () from /lib/libc.so.6
#1  0x00424d51 in ?? ()
#2  0x00425225 in ?? ()
#3  0x0041fe98 in ?? ()
#4  0x00404da6 in ?? ()
#5  0x0041f638 in ?? ()
#6  0x00407ce5 in ?? ()
#7  0x004107fd in ?? ()
#8  0x00410f59 in ?? ()
#9  0x00411fc5 in ?? ()
#10 0x00426f45 in ?? ()
#11 0x004118d3 in ?? ()
#12 0x2b808e2beb44 in __libc_start_main () from /lib/libc.so.6
#13 0x00403bc9 in ?? ()
#14 0x7fff1ce323c8 in ?? ()
#15 0x in ?? ()
(gdb) 

It appears there are no symbols.  Where can I get a version of rsync
that contains symbols?  I'm running Ubuntu 7.10.  All I could find at the
rsync site was RPMs.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-11-26 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108





--- Comment #1 from [EMAIL PROTECTED]  2007-11-26 21:29 CST ---
Please run rsync under gdb to obtain a backtrace for where the crash occurs. 
If your copy of rsync doesn't have debug info, obtain one that does or install
the debug info.  The following thread has some tips about how to isolate the
rsync process that is causing the problem from among the three:

http://lists.samba.org/archive/rsync/2007-August/018206.html

> Note I was unable to run the rsync deamon in debugging mode as described
> on your web page.  Every attempt to start the daemon would immediately exit
> with RC=1, no error message.

That's because you aren't using an rsync daemon.  Just run your original rsync
command under gdb or "strace -f".


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5108] New: --delete causes: segfault at 00000000fffffff9 rip 00002af8229bb6ab rsp 00007fff88788830 error 4

2007-11-26 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5108

   Summary: --delete causes: segfault at fff9 rip
2af8229bb6ab rsp 7fff88788830 error 4
   Product: rsync
   Version: 2.6.9
  Platform: x64
OS/Version: Linux
Status: NEW
  Severity: normal
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


hunter[111]$ rsync -aAH --delete . /tmp/gwk
rsync: connection unexpectedly closed (2430 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(454)
[sender=2.6.9]
hunter[112]$ dmesg | tail -1
[ 9674.001620] rsync[9223]: segfault at fff9 rip 2ad4686596ab
rsp 7fff42aeab90 error 4

hunter[113]$ uname -a
Linux hunter.localhost 2.6.22-14-generic #1 SMP Sun Oct 14 21:45:15 GMT 2007
x86_64 GNU/Linux

Note I was unable to run the rsync deamon in debugging mode as described
on your web page.  Every attempt to start the daemon would immediately exit
with RC=1, no error message.

I was also unable to turn on core dumps.  ulimit -c unlimited had no effect.

If I use --delete-during or --delete-after, the problem does not seem to
occur.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5075] Syncing with --iconv may yield protocol error

2007-11-22 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5075


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|NEW |RESOLVED
 Resolution||FIXED




--- Comment #3 from [EMAIL PROTECTED]  2007-11-22 10:09 CST ---
Thank you very much for the problem report and the patch.  Both problems are
now fixed in the git version.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Special Characters in Filenames -> rsync error code 24, files vanished

2007-11-16 Thread Benjamin Neef

Hello,

there are problems syncing files with special charcters in the filename.
The special characters in the filename are displayed as a question mark.
During synchronization, the rsync tells the file is vanished.
Here is the standard output with level 1 verbosity. Higher verbosity
levels dont give more informations about the problem. The stat command
with this file succeed.

file has vanished: "/backupmnt/neef/backup2/Sch?newolf.JPG"

sent 60557 bytes  received 64 bytes  121242.00 bytes/sec
total size is 188702060  speedup is 3112.82
rsync warning: some files vanished before they could be transferred
(code 24) at main.c(977) [sender=2.6.9]

Is rsync able to handle files with special characters in filename?

Help would be appreciated,

thanks in advance, Benjamin Neef.

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error?

2007-11-16 Thread Morgan Read
On Thu, 2007-11-15 at 19:37 +0100, Wesley W. Terpstra wrote:
> On Nov 15, 2007, at 10:55 AM, Morgan Read wrote:
> > Can anyone help me with the following error - is it serious; is the  
> > file
> > transferred; are the other files transferred?
> 
> The file is transferred as are the other files.
> However, rsync probably gives a non-zero exit status.
> 
> > lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ 
> > ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")  
> > failed: Permission denied (13)
> 
> The things that failed to copy are meta-data used by beagle (the  
> gnome desktop search tool). This meta-data is expendable. Don't worry.
> 
> As a point of interest; what version of rsync is this, and was the  
> file read-only?
Thanks Wesley

Yes, it was read only file - but, only one of many in that particular
directory.

Version of rsync:
[EMAIL PROTECTED] ~]$ rpm -q rsync
rsync-2.6.9-3.fc7

Regards,
M.
-- 
Getting errors: "There are problems with the signature" (or similar)?
Update your system by installing certificates from CAcert Inc, see here:
http://wiki.cacert.org/wiki/BrowserClients?#head-259758ec5ba51c5205cfb179cf60e0b54d9e378b
Or, if Internet Explorer is your default browser, simply click this link:
http://www.cacert.org/index.php?id=17

Morgan Read
NEW ZEALAND
<mailto:mstuffATreadDOTorgDOTnz>

fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
   http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
   http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF


smime.p7s
Description: S/MIME cryptographic signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error?

2007-11-16 Thread Morgan Read
On Thu, 2007-11-15 at 11:31 +0100, Daniel Maher wrote:
> On Thu, 2007-11-15 at 22:55 +1300, Morgan Read wrote:
> 
> > [EMAIL PROTECTED] ~]$ rsync -a -X -A -z -v /home/morgan/Documents
> > 192.168.1.30:/home/morgan/Documents
> > [EMAIL PROTECTED]'s password: 
> > building file list ... done
> > rsync: rsync_xal_set:
> > lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")
> >  failed: Permission denied (13)
> > rsync: rsync_xal_set:
> 
> Though i'm relatively new to rsync, i've been mired in ACL and xattrs
> hell for a while now, and have seen this behaviour before. :P
> 
> Can user "morgan" set ACLs on the filesystem of the receiving machine?
> If so, can user "morgan" set ACLs to the exactly the same state as the
> sending machine?  If the answer to either of these is "no", then you're
> going to run into problems like the one you've described.
Don't know but suspect "no" is the answer to both Qs: destination system
is my old laptop running fc5 that I'm begining to use as a mirror, with
a file system that pre-dates fc5 (perhaps 4 or 3).  Not sure ACLs were
up and running on it.  Once everything is sorted I"ll be updating it.

Regards,
M.
-- 
Getting errors: "There are problems with the signature" (or similar)?
Update your system by installing certificates from CAcert Inc, see here:
http://wiki.cacert.org/wiki/BrowserClients?#head-259758ec5ba51c5205cfb179cf60e0b54d9e378b
Or, if Internet Explorer is your default browser, simply click this
link:
http://www.cacert.org/index.php?id=17

Morgan Read
NEW ZEALAND


fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
   http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
   http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF


smime.p7s
Description: S/MIME cryptographic signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error?

2007-11-15 Thread Morgan Read
On Thu, 2007-11-15 at 11:31 +0100, Daniel Maher wrote:
> On Thu, 2007-11-15 at 22:55 +1300, Morgan Read wrote:
> 
> > [EMAIL PROTECTED] ~]$ rsync -a -X -A -z -v /home/morgan/Documents
> > 192.168.1.30:/home/morgan/Documents
> > [EMAIL PROTECTED]'s password: 
> > building file list ... done
> > rsync: rsync_xal_set:
> > lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")
> >  failed: Permission denied (13)
> > rsync: rsync_xal_set:
...

> Can user "morgan" set ACLs on the filesystem of the receiving machine?
> If so, can user "morgan" set ACLs to the exactly the same state as the
> sending machine?  If the answer to either of these is "no", then you're
> going to run into problems like the one you've described.
Don't know but suspect "no" is the answer to both Qs: destination system
is my old laptop running fc5 that I'm begining to use as a mirror, with
a file system that pre-dates fc5 (perhaps 4 or 3).  Not sure ACLs were
up and running on it.  Once everything is sorted I"ll be updating it.

Regards,
M.

-- 
Getting errors: "There are problems with the signature" (or similar)?
Update your system by installing certificates from CAcert Inc, see here:
http://wiki.cacert.org/wiki/BrowserClients?#head-259758ec5ba51c5205cfb179cf60e0b54d9e378b
Or, if Internet Explorer is your default browser, simply click this link:
http://www.cacert.org/index.php?id=17

Morgan Read
NEW ZEALAND


fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
   http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
   http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF


smime.p7s
Description: S/MIME cryptographic signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error?

2007-11-15 Thread Morgan Read
On Thu, 2007-11-15 at 19:37 +0100, Wesley W. Terpstra wrote:
> On Nov 15, 2007, at 10:55 AM, Morgan Read wrote:
> > Can anyone help me with the following error - is it serious; is the  
> > file
> > transferred; are the other files transferred?
> 
> The file is transferred as are the other files.
> However, rsync probably gives a non-zero exit status.
> 
> > lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ 
> > ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")  
> > failed: Permission denied (13)
> 
> The things that failed to copy are meta-data used by beagle (the  
> gnome desktop search tool). This meta-data is expendable. Don't worry.
> 
> As a point of interest; what version of rsync is this, and was the  
> file read-only?
Thanks Wesley

Yes, it was read only file - but, only one of many in that particular
directory.

Version of rsync:
[EMAIL PROTECTED] ~]$ rpm -q rsync
rsync-2.6.9-3.fc7

Regards,
M.
-- 
Getting errors: "There are problems with the signature" (or similar)?
Update your system by installing certificates from CAcert Inc, see here:
http://wiki.cacert.org/wiki/BrowserClients?#head-259758ec5ba51c5205cfb179cf60e0b54d9e378b
Or, if Internet Explorer is your default browser, simply click this link:
http://www.cacert.org/index.php?id=17

Morgan Read
NEW ZEALAND
<mailto:mstuffATreadDOTorgDOTnz>

fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
   http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
   http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF


smime.p7s
Description: S/MIME cryptographic signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error?

2007-11-15 Thread Wesley W. Terpstra

On Nov 15, 2007, at 10:55 AM, Morgan Read wrote:
Can anyone help me with the following error - is it serious; is the  
file

transferred; are the other files transferred?


The file is transferred as are the other files.
However, rsync probably gives a non-zero exit status.

lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ 
ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")  
failed: Permission denied (13)


The things that failed to copy are meta-data used by beagle (the  
gnome desktop search tool). This meta-data is expendable. Don't worry.


As a point of interest; what version of rsync is this, and was the  
file read-only?


--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error?

2007-11-15 Thread Morgan Read
Hi Folks

Can anyone help me with the following error - is it serious; is the file
transferred; are the other files transferred?

[EMAIL PROTECTED] ~]$ rsync -a -X -A -z -v /home/morgan/Documents
192.168.1.30:/home/morgan/Documents
[EMAIL PROTECTED]'s password: 
building file list ... done
rsync: rsync_xal_set:
lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")
 failed: Permission denied (13)
rsync: rsync_xal_set:
lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.Fingerprint")
 failed: Permission denied (13)
rsync: rsync_xal_set:
lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.MTime")
 failed: Permission denied (13)
rsync: rsync_xal_set:
lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.Uid")
 failed: Permission denied (13)

sent 1572135 bytes  received 20 bytes  89837.43 bytes/sec
total size is 2063655599  speedup is 1312.63
rsync error: some files could not be transferred (code 23) at
main.c(977) [sender=2.6.9]
[EMAIL PROTECTED] ~]$ 


Thanks,
M.
-- 
Getting errors: "There are problems with the signature" (or similar)?
Update your system by installing certificates from CAcert Inc, see here:
http://wiki.cacert.org/wiki/BrowserClients?#head-259758ec5ba51c5205cfb179cf60e0b54d9e378b
Or, if Internet Explorer is your default browser, simply click this link:
http://www.cacert.org/index.php?id=17

Morgan Read
NEW ZEALAND
<mailto:mstuffATreadDOTorgDOTnz>

fedora: Freedom Forever!
http://fedoraproject.org/wiki/Overview

"By choosing not to ship any proprietary or binary drivers, Fedora does
differ from other distributions. ..."
Quote: Max Spevik
   http://interviews.slashdot.org/article.pl?sid=06/08/17/177220

RMS on fedora:
   http://fedoraproject.org/wiki/FreeSoftwareAnalysis/FSF


smime.p7s
Description: S/MIME cryptographic signature
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: rsync error when sending lot's of small files

2007-11-15 Thread Johan Huysmans

whoops forgot to mention the error i receive ;)

This message appears on the client side:
rsync: writefd_unbuffered failed to write 4092 bytes [generator]: 
Connection reset by peer (104)
rsync error: error in rsync protocol data stream (code 12) at io.c(1122) 
[generator=2.6.9]

rsync error: received SIGUSR1 (code 19) at main.c(1182) [receiver=2.6.9]

Fabian Cenedese wrote:

At 11:57 15.11.2007 +0100, you wrote:
  

Hi All,

I have a problem when transferring files from a rsyncd.  This is my setup:



What is the error you get?

bye  Fabi


  

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error when sending lot's of small files

2007-11-15 Thread Fabian Cenedese
At 11:57 15.11.2007 +0100, you wrote:
>Hi All,
>
>I have a problem when transferring files from a rsyncd.  This is my setup:

What is the error you get?

bye  Fabi


-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: rsync error?

2007-11-15 Thread Daniel Maher

On Thu, 2007-11-15 at 22:55 +1300, Morgan Read wrote:

> [EMAIL PROTECTED] ~]$ rsync -a -X -A -z -v /home/morgan/Documents
> 192.168.1.30:/home/morgan/Documents
> [EMAIL PROTECTED]'s password: 
> building file list ... done
> rsync: rsync_xal_set:
> lsetxattr("Documents/Projects/CBT/SH20/HearingSubmission/ManukauBridgeSubCBT_PostPatrick_3_2.doc","user.Beagle.AttrTime")
>  failed: Permission denied (13)
> rsync: rsync_xal_set:

Though i'm relatively new to rsync, i've been mired in ACL and xattrs
hell for a while now, and have seen this behaviour before. :P

Can user "morgan" set ACLs on the filesystem of the receiving machine?
If so, can user "morgan" set ACLs to the exactly the same state as the
sending machine?  If the answer to either of these is "no", then you're
going to run into problems like the one you've described.


--
dan.

-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync error when sending lot's of small files

2007-11-15 Thread Johan Huysmans

Hi All,

I have a problem when transferring files from a rsyncd.  This is my setup:
* server: runs rsyncd on port 873.
* firewall: forwarding for the 873 port from outside (using SNAT and DNAT).
* client: manually running rsync command using modules.

The problem occurs when lots of small identical files are being send.
Small is smaller than 400 bytes.

It also only occurs when the NATting happens, running it locally give no 
problems.


Also when i use the --sockopts=SO_SNDBUF=xxx argument on the rsyncd it 
won't occur, but i noticed that the transfer is generally slower. (I 
also have normal sizes files available)


I hope someone call help me or point me to the right direction.

Greetings Johan Huysmans
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


better rsync error code when no space?

2007-11-12 Thread Ming Zhang
Hi All

I ran into this situation when rsync some files to remote side and
remote file system run out of space.

rsync: writefd_unbuffered failed to write 4 bytes [sender]: Connection
reset by peer (104)
rsync: write failed on "/IMG_5106.JPG" (in dest): No space left on
device (28)

 no space was detected and reported.


rsync error: error in file IO (code 11) at receiver.c(298)
[receiver=3.0.0pre5]
rsync: connection unexpectedly closed (27 bytes received so far)
[sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(601)
[sender=3.0.0pre5]
_exit_cleanup(code=12, file=io.c, line=601): about to call exit(12)


looks like error code 12 is caused by first error, 104.

shall rsync report ENOSPC for this? so it can be much easier to trace
and find out the error.

thanks!

-- 
Ming Zhang


@#$%^ purging memory... (*!%
http://blackmagic02881.wordpress.com/
http://www.linkedin.com/in/blackmagic02881


-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5075] Syncing with --iconv may yield protocol error

2007-11-11 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5075





--- Comment #2 from [EMAIL PROTECTED]  2007-11-12 00:17 CST ---
Sorry, I meant to add this too:

There is also an uninitialized variable in readfd_buffered that can cause
garbage to be read independently of the bug in mplex_write.  Under case
MSG_DELETED, inbuf.pos is never initialized which can -- and will -- cause the
call to iconvbufs further down to process random data.

The fix is to initialize inbuf with a proper call to INIT_XBUF before
proceeding to do the conversion.

Diff below and attached.

--- 510,515 
***
*** 1060,1066 
int pos = 0;

INIT_CONST_XBUF(outbuf, line);
!   inbuf.buf = ibuf;

while (msg_bytes) {
inbuf.len = msg_bytes > sizeof ibuf
--- 1069,1075 
int pos = 0;

INIT_CONST_XBUF(outbuf, line);
!   INIT_XBUF(inbuf, ibuf, 0, -1);

while (msg_bytes) {
inbuf.len = msg_bytes > sizeof ibuf


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5075] Syncing with --iconv may yield protocol error

2007-11-11 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5075





--- Comment #1 from [EMAIL PROTECTED]  2007-11-12 00:14 CST ---
Created an attachment (id=2963)
 --> (https://bugzilla.samba.org/attachment.cgi?id=2963&action=view)
Diffs to fix bug


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5075] New: Syncing with --iconv may yield protocol error

2007-11-11 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5075

   Summary: Syncing with --iconv may yield protocol error
   Product: rsync
   Version: 3.0.0
  Platform: All
OS/Version: All
Status: NEW
  Severity: major
  Priority: P3
 Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
 QAContact: [EMAIL PROTECTED]


If you use --iconv to sync between two machines and a file with a name that
needs conversion is to be deleted, the rsync protocol may get out of sync and
yield a protocol error if the converted filename differs in length form the
unconverted name.  This is because mplex_write in io.c will record and send the
message length *before* the message has been converted using iconvbuf.  If the
converted message differs in length, the reading rsync process will get
confused and interpret part of the message data as tag & length.

Here is an example:

[21:45:27]lenux:~/Mirror$ rsync -a --progress --del -n --iconv=utf-8,utf-8-mac
Lennart/Auto/ sva:Mirror/Lennart/Auto/
sending incremental file list
Audi Cabrio 92 (CUB931)/D\#303\#244ck/
deleting Audi Cabrio 92 (CUB931)/D\#303\#244ck/www.stro.nu.url.URL\#001
unexpected tag -7 [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(1135)
[sender=3.0.0pre5]

(Note the garbage #\001 at the end of the filename.)

To fix this, mplex_write needs to convert the message data before sending its
length.  Here is a possible rewrite:

/* Write an message to a multiplexed stream. If this fails, rsync exits. */
static void mplex_write(int fd, enum msgcode code, const char *buf, size_t len,
int convert)
{
char buffer[BIGPATHBUFLEN]; /* Oversized for use by iconv code. */
size_t n = len;

#ifdef ICONV_OPTION
if (convert && ic_send == (iconv_t)-1)
#endif
convert = 0;

#ifdef ICONV_OPTION
/* We need to convert buf before doing anything else so that we
 * can include the (converted) byte length in the message header.
 */
if (convert) {
xbuf outbuf, inbuf;

INIT_XBUF(outbuf, buffer + 4, 0, sizeof(buffer) - 4);
INIT_XBUF(inbuf, (char*)buf, len, -1);

iconvbufs(ic_send, &inbuf, &outbuf,
  ICB_INCLUDE_BAD | ICB_INCLUDE_INCOMPLETE);

if (inbuf.len > 0) {
rprintf(FERROR, "conversion buffer overflow in
mplex_write; "
"either enlarge 'buffer' or rewrite
code to allocate "
"buffer dynamically");
}

n = len = outbuf.len;
} else
#endif
if (n > sizeof(buffer) - 4)
n = 0;
else
memcpy(buffer + 4, buf, n);

SIVAL(buffer, 0, ((MPLEX_BASE + (int)code)<<24) + len);


defer_forwarding_keep = 1; /* defer_forwarding_messages++ on return */
writefd_unbuffered(fd, buffer, n+4);
defer_forwarding_keep = 0;

len -= n;
buf += n;

if (len)
writefd_unbuffered(fd, buf, len);

if (!--defer_forwarding_messages && !no_flush)
msg_flush();
}

Context diff based on 3.0.0pre5 follows:

*** io.c~   Sat Nov  3 00:20:05 2007
--- io.cSun Nov 11 21:59:57 2007
***
*** 468,485 
char buffer[BIGPATHBUFLEN]; /* Oversized for use by iconv code. */
size_t n = len;

-   SIVAL(buffer, 0, ((MPLEX_BASE + (int)code)<<24) + len);
- 
  #ifdef ICONV_OPTION
if (convert && ic_send == (iconv_t)-1)
  #endif
convert = 0;

!   if (convert || n > 1024 - 4) /* BIGPATHBUFLEN can handle 1024 bytes */
n = 0;
else
memcpy(buffer + 4, buf, n);

defer_forwarding_keep = 1; /* defer_forwarding_messages++ on return */
writefd_unbuffered(fd, buffer, n+4);
defer_forwarding_keep = 0;
--- 468,508 
char buffer[BIGPATHBUFLEN]; /* Oversized for use by iconv code. */
size_t n = len;

  #ifdef ICONV_OPTION
if (convert && ic_send == (iconv_t)-1)
  #endif
convert = 0;

! #ifdef ICONV_OPTION
!   /* We need to convert buf before doing anything else so that we
!* can include the (converted) byte length in the message header.
!*/
!   if (convert) {
!   xbuf outbuf, inbuf;
! 
!   INIT_XBUF(outbuf, buffer + 4, 0, sizeof(buffer) - 4);
!   INIT_XBUF(inbuf, (char*)buf, len, -1);
! 
!   iconvbufs(ic_send, &inbuf, &outbuf,
! ICB_INCLUDE_BAD | ICB_INCLUDE_INCOMPLETE);
! 
!   if (inbuf.len > 0) {
!   rprintf(FERROR, "conversion buffe

Strange rsync error

2007-11-11 Thread Pournaris Charalampos

Hello,

Sometimes when I am using the command:
rsync -avR -e rsh "/raid/system/Images/./GHOST.BAT" 
192.168.192.2:/raid/system/Images/ --delete -z --progress 
--exclude-from=/usr/local/excludes --bwlimit=70


I get the following error:

rsync: mkdir "/raid/system/Images" failed: File exists (17)
rsync error: error in file IO (code 11) at main.c(529) [receiver=2.6.9]
rsync: connection unexpectedly closed (8 bytes received so far) [sender]
rsync error: error in rsync protocol data stream (code 12) at io.c(453) 
[sender=2.6.9]


Other times it just works fine. Any ideas what the above error means and 
why that happened?


Version: rsync  version 2.6.9  protocol version 29

Thanks for your time.

--
Charalampos Pournaris
[EMAIL PROTECTED]

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5064] compile error - SCO 5.0.6a

2007-11-08 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5064


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|ASSIGNED|RESOLVED
 Resolution||FIXED




--- Comment #2 from [EMAIL PROTECTED]  2007-11-08 09:54 CST ---
The compile works, if you're picky about warnings, I do still get:

gcc -I. -I. -g -O2 -DHAVE_CONFIG_H -Wall -W -I./popt  -c lib/getaddrinfo.c -o
lib/getaddrinfo.o
lib/getaddrinfo.c: In function `get_canon_name_from_addr':
lib/getaddrinfo.c:116: warning: passing arg 1 of `gethostbyaddr' from
incompatible pointer type

Thanks


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


DO NOT REPLY [Bug 5064] compile error - SCO 5.0.6a

2007-11-08 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=5064


[EMAIL PROTECTED] changed:

   What|Removed |Added

 Status|NEW |ASSIGNED




--- Comment #1 from [EMAIL PROTECTED]  2007-11-08 09:13 CST ---
The latest CVS version fixes all the errors I could discern from that failed
compilation.  Please add another comment if there are more problems.


-- 
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
-- 
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


<    1   2   3   4   5   6   7   8   9   10   >