read errors mapping filename: Cannot allocate memory (12)

2010-01-11 Thread Matthias Adler 

I use rsync to copy files from various Windows servers to a backup server 
running linux (OpenSUSE 11.2, filesystem ext3). The files that are to be copied 
reside in CIFS shares which are mounted on the backup server.

This is the command I run:

rsync -rltv --out-format=./%n%L
   --delete --exclude-from=excludes.txt
   --link-dest=/backup/local/20100110/server1/backup$
   '/backup/server1/backup$/'
   '/backup/local/20100111/server1/backup$'

When copying a rather large file (34 GB) I get the following error:

rsync: read errors mapping filename: Cannot allocate memory (12)
WARNING: filename failed verification -- update discarded (will try again).
rsync: read errors mapping filename: Cannot allocate memory (12)
ERROR: filename failed verification -- update discarded.

It is the only file I have problems with.

I upgraded from rsync 2.6.4 to 3.0.6 and increased the memory on the machine 
from 1 GB to 1.5 GB, but the problem remains.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

RE: cygwin 1.7.x rsync 3.0.6 hangs at arbitrary reproducible points in transfers

2010-01-11 Thread Alan C. Bonnici 
Hi,

I am having the exact same problem on a Windows platform. I have been using
(prior versions of) rsync without any problems for a few years now.

Any help towards solving this problem greatly appreciated.

My logs are available upon request.

Regards,
Alan 

-Original Message-
From: Adam Rosi-Kessel [mailto:a...@rosi-kessel.org] 
Sent: 10 January 2010 02:30
To: rsync@lists.samba.org
Subject: cygwin 1.7.x rsync 3.0.6 hangs at arbitrary reproducible points in
transfers

Since upgrading to cygwin 1.7.x, I'm unable to complete rsync jobs to a 
Debian machine (running stable). cygwin rsync is 3.0.6; Debian is 3.0.3.

The transfer goes for a while and then just gets stuck halfway through 
an arbitrary file. If I cancel and restart, same thing (but gets a 
little further). If I manually copy the file in question, it will 
usually go a bit longer and then get stuck somewhere else.

I've seen a few postings on this list recently about similar issues, but 
no suggestions have worked. (In particular, some have suggested this is 
a problem with older cygwin/rsync, but it only started for me with 
cygwin 1.7.x).

I've posted cygcheck and strace output here:

http://adam.rosi-kessel.org/bugs/rsync/

Here are the last few lines of the strace in one example run. At the end 
is where it is just hung. This is from the cygwin side.

34 8512408 [main] rsync 5052 select_stuff::wait: woke up.  wait_ret 
1.  verifying
30 8512438 [main] rsync 5052 select_stuff::wait: gotone 1
26 8512464 [main] rsync 5052 select_stuff::wait: returning 0
28 8512492 [main] rsync 5052 select_stuff::cleanup: calling cleanup 
routines
27 8512519 [main] rsync 5052 socket_cleanup: si 0x773B38 si-thread 
0x6114E700
   163 8512682 [main] rsync 5052 socket_cleanup: returning
31 8512713 [main] rsync 5052 peek_socket: read_ready: 0, 
write_ready: 1, except_ready: 0
26 8512739 [main] rsync 5052 set_bits: me 0x773B08, testing fd 4 ()
29 8512768 [main] rsync 5052 set_bits: ready 1
26 8512794 [main] rsync 5052 select_stuff::poll: returning 1
26 8512820 [main] rsync 5052 select_stuff::cleanup: calling cleanup 
routines
27 8512847 [main] rsync 5052 select_stuff::~select_stuff: deleting 
select records
51 8512898 [main] rsync 5052 writev: writev (4, 0x228064, 1)
32 8512930 [main] rsync 5052 writev: 4 = write (4, 0x228064, 1), errno 0
30 8512960 [main] rsync 5052 cygwin_select: 5, 0x0, 0x2284D4, 
0x2284C4, 0x2284BC
53 8513013 [main] rsync 5052 dtable::select_write:  fd 4
27 8513040 [main] rsync 5052 dtable::select_except:  fd 4
28 8513068 [main] rsync 5052 cygwin_select: to-tv_sec 60, 
to-tv_usec 0, ms 6
27 8513095 [main] rsync 5052 cygwin_select: sel.always_ready 0
52 8513147 [main] rsync 5052 start_thread_socket: stuff_start 0x228020
69 8513216 [main] rsync 5052 select_stuff::wait: m 2, ms 6
29 8513245 [select_socket] rsync 5052 thread_socket: stuff_start 
0x228020
31 8513276 [select_socket] rsync 5052 peek_socket: read_ready: 0, 
write_ready: 1, except_ready: 0
30 8513306 [select_socket] rsync 5052 thread_socket: leaving 
thread_socket
98 8513404 [main] rsync 5052 select_stuff::wait: woke up.  wait_ret 
1.  verifying
25 8513429 [main] rsync 5052 select_stuff::wait: gotone 1
27 8513456 [main] rsync 5052 select_stuff::wait: returning 0
24 8513480 [main] rsync 5052 select_stuff::cleanup: calling cleanup 
routines
27 8513507 [main] rsync 5052 socket_cleanup: si 0x773B38 si-thread 
0x6114E700
69 8513576 [main] rsync 5052 socket_cleanup: returning
28 8513604 [main] rsync 5052 peek_socket: read_ready: 0, 
write_ready: 1, except_ready: 0
28 8513632 [main] rsync 5052 set_bits: me 0x773B08, testing fd 4 ()
26 8513658 [main] rsync 5052 set_bits: ready 1
26 8513684 [main] rsync 5052 select_stuff::poll: returning 1
27 8513711 [main] rsync 5052 select_stuff::cleanup: calling cleanup 
routines
26 8513737 [main] rsync 5052 select_stuff::~select_stuff: deleting 
select records
50 8513787 [main] rsync 5052 writev: writev (4, 0x228064, 1)

Any suggestions?

Adam


-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html