Re: Cannot Allocate Memory
On Tue, 7 Jun 2005, Max Kipness <[EMAIL PROTECTED]> wrote:
>
> I've just upgraded to 2.6.5.
>
> On a new set of servers I'm trying to sync I seem to be running into a log
> of memory allocation errors.
>
> With some of the servers, I start the rsync session, and it counts so many
> files and then stops. At that point I'm unable to control-c out of the
> process. From another session I can't issue a kill command either...very
> strange.
A control-C might not always work, but a kill -9 {PID} should. If it
doesn't, there may be some OS-related problem in your brand-new servers.
> On other servers, the first few files/directories issue a 'cannot allocate
> memory', but strangly enough, it continues on.
If that's an actual quote of the error message, it's not from rsync.
Rsync uses "ERROR: out of memory in {NameOfRoutine}", and then exits.
> Does this simply mean that the 256mb memory isn't sufficient? I am trying
> to sync a very large folder structure.
At an average of 100 bytes per file, you could do 1 million files in
100 MB, so unless you have a real whopper, 256 MB should be just fine
especially if you also have some swap space.
> Is there anyway around this using tmp disk space or something until I can
> get more memory?
Using swap should effectively use temp disk space.
What are your ulimit values? If you are running as root it shouldn't matter,
but small memory limits might trigger a problem.
But the overall symptoms imply a deeper problem, IMO.
John
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: restoring incremental backups
Rework the script using --link-dest= rather than --backup and --backup-dir. This way a directory for each day of the week will contain an exact (complete) snapshot from the corresponding day of the tree(s) you're backing up. Unchanged files share storage on the backup server via multiple hard links and restoration is quite straightforward. Quoting Erik Romijn <[EMAIL PROTECTED]>: > Hi, > > I'm using rsync to make incremental backups, which appears to work fine. > I use a script quite similar to the first one on > http://rsync.samba.org/examples.html (incremental 7 day to remote host). > However, I can't seem to find a nice way to restore a backup other than > the current backup. > > Assuming the following situation: > current - made today, contains up-to-date versions of all files > saturday - made yesterday, contains the old versions of every file > that was deleted/changed in current with the last backup run > friday - made 2 days ago, contains the old versions of every file that >that was deleted/changed compared to yesterday's current > > A bit complicated, but my problem is this: I want to restore the system > as it was on friday. > One way to do it is to restore current, overwrite it with saturday (and > delete all files that are in current but not in saturday) and then > overwrite it with friday (and delete ...). > However, this seems quite ugly to me. Isn't there a way to tell rsync: > restore the situation from friday, incrementals made after that are > saturday, current tree is current? I have been unable to find any > information about that. > Or would I have to build a wrapper myself? > > greets, > Erik Romijn > -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Updating Full Backups, w/ Differentials, on a Windows XP Machine
Hellois it possible to schedule a weekly full backup and then have that updated daily with changes, via a differential job, on/for a Windows machine? If so, what RSYNC-based command-line args would I need to use? Thanks in advance Steve -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2790] Add support for converting filenames into different encodings
https://bugzilla.samba.org/show_bug.cgi?id=2790 --- Additional Comments From [EMAIL PROTECTED] 2005-06-12 09:18 --- If this is indeed an artifact of the receiving OS, then I suggest an addition in the RSync FAQ to cover this issue. In particular, even though a Mac OS-X system may have large disks handy, it may not be an ideal OS to support periodic "backups" via rsync for European users or other users who may naturally use extended characters. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync 2.6.5 segfault using --fuzzy & --link-dest
On Sat, 11 Jun 2005 23:22:39 -0700 Wayne Davison <[EMAIL PROTECTED]> wrote: > OK, the crash turned out to be caused by an empty file-list not getting > its "high" value set correctly. If such an empty list gets passed to > flist_find(), it would crash. This is not something that normally > happens, but in the case where an empty destination directory is matched > up with a list-dest directory that has a file that is present but not > up-to-date, rsync triggers the bug. Attached is a patch to fix this. I seem to have a habit of doing stuff that doesn't 'normally happen'. :) > Thanks for your help! Rebuilt with this & the max verbosity patches, deployed, tested. Works like an absolute charm. Thanks for the quick turnaround on these fixes. Erik -- "I really want a license to do just two things: make the code available to others, and make sure that improvements stay that way. That's really it. Nothing more, nothing less. Everything else is fluff." -- Linus Torvalds -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
restoring incremental backups
Hi, I'm using rsync to make incremental backups, which appears to work fine. I use a script quite similar to the first one on http://rsync.samba.org/examples.html (incremental 7 day to remote host). However, I can't seem to find a nice way to restore a backup other than the current backup. Assuming the following situation: current - made today, contains up-to-date versions of all files saturday - made yesterday, contains the old versions of every file that was deleted/changed in current with the last backup run friday - made 2 days ago, contains the old versions of every file that that was deleted/changed compared to yesterday's current A bit complicated, but my problem is this: I want to restore the system as it was on friday. One way to do it is to restore current, overwrite it with saturday (and delete all files that are in current but not in saturday) and then overwrite it with friday (and delete ...). However, this seems quite ugly to me. Isn't there a way to tell rsync: restore the situation from friday, incrementals made after that are saturday, current tree is current? I have been unable to find any information about that. Or would I have to build a wrapper myself? greets, Erik Romijn signature.asc Description: OpenPGP digital signature -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2791] a long exclude-from list is not parsed correctly
https://bugzilla.samba.org/show_bug.cgi?id=2791 --- Additional Comments From [EMAIL PROTECTED] 2005-06-12 02:42 --- Created an attachment (id=1268) --> (https://bugzilla.samba.org/attachment.cgi?id=1268&action=view) file_list -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2791] a long exclude-from list is not parsed correctly
https://bugzilla.samba.org/show_bug.cgi?id=2791 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||INVALID --- Additional Comments From [EMAIL PROTECTED] 2005-06-12 02:52 --- false alarm rsync is perfect -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2791] New: a long exclude-from list is not parsed correctly
https://bugzilla.samba.org/show_bug.cgi?id=2791
Summary: a long exclude-from list is not parsed correctly
Product: rsync
Version: 2.6.5
Platform: All
OS/Version: OpenBSD
Status: NEW
Severity: normal
Priority: P3
Component: core
AssignedTo: [EMAIL PROTECTED]
ReportedBy: [EMAIL PROTECTED]
QAContact: [EMAIL PROTECTED]
I have an openbsd development system that is periodically updated and I'm trying
to create a smaller system in order to fit onto a compact flash used on a
soekris box. so I thought a
rsync --verbose --recursive --times --perms --owner --group --numeric-ids
--links --hard-links --devices --exclude-from ./file_list /
10.0.0.2:/var/tmp/openbsd37_full/
with a good file_list is just the right thing.
the problem is that if the file_list is large enough it will not be parsed
correctly by rsync. some of the files will not be transfered as they should.
if I split the file_list in more pieces and I run rsync for each of them I can
get the job done, but I guess you should know about the bug.
in my application the client was a rsync {2.6.0-2.6.5} running on openbsd 3.7
and the destination (10.0.0.2) was a gentoo linux machine with rsync 2.6.0 (but
I guess this ain't relevant).
--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2784] rsync gives following error: buffer overflow in receive_file_entry
https://bugzilla.samba.org/show_bug.cgi?id=2784 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |ASSIGNED --- Additional Comments From [EMAIL PROTECTED] 2005-06-12 00:13 --- This sounds like the bytes being transfer are being corrupted between the sender and the receiver, possibly because your remote-shell transport is not 8-bit clean. You can test this using the "savetransfer" program in the support dir of a modern rsync release. Just chdir into the support dir, type make, and then read the savetransfer.c file's opening comments for how to make a copy of the data that is being sent or received (one copy on the sender, and one on the receiver) and then diff it for errors. Your --rsh options are also strange: you're using a --port option that has no effect, for instance (because you'r using a remote shell to talk directly to a freshly-spawned daemon process over stdin/stdout). The specifying of rsync options is more appropriately done in the --rsync-path option rather than in the --rsh option. For instance, rsync is appending the --server --daemon options onto the rsync command, so the command you list is running this (this is a single command): ssh BCPSERVER rsync rsyncd --daemon --config=FILE --port=PORT BCPSERVER /PATH/rsync --server --daemon If you changed the --rsh option to be just "ssh" and changed the --rsync-path option to be "$RSYNCPATH --config=$RSYNCDCONFIGFILE", it would run something more like this: ssh BCPSERVER /PATH/rsync --config=FILE --server --daemon -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
