[Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #27 from samba --- Still an issue on rsync-3.1.1-3 as found on Debian 8 -- You are receiving this mail because: You are the QA Contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 Wayne Davison changed: What|Removed |Added Status|NEW |RESOLVED Resolution||FIXED --- Comment #26 from Wayne Davison 2014-01-01 18:38:33 UTC --- I should note that the issue with deletions being skipped has been fixed (the file-has-vanished errors were changed into warnings). The script support/rsync-no-vanished that will be in the next release. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #25 from jakob...@gmail.com 2014-01-01 15:04:58 UTC --- What remains to be done is to make the the rsync-no-vanished script accessible to users. I created bug 10356 about including it in the tarball. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 Nick Hibma changed: What|Removed |Added CC||n...@anywi.com --- Comment #24 from Nick Hibma 2012-11-01 08:41:35 UTC --- Interesting to see how a simple request is actually a rather intricate little problem in the bigger scheme of things. I'm very interested to see how this is resolved (as I get back up warnings once in a while because of this). By the way: Suggesting that removing warnings from the error log is silly. Creating a script like this on more than 5 different machines gets old very quickly. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #23 from g...@delfi.ee 2011-02-11 09:41 CST --- i updated patch again as found similar pattern in code http://cvs.pld-linux.org/cgi-bin/cvsweb.cgi/packages/rsync/ignore-vanished.patch?rev=1.2 but seems the problem is reported on server side, not client side and it still does not work, because the --ignore-vanished apparently is not "transported" to rsync server, and response generated by rsync server would still include those vanished error messages. totally different approach must be taken perhaps. to me the rsync exit code ignoring is not a solution, because my problem looks like: i rsync large disk with Maildir files, rsync alone calculating filelist takes 1.5 hour, so when the sync finishes there are certainly some files moved around. and as for me the delete is also skipped, meaning backup space from old removed files is never released, meaning my backup grows and grows. what would the alternative fix here? file has VANISHED: "/Maildir/new/1297421485.M458439P3915VFE04I003EDB8D_0.localhost,S=8354" (in vmail), protocol=30, code=4 delfi.ee/ylle/Maildir/tmp/ IO error encountered -- skipping file deletion sent 7900103 bytes received 31665465290 bytes 1978039.99 bytes/sec total size is 281386128794 speedup is 8.88 rsync warning: some files vanished before they could be transferred (code 24) at main.c(1508) [generator=3.0.7] -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #22 from g...@delfi.ee 2011-01-25 13:55 CST --- Created an attachment (id=6228) --> (https://bugzilla.samba.org/attachment.cgi?id=6228&action=view) updated patch in #c1 against rsync-3.0.7 -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653
--- Comment #21 from m...@mattmccutchen.net 2010-11-21 21:12 CST ---
(In reply to comment #20)
> AFAICS, delete_in_dir() suppresses deletion when /any/ flag is set in
> io_error:
>
> if (io_error && !ignore_errors) {
Indeed, that is a bug. I entered bug 7809.
--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653
--- Comment #20 from jr-sambabugzi...@quo.to 2010-11-21 19:43 CST ---
(In reply to comment #19)
> You're right that the IOERR_GENERAL flag (which corresponds to that message)
> stops all destination files from being deleted. But it is only supposed be
> set
> when there is an error that might lead to the omission of existing source
> files
> from the file list. A run-of-the-mill vanished file should not set the flag.
AFAICS, delete_in_dir() suppresses deletion when /any/ flag is set in io_error:
if (io_error && !ignore_errors) {
--
Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email
--- You are receiving this mail because: ---
You are the QA contact for the bug, or are watching the QA contact.
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #19 from m...@mattmccutchen.net 2010-11-21 17:57 CST --- (In reply to comment #18) > What's also annoying is that a "vanished file" warning triggers: > > "IO error encountered -- skipping file deletion" > > which if I'm not mistaken stops *all* files from being deleted on the > receiving > end, not just the ones that have vanished. You're right that the IOERR_GENERAL flag (which corresponds to that message) stops all destination files from being deleted. But it is only supposed be set when there is an error that might lead to the omission of existing source files from the file list. A run-of-the-mill vanished file should not set the flag. If you have a reproducible case in which it does, please file a separate bug. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 jr-sambabugzi...@quo.to changed: What|Removed |Added CC||jr-sambabugzi...@quo.to --- Comment #18 from jr-sambabugzi...@quo.to 2010-11-20 12:47 CST --- +1 for --ignore-vanished. Filtering out the warnings when stdout and stderr are redirected to different places isn't so trivial. What's also annoying is that a "vanished file" warning triggers: "IO error encountered -- skipping file deletion" which if I'm not mistaken stops *all* files from being deleted on the receiving end, not just the ones that have vanished. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [Bug 3653] Reduce the need for the "vanished files" warning
> Doing nightly backups from cron is an *extremely* common use-case of rsync, > and > telling each and every user of rsync that they should either A) write their > own > shell script to filter and discard error messages, or B) play a constant game > of whack-a-mole chasing down new --exclude options to add, is just silly. It > pushes work downstream that could be done upstream much more efficiently. Why > make each user write the same code over and over when the developer could > write > it just once, and get it right? You may want to take a look at LBackup : http://www.lbackup.org Just one rsync based backup possibility. Note : The current version 0.9.8r5-alpha3 of LBackup, requires a wrapper script to be put around rsync if you want to ignore the vanished files warning. : http://www.lbackup.org/developer/ignore_vanished_file_warnings Any assistance to improve rsync / LBackup is warmly welcomed. Perhaps one option is a new option to suppress this file vanished warning is a possibility? I would be interested to have other peoples take on such an approach. - This email is protected by LBackup, an open source backup solution. http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 j...@jwz.org changed: What|Removed |Added CC||j...@jwz.org --- Comment #17 from j...@jwz.org 2010-10-01 11:27 CST --- "Me too." Doing nightly backups from cron is an *extremely* common use-case of rsync, and telling each and every user of rsync that they should either A) write their own shell script to filter and discard error messages, or B) play a constant game of whack-a-mole chasing down new --exclude options to add, is just silly. It pushes work downstream that could be done upstream much more efficiently. Why make each user write the same code over and over when the developer could write it just once, and get it right? Option A is bad because everyone gets to introduce differently-subtle bugs in their script (wrong error code? accidentally ignoring too many error messages? who knows. It's fragile.) Option B is bad because I don't *want* to have a bunch of --exclude options for my backup: disk and bandwidth are cheap, so I want my backup disk to be an exact mirror. That way, when the disk holding / dies, I can just drop the backup in and boot it, being confident that everything is exactly the same. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 r...@golder.org changed: What|Removed |Added CC||r...@golder.org --- Comment #16 from r...@golder.org 2009-05-18 07:59 CST --- This is a 'me too' for '--ignore-vanished-files' flag. Lots of legitimate cases where files could vanish, so having the option to treat this as normal (i.e. prevent rsync from producing this warning and ensure a zero exit value) should be simple enough, and would prevent lots of people (me included) from needing to use wrapper scripts, hacks and/or just give it to receiving the annoying cron messages it causes :) -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #15 from o...@yadan.net 2009-04-22 03:51 CST --- I ended up using the following script for snapback2 (which exits with the same error codes as rsync if rsync fails: # cat /etc/cron.daily/snapback2 #! /bin/sh OUT=`/usr/bin/snapback2 2>&1` RET=$? if [ "$RET" != "23" -a "$RET" != "0" -a "$RET" != 24 ]; then echo "$OUT" exit $RET fi this is a workaround, it would still be great to be able to tell rsync to ignore vanished files. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 --- Comment #14 from rv-rsyncbugzi...@eychenne.org 2009-04-22 03:39 CST --- I also find this warning annoying, I really vote for this patch. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
DO NOT REPLY [Bug 3653] Reduce the need for the "vanished files" warning
https://bugzilla.samba.org/show_bug.cgi?id=3653 [EMAIL PROTECTED] changed: What|Removed |Added CC||[EMAIL PROTECTED] --- Comment #13 from [EMAIL PROTECTED] 2008-07-14 16:24 CST --- Guys, I also find this warning annoying. I get a pretty much daily email about it from my backup 'failing'. /etc/cron.daily/snapback2: rsync warning: some files vanished before they could be transferred (code 24) at main.c(1515) [generator=3.0.2] I am not even sure which files are vanishing. I suspect the files are from a mail directory, where some spam messages are moved after rsync builds the files list. I vote for including the patch into rsync to make it more useful for this use case. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
