Rsync question
Title: Message Hi there - various web pages indicated that the emails on the To lines could be used for general questions so what the heck ... I'm having a problem getting a specific rsync option to work.. I am trying to copy a list of files via rsync - the man pages indicate the --files-from option should work but I cant seem to get this to work the syntax I'm using is rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ but I get an error that I cant seem to intrepet - nor find ANY examples of a proper files-from syntax ctltest02:/tmp rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ rsync version 2.6.2 protocol version 28Copyright (C) 1996-2004 by Andrew Tridgell and others.. Please see the rsync(1) and rsyncd.conf(5) man pages for full documentationSee http://rsync.samba.org/ for updates, bug reports, and answersrsync error: syntax or usage error (code 1) at options.c(730) Thanks in advance This e-mail message is intended only for the person(s) named above and may contain confidential or privileged information. If you are not the person named or have not been authorized by them, please notify the sender immediately and delete this e-mail and any attachments without reading, saving, or forwarding. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: Rsync question
Title: Message Hi - Nevermind - I got this to work... still need the source dir - thanks -Original Message-From: Dimond, Carol Sent: Thursday, June 30, 2005 12:07 AMTo: '[EMAIL PROTECTED]'; '[EMAIL PROTECTED]'Subject: Rsync question Hi there - various web pages indicated that the emails on the To lines could be used for general questions so what the heck ... I'm having a problem getting a specific rsync option to work.. I am trying to copy a list of files via rsync - the man pages indicate the --files-from option should work but I cant seem to get this to work the syntax I'm using is rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ but I get an error that I cant seem to intrepet - nor find ANY examples of a proper files-from syntax ctltest02:/tmp rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ rsync version 2.6.2 protocol version 28Copyright (C) 1996-2004 by Andrew Tridgell and others.. Please see the rsync(1) and rsyncd.conf(5) man pages for full documentationSee http://rsync.samba.org/ for updates, bug reports, and answersrsync error: syntax or usage error (code 1) at options.c(730) Thanks in advance This e-mail message is intended only for the person(s) named above and may contain confidential or privileged information. If you are not the person named or have not been authorized by them, please notify the sender immediately and delete this e-mail and any attachments without reading, saving, or forwarding. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync question
Hi, first of all excuse my bad english... you didn't let me answer you ... Well, i've been just working with rsync also, and want to use the --files-from option and write the same command. And my question is: wouldn't it be the correct behavior to provide just one file with the --files-from without writting a source dir? I mean, the content of the files-from file shows the sources which i want to rsync so, why do i have to provide anything else? It was just my point.. Thanks, and again excuse my english... Judith Dimond, Carol wrote: Hi - Nevermind - I got this to work... still need the source dir - thanks -Original Message- *From:* Dimond, Carol *Sent:* Thursday, June 30, 2005 12:07 AM *To:* '[EMAIL PROTECTED]'; '[EMAIL PROTECTED]' *Subject:* Rsync question Hi there - various web pages indicated that the emails on the To lines could be used for general questions so what the heck ... I'm having a problem getting a specific rsync option to work.. I am trying to copy a list of files via rsync - the man pages indicate the --files-from option should work but I cant seem to get this to work the syntax I'm using is rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ but I get an error that I cant seem to intrepet - nor find ANY examples of a proper files-from syntax /ctltest02:/tmp rsync -vpgut --stats --bwlimit=5 --no-relative --files-from=/tmp/DBA_TST.RSYNC_LST /work/dba_arch/DBA_TST/ rsync version 2.6.2 protocol version 28 Copyright (C) 1996-2004 by Andrew Tridgell and others ../ /Please see the rsync(1) and rsyncd.conf(5) man pages for full documentation See //http://rsync.samba.org/// for updates, bug reports, and answers rsync error: syntax or usage error (code 1) at options.c(730) / // Thanks in advance This e-mail message is intended only for the person(s) named above and may contain confidential or privileged information. If you are not the person named or have not been authorized by them, please notify the sender immediately and delete this e-mail and any attachments without reading, saving, or forwarding. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync .gz files?
On Wed 29 Jun 2005, Diane Rolland wrote: Interactively, I get the following error: :rsync error: some files could not be transferred (code 23) at main.c(1045) In the /etc/rsyncd.log, for each of the files, I get: send_files failed to open /backup/exp_dbase_2005-06-2 8.gz: Permission denied So it seems that the sending side isn't allowed to open the files in question. My command is: rsync --verbose --progress --stats --rsh=/usr/bin/ssh --recursive --delete prsvr01::prod-db/backup/* /prod/db/backup Tip: leave off the '*', you're already telling rsync to be recursive. My module on the source host is: [prod-db] path = /prod/db comment = /prod/db uid = nobody Is user 'nobody' allowed to read those files? Paul Slootman -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync question
On Thu 30 Jun 2005, Judith Flo wrote: Well, i've been just working with rsync also, and want to use the --files-from option and write the same command. And my question is: wouldn't it be the correct behavior to provide just one file with the --files-from without writting a source dir? I mean, the content of the files-from file shows the sources which i want to rsync so, why do i have to provide anything else? Read the manpage, the --files-from section, in particular this: The file names that are read from the FILE are all relative to the source dir -- any leading slashes are removed and no .. references are allowed to go higher than the source dir. If you don't supply a source dir, to what directory should the file names be relative to? Paul Slootman -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync question
Hi, I was just thinking about the possibility of a flag that provide rsync with a method that doesn't require a source dir in the line command. I mean, a method where the user just has to write a file which contents all directorys that wants to rsync (directorys without the same root), something like: #cat files2rsync /home/user/a /usr/local/ /a_directory/a_file rsync -a --files-from=/home/user/files2rsync /backup_dir I know i can do something like rsync -a --files-from=/home/user/files2rsync / /backup_dir and modify the content of files2rsync, but i think it will be a good simplification and quite more natural to use.. anyway.. was just thinking loud Thanks! Judith pd: again excuse my english.. Paul Slootman wrote: Read the manpage, the --files-from section, in particular this: The file names that are read from the FILE are all relative to the source dir -- any leading slashes are removed and no .. references are allowed to go higher than the source dir. If you don't supply a source dir, to what directory should the file names be relative to? Paul Slootman -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync .gz files?
Hello all. I would more suspect the gzip behaviour that changes the file permissioning during compression And can also let both files: xxx AND xxx.gz after an error... I have found such unexpected files on nfs systems. By the way I am interested in a method where I could avoid to send .gz files if the uncompressed version exists on remote In other term a way to use rsync to compare compressed and not compressed files. Is there a way to tell rsync to use an external comparison program ? As there is a --size-only option, there is no --date-only option... Thanks and regards Francois -- Message: 8 Date: Thu, 30 Jun 2005 10:35:31 +0200 From: Paul Slootman [EMAIL PROTECTED] Subject: Re: rsync .gz files? To: rsync@lists.samba.org Message-ID: [EMAIL PROTECTED] Content-Type: text/plain; charset=us-ascii On Wed 29 Jun 2005, Diane Rolland wrote: Interactively, I get the following error: :rsync error: some files could not be transferred (code 23) at main.c(1045) In the /etc/rsyncd.log, for each of the files, I get: send_files failed to open /backup/exp_dbase_2005-06-2 8.gz: Permission denied So it seems that the sending side isn't allowed to open the files in question. My command is: rsync --verbose --progress --stats --rsh=/usr/bin/ssh --recursive --delete prsvr01::prod-db/backup/* /prod/db/backup Tip: leave off the '*', you're already telling rsync to be recursive. My module on the source host is: [prod-db] path = /prod/db comment = /prod/db uid = nobody Is user 'nobody' allowed to read those files? Paul Slootman - Visit our Internet site at http://www.reuters.com To find out more about Reuters Products and Services visit http://www.reuters.com/productinfo Any views expressed in this message are those of the individual sender, except where the sender specifically states them to be the views of Reuters Ltd. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2831] rsync tries to create . directory
https://bugzilla.samba.org/show_bug.cgi?id=2831 --- Additional Comments From [EMAIL PROTECTED] 2005-06-30 10:00 --- Created an attachment (id=1292) -- (https://bugzilla.samba.org/attachment.cgi?id=1292action=view) Ignore EEXIST on second mkdir() call -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2831] rsync tries to create . directory
https://bugzilla.samba.org/show_bug.cgi?id=2831 --- Additional Comments From [EMAIL PROTECTED] 2005-06-30 10:12 --- I should also mention that you can avoid the bug by simply never using a trailing slash on a source path when using --relative (there's no difference in behavior with or without a trailing slash when --relative is used). Also, your --excludes won't exclude anything because they are anchored at /www and the transfer is starting at /etc (due to the --relative option). -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2831] rsync tries to create . directory
https://bugzilla.samba.org/show_bug.cgi?id=2831 [EMAIL PROTECTED] changed: What|Removed |Added Status|NEW |RESOLVED Resolution||FIXED --- Additional Comments From [EMAIL PROTECTED] 2005-06-30 10:01 --- Please double-check the rsync version on both ends of the transfer. I can duplicate the bug with the args you mention back in 2.5.7 and 2.6.0, but not in 2.6.1 or newer -- at least, not without adding either --no-implied-dirs or --exclude='*/'. The difference is that newer rsyncs prefer to use the path /etc/ rather than /etc/./, , and it is the trailing . dir that tickles the bug (due to create_directory_path() creating the actual directory itself instead of just the path through the parent directory). In any case, the just-attached patch fixes the problem in the CVS version. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2781] rsync linked files not listed as uptodate
https://bugzilla.samba.org/show_bug.cgi?id=2781 [EMAIL PROTECTED] changed: What|Removed |Added Status|ASSIGNED|RESOLVED Resolution||FIXED --- Additional Comments From [EMAIL PROTECTED] 2005-06-30 10:37 --- I checked-in my fix into CVS a while back and added a test case to verify that the -vv and --itemized output remains consistent. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
[Bug 2831] rsync tries to create . directory
https://bugzilla.samba.org/show_bug.cgi?id=2831 --- Additional Comments From [EMAIL PROTECTED] 2005-06-30 10:32 --- I use rsnapshot as a backup tool to backup some files on a different location on the same partition. I backup 3 folders, but the exclude-directory defined in rsnapshot get forwared to every rsync call. That's why they are listed there. And to your other question, cause of a local backup, the rsync version should not differ :) I already had the same problem on another computer, but upgrading from 2.6.0 to 2.6.5 fixed it. This time it did not help though. Just tried out the remove slash in the source path.. that works, yes! :) I tried several different arguments, but never tried without the slash Thank you :) -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug, or are watching the QA contact. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: 2 instances of rsync
On Wed, Jun 29, 2005 at 10:39:57AM +0400, [EMAIL PROTECTED] wrote: I noticed that when the script is run, there are 2 instances of rsync running (using ps) on server H. Is this normal behaviour? Yes. The receiving side forks into a separate generator and receiver process. ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Question about include/exclude rules
On Tue, Jun 28, 2005 at 02:22:22PM +0200, [EMAIL PROTECTED] wrote:
Rsync works fine for me (the rules are reported below) except a point,
rsync create an empty folders structure that I don'want.
The only way to get rsync to not create directory hierarchies that don't
contain *.txt files is to actually remove the directories from the
transfer, either through more targeted directory includes, or by using
--files-from (though the latter would not make it easy to delete missing
files).
So, instead of the + */ rule you would need to maintain some include
rules, perhaps using something like this perl script:
#!/usr/bin/perl
use strict;
my $dir = shift;
chdir($dir) or die Unable to chdir to $dir: $!\n;
print + *.txt\n;
my %hash;
open(IN, 'find . -name *.txt |') or die Failed to run find: $!\n;
while (IN) {
chomp;
s#^\./##;
next unless s#/[^/]*\.txt$##;
my $path = '';
foreach (split(/\//)) {
$path .= $_ . '/';
next if $hash{$path};
$hash{$path} = 1;
print + $path\n;
}
}
print - *\n;
And use it like this:
new-script ./source | rsync -avz --delete-excluded --exclude-from=- ./source/
./dest
..wayne..
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Symlinks
On Wed, Jun 29, 2005 at 10:53:00AM +0400, [EMAIL PROTECTED] wrote: Now, I've just added a firewire disk to both servers and created a symlink to the mounted disk within the source and destination trees: Rsync copies symlinks as symlinks unless the --copy-links option is given, in which case all symlinks are replaced by the referent object. However, if the symlink points outside of a module's path, it cannot be copied (because that would be a security problem). If you want to copy the contents of the fwdisk directory, I'd suggest either making a new daemon module for that path and copying it separately, or using bind mounts instead of symlinks (if possible on your OS) to mount the same dir into multiple places (on both the source and destination). ..wayne.. -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
CVS update: rsync
Date: Thu Jun 30 17:03:14 2005 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv25178 Modified Files: generator.c Log Message: Ignore EEXIST on second mkdir() call. Revisions: generator.c 1.216 = 1.217 http://www.samba.org/cgi-bin/cvsweb/rsync/generator.c?r1=1.216r2=1.217 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
CVS update: rsync
Date: Thu Jun 30 17:18:30 2005 Author: wayned Update of /data/cvs/rsync In directory dp.samba.org:/tmp/cvs-serv32572 Modified Files: NEWS Log Message: Mention the EEXIST fix. Revisions: NEWS1.310 = 1.311 http://www.samba.org/cgi-bin/cvsweb/rsync/NEWS?r1=1.310r2=1.311 ___ rsync-cvs mailing list rsync-cvs@lists.samba.org https://lists.samba.org/mailman/listinfo/rsync-cvs
