Re: New feature: detect and avoid transfering renamed files
On Tue, 9 Sep 2008 07:49:06 -0700, Wayne Davison wrote: Sorry for the slow reply -- I marked your message for more in-depth study, and failed to get back to it until now. That's OK, I've done worse :-( drawbacks: - It creates a single (potentially really big) directory of files on the receiver for the byinode/* files. [others deleted] Indeed, it more or less assumes you have a filesystem which handles this well. Your other observations are also quite correct. I had been thinking of extending the db patch to add the ability to track files by checksum in a database. This would allow a run that used the DB to be an efficient checksum run (reading the checksums from the DB, not slowly generating them) and look up matching checksums in the DB That is a good idea because the database can be used for all sorts of other purposes too. Here are the drawbacks I see: - I think you will have trouble catching files that have both moved and changed since the last rsync (typical example: /var/log/syslog had data appended and then was rotated to /var/log/syslog.0 and then rsync runs to do an incremental backup). You can solve this by storing devinum in the database. I'm not familiar with the db patch, perhaps it already does this? - It might be inconvenient to have a database on both sides of the transfer. For example, when I backup many devices to a backup server, it's cleaner to keep state only on the backup server. Some small devices (mobile phones?) might not even tolerate the creation of extra files (sqlite database) in their filesystem. As I indicated, the first is solvable, and I think I can live with the second one. -Phil -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync is effecting in the DC switch??
hi guys, we are using rsycn without problem but today after some problems in one of the servers, the dc tech did find the rsync is effecting in the switch where they have the server connected broadcasting all the ports in the switch at the dc? This is what the dc tech said: It appears that your server is broadcasting to every port on the switch that you are connected to Any idea why this is happening? Thanx in advance! im using version 3.0.3 protocol version 30 and im running the command through shell in the destination server (backup server) to pull the files from the other servers: /usr/bin/rsync -rplogDtzH --stats --delete-during --timeout=500 --exclude-from=/rsyncexcludedfiles --files-from=/rsyncincludedfiles -e ssh [EMAIL PROTECTED]:/ /backup/server Manuel -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: New feature: detect and avoid transfering renamed files
Phil Vandry wrote: On Tue, 9 Sep 2008 07:49:06 -0700, Wayne Davison wrote: Sorry for the slow reply -- I marked your message for more in-depth study, and failed to get back to it until now. That's OK, I've done worse :-( drawbacks: - It creates a single (potentially really big) directory of files on the receiver for the byinode/* files. [others deleted] Indeed, it more or less assumes you have a filesystem which handles this well. Your other observations are also quite correct. I had been thinking of extending the db patch to add the ability to track files by checksum in a database. This would allow a run that used the DB to be an efficient checksum run (reading the checksums from the DB, not slowly generating them) and look up matching checksums in the DB I missed the first part of the discussion, and I may be off-base, but you may want to look at unison and how it handles its database. http://www.cis.upenn.edu/~bcpierce/unison/ Where rsync is stateless, unison is stateful. You're talking about making rsync stateful. --Yan -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
--files-from= and --delete corrent options
Hi, I am running the following command to backup a specific file from /tmp/BACKUPFILE which contains the name Friday2008-09-19.bkf. rsync -ah --delete --numeric-ids --stats --delete-excluded --files-from=/tmp/BACKUPFILE /var/data/shares/vmbackups/ /mnt/usb_backup/SFSYDVS01/daily.0/VM/ The name in /tmp/BACKUPFILE changes each day for example when next run it will be Monday2008-09-19.bkf I use a script before running rsync to obtain the most recently modified file from /var/data/shares/vmbackups/ and cat it into /tmp/BACKUPFILE. I want the /mnt/usb_backup/SFSYDVS01/daily.0/VM/ directory to only ever contain the most recent backup file e.g. [EMAIL PROTECTED]:~# ls -t1 /var/data/shares/vmbackups | head -n 1 /tmp/BACKUPFILE [EMAIL PROTECTED]:~# rsync [CORRECT OPTIONS] --files-from=/tmp/BACKUPFILE /var/data/shares/vmbackups/ /mnt/usb_backup/SFSYDVS01/daily.0/VM/ [EMAIL PROTECTED]:~# ls /mnt/usb_backup/SFSYDVS01/daily.0/VM/ Friday2008-09-19.bkf Skip to next day. [EMAIL PROTECTED]:~# ls -t1 /var/data/shares/vmbackups | head -n 1 /tmp/BACKUPFILE [EMAIL PROTECTED]:~# rsync [CORRECT OPTIONS] --files-from=/tmp/BACKUPFILE /var/data/shares/vmbackups/ /mnt/usb_backup/SFSYDVS01/daily.0/VM/ [EMAIL PROTECTED]:~# ls /mnt/usb_backup/SFSYDVS01/daily.0/VM/ Monday2008-09-19.bkf But currently the command grabs everything in /var/data/shares/vmbackups/ and so I end up with: [EMAIL PROTECTED]:~# ls /mnt/usb_backup/SFSYDVS01/daily.0/VM/ Monday2008-09-19.bkf Friday2008-09-19.bkf I expected the --delete option would have removed Friday2008-09-19.bkf in this example (with the --delete option) but it doesn't. I've read the man page and googled a bit but I think i'm getting a bit lost. Sorry if this seems long winded but I hope you understand what I'm trying to do. Thanks James -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
