[Bug 8445] Add a non-trusted filter-file option that would limit the rules and ignore syntax errors
https://bugzilla.samba.org/show_bug.cgi?id=8445 --- Comment #3 from Ruediger Meier 2011-09-18 14:42:57 UTC --- (In reply to comment #2) I have to admit that I was wrong about my point 1. There was no error because the user changed the filter. It was another filter file from a different directory which was broken. All this together happened randomly within seconds so I got the wrong view on it. Anyway point 2. is still on my wishlist and matches the subject of this enhancement request. -- Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email --- You are receiving this mail because: --- You are the QA contact for the bug. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [Bug 8456] improve --link-dest bahaviour
> In general - --link-dest works as expected *only*, if the destination > directory > is empty. Going along with this idea of ensuring the destination directory is empty. LBackup is a rsync backup wrapper system which may be of assistance in this regard. --- This email is protected by LBackup http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [Bug 8450] New: --link-dest seems not to work mounted NTFS file systems
Just to clarify, Is the destination file system NTFS? Also, is this storage directly attached or is it mounted via the network? Finally, you mentioned it is mounted read-only would you please clarify why the drive you are writing to is mounted in this way? Thanks. Henri This email is protected by LBackup http://www.lbackup.org > https://bugzilla.samba.org/show_bug.cgi?id=8450 > > Summary: --link-dest seems not to work mounted NTFS file >systems > Product: rsync > Version: 3.0.8 > Platform: x86 >OS/Version: Linux >Status: NEW > Severity: normal > Priority: P5 > Component: core >AssignedTo: way...@samba.org >ReportedBy: toralf.foers...@gmx.de > QAContact: rsync...@samba.org > > > I use rsync to create daily/weekly/monthly backups to an external USB drive of > my Gentoo Linux using this command line options : > > --archive --delete --delete-excluded --exclude-from=/exclude.list > --link-dest= --stats --verbose > > This works like a charm for all files located on my ext3 Linux partition. > However for the 2 files of a NTFS drive not. > > Here rsync always transfers an unchanged file too, even if contains > that file (from a backup made yesterday) and therefore it should better be > hard-linked only instead of being transferred twice. > > What is really curious - at the beginning of using this backup solution (some > weeks ago) the doesn't contain an older version of that file, and there > hard-linking worked IIRC. > > The NTFS drive is mounted read-only: > > tfoerste@n22 ~ $ mount | grep C > /dev/sda1 on /mnt/C type ntfs > (ro,noexec,nosuid,nodev,noatime,uid=1000,gid=100,umask=0027) > > is /mnt/C/notes/data/archive/ > is /mnt/media/daily/f/ > is /mnt/media/weekly/b (given as ../../weekly/b at the command > line) > > Here you can see that different hard links are used : > > tfoerste@n22 ~ $ ls -il /mnt/C/notes/data/archive/l_DE1448.nsf > /mnt/media/daily/f/archive/l_DE1448.nsf > /mnt/media/weekly/b/archive/l_DE1448.nsf > 80719 -r-xr-x--- 1 tfoerste users 8126464 Sep 2 13:40 > /mnt/C/notes/data/archive/l_DE1448.nsf > 2293796 -r-xr-x--- 1 tfoerste users 8126464 Sep 2 13:40 > /mnt/media/daily/f/archive/l_DE1448.nsf > 2310874 -r-xr-x--- 1 tfoerste users 8126464 Sep 2 13:40 > /mnt/media/weekly/b/archive/l_DE1448.nsf > > md5sum proves identical content, the file attributes shouldn't changed too > (NTFS is always mounted read-only, never read-write) : > > tfoerste@n22 ~ $ md5sum /mnt/C/notes/data/archive/l_DE1448.nsf > /mnt/media/daily/f/archive/l_DE1448.nsf > /mnt/media/weekly/b/archive/l_DE1448.nsf > 88ef0d516c5696bf120d749f4b1fc9ba /mnt/C/notes/data/archive/l_DE1448.nsf > 88ef0d516c5696bf120d749f4b1fc9ba /mnt/media/daily/f/archive/l_DE1448.nsf > 88ef0d516c5696bf120d749f4b1fc9ba /mnt/media/weekly/b/archive/l_DE1448.nsf > > OTOH does it make any difference whether the drive at the external USB > drive is mounted as ext2 instead of ext3 ? > > -- > Configure bugmail: https://bugzilla.samba.org/userprefs.cgi?tab=email > --- You are receiving this mail because: --- > You are the QA contact for the bug. > -- > Please use reply-all for most replies to avoid omitting the mailing list. > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [Bug 8456] improve --link-dest bahaviour
> I'd like to use rsync as an efficient (== do not store the same file twice at > the backup media) backup solution. The backup should be made into N remote > directories (rotating each day) _without_ the need to delete the remote > directory before. This is essentially, what LBackup is doing. However, keep in mind that if the transfer is interrupted. The incomplete backup will be deleted and then it will be restarted only using the latest successful backup (with regards link-dest). LBackup will always backup to a clean (empty) backup destination directory called "Section.inprogress". The LBackup project is open source. As such, you are free to have a look at the code to get an idea of what it is doing or even fork the project (github - makes this easy) for your specific requirements. Also, keep in mind that if a file is not hard linked to save space and it has been updated then it will end up taking up additional space on the destination backup system. I have not experimented with de-duplicating file systems. However, if you want to save on space then this may be an avenue to investigate as well with regards backups, regardless of wheather you use LBackup, a different wrapper, rsync directly or some other system. I hope this helps. --- This email is protected by LBackup http://www.lbackup.org -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync command for multi files and dirs from remote server
Hi there, okay so I have a port knocker installed on my remote server so I am trying to bundle a bunch of directories in a single ssh session that rsync establishes. so far all the rsync examples I have seen require a new ssh session for each directory. is there anyway to get something like this into one line and therefore one ssh session. Clues on this? --- snip --- /usr/bin/rsync -avrz --human-readable --progress --update --perms --ignore-existing -e 'ssh -p -o ServerAliveInterval=10' --delete --relative root@:/etc '/shares/internal//' /usr/bin/rsync -avrz --human-readable --progress --update --perms --ignore-existing -e 'ssh -p -o ServerAliveInterval=10' --delete --relative root@:/root '/shares/internal//' --- snip --- Cheers, Noah -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync command for multi files and dirs from remote server
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Look into ssh connection sharing (search for ControlMaster). You can set ssh to use a single TCP connection (and authentication) for all ssh activity to a specific host. On 09/18/11 22:53, Noah wrote: > Hi there, > > okay so I have a port knocker installed on my remote server so I am > trying to bundle a bunch of directories in a single ssh session that > rsync establishes. so far all the rsync examples I have seen require a > new ssh session for each directory. > > is there anyway to get something like this into one line and therefore > one ssh session. Clues on this? > > --- snip --- > > /usr/bin/rsync -avrz --human-readable --progress --update --perms > --ignore-existing -e 'ssh -p -o ServerAliveInterval=10' --delete > --relative root@:/etc '/shares/internal//' > /usr/bin/rsync -avrz --human-readable --progress --update --perms > --ignore-existing -e 'ssh -p -o ServerAliveInterval=10' --delete > --relative root@:/root '/shares/internal//' > > --- snip --- > > Cheers, > > Noah - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk52sKEACgkQVKC1jlbQAQcEkACdFTjR4f9+R++o+oSVHn9xUyPP Q+oAnizyhYiAykhD6p2pzptUexid81hY =KV9D -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync command for multi files and dirs from remote server
On Sun, 18 Sep 2011, Noah wrote: Hi there, okay so I have a port knocker installed on my remote server so I am trying to bundle a bunch of directories in a single ssh session that rsync establishes. so far all the rsync examples I have seen require a new ssh session for each directory. is there anyway to get something like this into one line and therefore one ssh session. Clues on this? Try the ControlMaster=auto option to SSH with an appropriate ControlPath setting. Example of usage at: (Googled: SSH multiplex) http://www.linuxjournal.com/content/speed-multiple-ssh-connections-same-server As an '-e' argument, it'd be: -e 'ssh [...etc...] -o ControlMaster=auto -o ControlPath=~/.ssh/master-%r@%h:%p [...etc...]' -- Best, Ben -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync command for multi files and dirs from remote server
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 BTW, you can specify all that stuff in ~/.ssh/config and save your fingers some wear. On 09/18/11 23:06, Benjamin R. Haskell wrote: > On Sun, 18 Sep 2011, Noah wrote: > >> Hi there, >> >> okay so I have a port knocker installed on my remote server so I am >> trying to bundle a bunch of directories in a single ssh session that >> rsync establishes. so far all the rsync examples I have seen require >> a new ssh session for each directory. >> >> is there anyway to get something like this into one line and therefore >> one ssh session. Clues on this? > > Try the ControlMaster=auto option to SSH with an appropriate ControlPath > setting. > > Example of usage at: (Googled: SSH multiplex) > http://www.linuxjournal.com/content/speed-multiple-ssh-connections-same-server > > > As an '-e' argument, it'd be: > > -e 'ssh [...etc...] -o ControlMaster=auto -o > ControlPath=~/.ssh/master-%r@%h:%p [...etc...]' > - -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: http://www.sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~ -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.17 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk52sigACgkQVKC1jlbQAQfxKACfe5peSSNS8dMXQVwoloruY5sZ E7kAmQGXJr9mUrpNamkNQsj91oLRFDhG =Z4ti -END PGP SIGNATURE- -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync command for multi files and dirs from remote server
[reversing t
On Sun, 18 Sep 2011, Kevin Korb wrote:
On 09/18/11 23:06, Benjamin R. Haskell wrote:
On Sun, 18 Sep 2011, Noah wrote:
Hi there,
okay so I have a port knocker installed on my remote server so I am
trying to bundle a bunch of directories in a single ssh session that
rsync establishes. so far all the rsync examples I have seen
require a new ssh session for each directory.
is there anyway to get something like this into one line and
therefore one ssh session. Clues on this?
Try the ControlMaster=auto option to SSH with an appropriate
ControlPath setting.
Example of usage at: (Googled: SSH multiplex)
http://www.linuxjournal.com/content/speed-multiple-ssh-connections-same-server
As an '-e' argument, it'd be:
-e 'ssh [...etc...] -o ControlMaster=auto -o
ControlPath=~/.ssh/master-%r@%h:%p [...etc...]'
BTW, you can specify all that stuff in ~/.ssh/config and save your
fingers some wear.
The link I posted showed it in config format. I was providing an
alternative, since the OP's already doing weird acrobatics with -e:
-e 'ssh -p -o ServerAliveInternal=10'
But, as you point out, this is probably better placed in an
~/.ssh/config:
Host rsync-reverse
HostName hostname.net
User root
Port
ServerAliveInternal 10
ControlMaster auto
ControlPath ~/.ssh/master-%r@%h:%p
Then, the commands from before:
/usr/bin/rsync -avrz --human-readable --progress --update --perms --ignore-existing -e 'ssh -p
-o ServerAliveInterval=10' --delete --relative root@:/etc
'/shares/internal//'
/usr/bin/rsync -avrz --human-readable --progress --update --perms --ignore-existing -e 'ssh -p
-o ServerAliveInterval=10' --delete --relative root@:/root
'/shares/internal//'
1. don't need the '-e' option ('ssh' is the default, and the options
will come from ~/.ssh/config)
2. can use the Host specified above to shorten the source
3. don't need the redundant '-r' and '--perms' (-a includes both)
/usr/bin/rsync -avz --human-readable --progress --update --ignore-existing --delete
--relative rsync-reverse:/etc '/shares/internal//'
/usr/bin/rsync -avz --human-readable --progress --update --ignore-existing --delete
--relative rsync-reverse:/root '/shares/internal//'
And, if the sources are really /etc and /root, you can just
combine them into the following (and the --relative is redundant because
it's based at the root directory):
/usr/bin/rsync -avz --human-readable --progress --update
--ignore-existing --delete --relative rsync-reverse:'/etc /root'
'/shares/internal//'
(in which case you might not even need the ControlMaster/ControlPath
stuff.)
--
Best,
Ben
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: [Bug 8456] improve --link-dest bahaviour
On Wed, Sep 14, 2011 at 9:48 AM, wrote: > I'd like to use rsync as an efficient (== do not store the same file twice > at > the backup media) backup solution. Check out PCBackup -- it can use rsync (either via ssh or a daemon) and stores files without duplicates. There's also a diff in the patches called link-by-hash that will hard link files together that have the same hash because it maintains a directory of hash-named files. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
