Incremental file updates over a network, NFS?

Hi list, can anyone point me at some consise info on when rsync is capable of performing incremental updates of binary files? I need to rsync over a network, and currently I have this over an NFS share but I suppose that even if binary updates are possible there not going to do much good as r

Re: Incremental file updates over a network, NFS?

Ok, thanks for the info. That seems to open up the issue of network security (yes NFS security normally isnt great, but...) rsyncd native: is this bug free and secure (based on hosts_allow/hosts_deny?), perhaps a good solution with tcpwrappers? rsh: no thanks ssh: dont really want to have to put

Re: Incremental file updates over a network, NFS?

Hey Matt, thanks a lot for your detailed and very helpful responces! I must admit Ive never come across the ssh force command option before and with this suddenly I feel much more comfortable with the solution! Probably that will work well for me, tho I'd like to understand the other part of

Re: Incremental file updates over a network, NFS?

Hi, ok so basically that would (invoke with SETUID) be to invoke rsync daemon as root for example? More or less I have to run the daemon as root to be able to update files for all users dont I? For example if I want to rsync the homedirs area, I have to run the deamon as root or run a seperat

Re: Incremental file updates over a network, NFS?

Ok thanks for that! I've tried implementing this but Im getting a nasty issue, rsync is core dumping on the recieving server (the daemon side). Im running this command: /usr/local/bin/rsync -vv -r -e "ssh -vv -l rsync -i /usr/home/rsync/.ssh/id_dsa" /usr/home/rsync/rra/ bkupsrv::confidential

Re: Incremental file updates over a network, NFS?

difference if I push or pull from the server side? Im thinking the only important thing is if you pull you can set the server side read-only which is better for security, that about right?? thanks again! Andy. - Original Message - From: "Matt McCutchen" <[EMAIL PROTE

Re: Incremental file updates over a network, NFS?

enting it being better... thanks! Andy. - Original Message - From: "Matt McCutchen" <[EMAIL PROTECTED]> To: "Andy Smith" <[EMAIL PROTECTED]> Cc: Sent: Monday, March 17, 2008 7:05 PM Subject: Re: Incremental file updates over a network, NFS? On Mon, 2008-03-

rsync not preserving permissions

Hi, I am running the following command, it is "pulling" the files across from a read-only configured rsync server via ssh. The command runs as root and I use the -p option to preserve permissions but files with non-root owners are being created/updated as root owned. Can anyone explain

Re: rsync not preserving permissions

Hi Nate, Yes the user id exists on both hosts with the same UID, I also tried the --numeric-ids but this didn't make any difference :S thanks Andy. Quoting nate: Do the same userids exist at both ends? Try --numeric-ids as an option and see if that helps.

Re: rsync not preserving permissions

Yep that did the trick! thanks Matt. Quoting Matt: Ownership is separate from permissions. To preserve user and group ownership, you need to pass -og . This message was sent using IMP, the Internet Messaging Program. -- P

anchoring of patterns for per-directory merge files

Hi, I'm extremely confused about anchoring of patterns for per-directory merge files, as what I see seems to not be the behaviour the documentation suggests. On the receiver side I have rsync version 3.0.3 protocol version 30. On the sender I have rsync version 2.6.9 protocol version 29. I'm

Re: anchoring of patterns for per-directory merge files

Hi Paul, On Wed, Nov 11, 2009 at 06:43:33PM +0100, Paul Slootman wrote: > From the manpage: > >The following modifiers are accepted after a “+” or “-”: > >o A / specifies that the include/exclude rule should be matched > against the absolute pathname of the current item

Re: anchoring of patterns for per-directory merge files

On Wed, Nov 11, 2009 at 05:59:29PM +, Andy Smith wrote: > On Wed, Nov 11, 2009 at 06:43:33PM +0100, Paul Slootman wrote: > > From the manpage: > > > >The following modifiers are accepted after a “+” or “-”: > > > >o A / specifies that the

Re: anchoring of patterns for per-directory merge files

On Wed, Nov 11, 2009 at 06:12:53PM +, Andy Smith wrote: > "-/ tmp/" works though, and does only exclude exactly what I want. I spoke too soon. For me, "-/ tmp/" works identically to "- tmp/", that is it excludes everything with a "tmp/" directory i

Re: deduplicate mode?

Hi Harald, On Mon, Dec 12, 2016 at 02:31:03PM +0100, Harald Dunkel wrote: > Have you considered to introduce a "deduplicate mode" for > rsync, replacing duplicate files in the destination directory > by hard links? For a month now I have been successfully using the offline deduplication feature t

High memory usage - any way around it other than splitting jobs?

Hi, I have a virtual machine with 2G of memory. On this VM there is a directory tree with 33.3 million files in it. When attempting to rsync (rsync -PSHav --delete /source /dest) this tree from one directory to another on the same host, rsync uses all the memory and is killed by oom-killer. This

Re: feature request: exclude from path

Hi Matt, On Sat, Aug 01, 2020 at 10:10:49PM -0400, Matt Stevens via rsync wrote: > I lack development skills. Would there be a way for rsync to be passed an > option to exclude a specific path during a sync operaton? All of my attempts > to use exclude have failed, as it does not respect paths, on

Re: How to manage root<-->root rsync keeping permissions?

Hi Chris, On Tue, Aug 03, 2021 at 09:48:37AM +0100, Chris Green via rsync wrote: > But how do you handle the other end to restore the root ownership etc.? > The script has to do something like:- > > rsync -a /etc/ chris@remote:backups/etc/ > > So at the remote end it only has chris' privileg

Re: How to manage root<-->root rsync keeping permissions?

Hi Chris, On Tue, Aug 03, 2021 at 11:48:31AM +0100, Chris Green via rsync wrote: > If I used the --super option (in a command like the one above) and > chris can run rsync as root on the remote end (via options in the > sudoers file) will this do what I want? I guess I can go away and try > it! :

Re: How to manage root<-->root rsync keeping permissions?

Hello, On Tue, Aug 03, 2021 at 03:05:27PM +0100, Chris Green via rsync wrote: > Remember, as I said, this is all Debianland with no real root login, > while I could add one I'd prefer not to. Your system already has a root user and if you added an SSH public key to its authorized_keys file (and

Confused as to why rsync thinks time, owner and group of many files differ

Hi, I am at the moment using rsync to move quite a big set of backups from one machine to another. The source filesystem is xfs; the target filesystem is btrfs. For various reasons I have been stopping the rsync part way through and re-starting. I have noticed that a large number of files are tra

Re: Confused as to why rsync thinks time, owner and group of many files differ

Hi Kevin, On Thu, Feb 03, 2022 at 05:38:41PM -0500, Kevin Korb via rsync wrote: > Are you using the same source and target each time? Yes. > I ask because the only discrepancy I see is the link count which > shows that there are 11 more instances of that inode on the source > than the target. M