Re: rsync of STDIN to a file.

2009-11-19 Thread Ryan Lynch
On Thu, Nov 19, 2009 at 08:14, Mark Young wrote: > I've been unable to find any reference to rsync being used in this fashion. > Can anyone tell me whether this is possible today, and if not whether it > might be considered for a future version? In client mode, 'rsync' can accept a list of files

Re: rsync of STDIN to a file.

2009-11-19 Thread Matt McCutchen
On Thu, 2009-11-19 at 13:14 +, Mark Young wrote: > I'm hoping rsync could be told to capture STDIN and treat it as a > single file that it would then sync with the named file at the remote > end. Perhaps something like this: > > tar czf - --files-from $FILE_LIST | rsync - $HOST:${BACKUP_FILE}

RE: rsync of STDIN to a file.

2009-11-19 Thread Mark Young
Hi Ryan & Matt, Thank you both for your replies. I'll reply to you both in one go, starting with you Ryan. The decision to have tarballs on the remote site is arguably unnecessary. It's like that historically, and does cope with a very large hierachy of small files. There are many different m

RE: rsync of STDIN to a file.

2009-11-19 Thread Matt McCutchen
On Thu, 2009-11-19 at 16:28 +, Mark Young wrote: > I tried an experiment to see how rsync coped with the tar compressed > files versus the uncompressed files. I took a .tgz from last week and > rsync'd it with last nights version. rsync achieved the transfer with > a 1.61 speed up. Specifically

RE: rsync of STDIN to a file.

2009-11-19 Thread Mark Young
ff command for since rsync will do the delta-transfer cleverness for me. Cheers, Mark > Subject: RE: rsync of STDIN to a file. > From: m...@mattmccutchen.net > To: mark_yo...@hotmail.com > CC: rsync@lists.samba.org > Date: Thu, 19 Nov 2009 11:53:30 -0500 > > On Thu

Re: rsync of STDIN to a file.

2009-11-19 Thread Eliot Moss
Among other things, gzip embeds the names of the files that it zipped ... so why would you expect your two .gz files to be exactly the same? You'll need to use the same name for the tar files ... and even then, I bet gzip records date and time ... Best wishes -- Eliot Moss ===

Re: rsync of STDIN to a file.

2009-11-19 Thread Matt McCutchen
On Thu, 2009-11-19 at 13:02 -0500, Eliot Moss wrote: > Among other things, gzip embeds the names of the files that it > zipped ... so why would you expect your two .gz files to be > exactly the same? You'll need to use the same name for the > tar files ... and even then, I bet gzip records date and

RE: rsync of STDIN to a file.

2009-11-19 Thread Matt McCutchen
On Thu, 2009-11-19 at 17:29 +, Mark Young wrote: > So if I understand you correctly you are suggesting that I modify my > backup line to be something like this: > > tar czf - --files-from $FILE_LIST | gzip --rsyncable > ${BACKUP_FILE} > or: > GZIP="--rsyncable" tar cvf - --files-from $FILE_LIS

RE: rsync of STDIN to a file.

2009-11-20 Thread Mark Young
Thanks very much Eliot and Matt. I didn't know about gzip storing the original filename, thanks for the tip about the -n. As you say from rsync's point of view I'm sure the difference is negligible. Can you point me at any usage examples with rdiff. I've searched quite a bit and apart from the

Re: rsync of STDIN to a file.

2009-11-20 Thread Ryan Lynch
On Fri, Nov 20, 2009 at 12:35, Mark Young wrote: > Thanks very much Eliot and Matt. I didn't know about gzip storing the > original filename, thanks for the tip about the -n. As you say from rsync's > point of view I'm sure the difference is negligible. > > Can you point me at any usage examples w

RE: rsync of STDIN to a file.

2009-11-20 Thread Matt McCutchen
On Fri, 2009-11-20 at 17:35 +, Mark Young wrote: > Can you point me at any usage examples with rdiff. I've searched quite > a bit and apart from the cygwin man page and the "rdiff -?" usage > message I'm unable to find enough information for me to see how to use > it successfully. Yes, the man

RE: rsync of STDIN to a file.

2009-11-20 Thread Matt McCutchen
On Fri, 2009-11-20 at 19:01 -0500, Matt McCutchen wrote: > On Fri, 2009-11-20 at 17:35 +, Mark Young wrote: > > Can you point me at any usage examples with rdiff. I've searched quite > > a bit and apart from the cygwin man page and the "rdiff -?" usage > > message I'm unable to find enough info

RE: rsync of STDIN to a file.

2009-11-24 Thread Mark Young
Thanks very much Matt for the rdiff command examples and for filing a request to improve the documentation. Cheers, Mark -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.

RE: rsync of STDIN to a file.

2009-11-25 Thread Mark Young
lta oldbackup.sig > backup.delta $ cat backup.delta | ssh u...@remote_host "rdiff patch backup_Wed.tgz > backup_Wed.tgz.new" $ ssh u...@remote_host "mv backup_Wed.tgz.new backup_Wed.tgz" All the best, Cheers, Mark From: mark_yo...@hotmail.com To: rsync@lists.s

RE: rsync of STDIN to a file.

2009-11-27 Thread Matt McCutchen
On Wed, 2009-11-25 at 12:09 +, Mark Young wrote: > I believe the rdiff man page is still not correct, even with your > submitted changes. It states "In every case where a filename must be > specified, - may be used instead to mean either standard input or > standard output as appropriate.". >

RE: rsync of STDIN to a file.

2009-11-28 Thread Mark Young
> On Wed, 2009-11-25 at 12:09 +, Mark Young wrote: > > I believe the rdiff man page is still not correct, even with your > > submitted changes. It states "In every case where a filename must be > > specified, - may be used instead to mean either standard input or > > standard output as appropr

RE: rsync of STDIN to a file.

2009-12-04 Thread Matt McCutchen
On Sat, 2009-11-28 at 23:50 +, Mark Young wrote: > > The next sentence of the man page says, "Be aware that if you do > this, > > you’ll need to terminate your options with -- or rdiff will think > you > > are passing it an empty option." > I'm sure you are right, but there are still older ver