Re: Does the --delete conflict with --files-from?

2015-04-14 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Technically no, practically kinda... Deleting files only works when you are syncing a directory. If you specify every file to copy then you aren't actually syncing anything and there is nothing for --delete to do. So, --delete will only work if your

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 04/14/2015 11:35 PM, Henri Shustak wrote: >> Ill take a look but I imagine I cant backup the 80 Million files >> I need to in under the 5 hours i have for nightly >> maintenance/backups. Currently it's possible by recycling >> directories... I woul

Does the --delete conflict with --files-from?

2015-04-14 Thread Hongyi Zhao
Hi all, I've tried to use the --files-from and --delete options together. But finally find that in this case, the `--delete' won't delete the extraneous files from dest dirs. So, does the --delete conflict with --files-from? Any hints on this issue? Regards -- .: Hongyi Zhao [ hongyi.zhao

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
> Ill take a look but I imagine I cant backup the 80 Million files I need > to in under the 5 hours i have for nightly maintenance/backups. Currently > it's possible by recycling directories... To cover that many files in that much time you will require a high speed system. Just another thought. P

Re: rsync --link-dest won't link even if existing file is out of date

2015-04-14 Thread Henri Shustak
Hi Ken, You may wish to take a quick look at LBackup (disclaimer I am a developer on this project) which is a wrapper to rsync ; designed for reliable user data backups. LBackup always starts a new backup snapshot with an empty directory. I have been looking at extending --link-dest options t

Re: The --inplace is very different from the behaviour of --partial when resuming a complex case transfer.

2015-04-14 Thread Kevin Korb
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 2 things... First, --partial has no effect in your commands. --partial does not mean resume. Rsync would always attempt to verify+complete a shorter file unless you specify --whole-file. --partial just means don't delete an incomplete file when rsy

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

2015-04-14 Thread Hongyi Zhao
On Tue, 14 Apr 2015 13:28:26 +, Hongyi Zhao wrote: >> but I wouldn't be surprised if some of the filter rules don't work on >> the older rsync. I've done a further test, and it doesn't support your point of view. Even I connect to a server with protocol version 30, it will still fails to li

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

2015-04-14 Thread Hongyi Zhao
On Tue, 14 Apr 2015 13:32:46 +0200, Paul Slootman wrote: > ftp.cn.debian.org is running a version of rsync that supports protocol > version 30, whereas ftp.is.co.za is running an older version that only > supports up to 29. Anyway, thanks for your above notes again. I finally use the nmap to

[Bug 11215] New: compression/zlib errors discard the zlib error message

2015-04-14 Thread samba-bugs
https://bugzilla.samba.org/show_bug.cgi?id=11215 Bug ID: 11215 Summary: compression/zlib errors discard the zlib error message Product: rsync Version: 3.1.0 Hardware: All OS: All Status: NEW Severity: norm

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

2015-04-14 Thread Hongyi Zhao
On Tue, 14 Apr 2015 13:32:46 +0200, Paul Slootman wrote: > ftp.cn.debian.org is running a version of rsync that supports protocol > version 30, whereas ftp.is.co.za is running an older version that only > supports up to 29. >From where can I know the above version information you denoted for the

Re: The complicated filter rule used by me worked for one Debian mirror and not for the other.

2015-04-14 Thread Paul Slootman
On Tue 14 Apr 2015, Hongyi Zhao wrote: > I write a complex filter rules as follows: > > rsync -amvHPRSB131072 -n --delete --delete-excluded \ > -f +_dists/jessie/**binary-all/Packages.gz \ > -f +_dists/jessie/Release* \ > -f +_dists/jessie/**binary-amd64/Packages.gz \ > -f +_dists/jessie/**instal

The complicated filter rule used by me worked for one Debian mirror and not for the other.

2015-04-14 Thread Hongyi Zhao
Hi all, I write a complex filter rules as follows: rsync -amvHPRSB131072 -n --delete --delete-excluded \ -f +_dists/jessie/**binary-all/Packages.gz \ -f +_dists/jessie/Release* \ -f +_dists/jessie/**binary-amd64/Packages.gz \ -f +_dists/jessie/**installer-amd64/*** \ -f +_dists/jessie/**binary-i3

timeout not working.

2015-04-14 Thread Tim Dickson
I am rsyncing to data from one machine (Server) running rsync --deamon (from inetd) to another (client) using /usr/bin/rsync -azq --delete --timeout=60 --contimeout=60 "10.1.1.100::data/" "/data/data/" on the client which works well as you would expect (takes about 34secs with no changes). howe

Re: Two same rsync commands give different results on two debian mirrors.

2015-04-14 Thread Hongyi Zhao
On Tue, 14 Apr 2015 11:36:20 +0200, Paul Slootman wrote: > ou should ensure your messages don't mangle the command lines you want > to show. You could have inserted a \ and a newline before the hostname: > > $ rsync -rmnv -f +_README -f -_* \ > ftp.is.co.za::mirror/ftp.debian.org/ftp.us.debian.

The --inplace is very different from the behaviour of --partial when resuming a complex case transfer.

2015-04-14 Thread Hongyi Zhao
Hi all, >From the manpage of rsync, I can see the following descriptions: --inplace The option implies --partial (since an interrupted transfer does not delete the file) So I do the following testings on the `--inplace' and `--partial' for resuming a file with th

Re: Two same rsync commands give different results on two debian mirrors.

2015-04-14 Thread Paul Slootman
On Tue 14 Apr 2015, Hongyi Zhao wrote: > On Tue, 14 Apr 2015 09:32:10 +0200, Paul Slootman wrote: > > > On Tue 14 Apr 2015, Hongyi Zhao wrote: > >> > >> See the following commands: > >> > >> ___ > >> > >> $ rsync -rmnv -f +_README -f -_* ftp.is.co.za::mirror/ftp.debian.o

Re: Two same rsync commands give different results on two debian mirrors.

2015-04-14 Thread Hongyi Zhao
On Tue, 14 Apr 2015 09:32:10 +0200, Paul Slootman wrote: > On Tue 14 Apr 2015, Hongyi Zhao wrote: >> >> See the following commands: >> >> ___ >> >> $ rsync -rmnv -f +_README -f -_* ftp.is.co.za::mirror/ftp.debian.org/ >> ftp.us.debian.org/debian Please see the above lin

Re: Two same rsync commands give different results on two debian mirrors.

2015-04-14 Thread Paul Slootman
On Tue 14 Apr 2015, Hongyi Zhao wrote: > > See the following commands: > > ___ > > $ rsync -rmnv -f +_README -f -_* ftp.is.co.za::mirror/ftp.debian.org/ > ftp.us.debian.org/debian > > [snipped] > > receiving file list ... done > > sent 23 bytes received 9 bytes 1.42