Re: Rsync: Re: patch to enable faster mirroring of large filesystems

2001-11-28 Thread Eric Whiting
Dave Dykstra wrote: > > Note that his case is rather pathological because he's got over a million > files in only 400 directories, so he must have an average of over 2500 > files per directory, which are very large directories. He's got about 65% > of the files explicitly listed in his --include-

Re: Widespread implementation of rsync

2001-11-28 Thread Martin Pool
On 30 Oct 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > I know there's no patent on it, and other people have done implementations. > The "resources" page on rsync.samba.org points to a REXX implementation. > Josh Macdonald wrote an implementation in C > http://sourceforge.net/projects/xdelt

Re: rsync server over SSH [includes code patches]

2001-11-28 Thread Martin Pool
> sun/amdahl/unixware patch All these are applied now. I changed the library routines to just include rsync.h -- Martin

rsync with hp-ux 10.20 stock compiler (was Re: CVS update: rsync)

2001-11-28 Thread Martin Pool
On 28 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > The HP compiler needs a -Ae to accept ANSI. Sadly the compiler on this machine reports: configure:5002: cc -c -Ae -DHAVE_CONFIG_H conftest.c >&5 (Bundled) cc: warning 480: The -A option is available only with the C/ANSI C product; igno

Re: How to avoid copying empty directories?

2001-11-28 Thread Dave Madole
I agree with this - a perl script to generate a list of "includes" from a list of directories is not hard to write (below in "long and readable" rather than compact perly form), and what about --python and --awk: #cat frag.pl #!/usr/bin/perl -w # frag.pl - perl fragment for generating include l

Re: cannot create .hosts.b0WX1x : File exists

2001-11-28 Thread Rok Krulec
Hello Dave, thank You for Your time; sorry I didn't included my rsyncd.conf. As I said, on two other machines with EXACTLY the same config file and EXACTLY the same passwd entries for nobody and nogroup = same ID's, it works perfectly. EXECTLY the same permissions on target directory alos ofcours

Re: patch from faith@alephnull to add rate indicator to --progress

2001-11-28 Thread Robert Scholten
Ooooh! I love this sort of thing - helps debugging problems, and in making decisions such as "have I got time to go for a coffee while this is cranking". 2.4.7pre5 please. On Thu, 29 Nov 2001, Martin Pool wrote: > Any votes for/against? > > > - Forwarded message from Rik Faith <[EMAIL PROT

patch from faith@alephnull to add rate indicator to --progress

2001-11-28 Thread Martin Pool
Any votes for/against? - Forwarded message from Rik Faith <[EMAIL PROTECTED]> - Date: Wed, 28 Nov 2001 12:55:29 -0500 From: Rik Faith <[EMAIL PROTECTED]> To: [EMAIL PROTECTED] Subject: rsync patch X-Mailer: VM 6.96; XEmacs 21.1; Linux 2.4.16 (light) Here is a patch that adds rate infor

Re: cannot create .hosts.b0WX1x : File exists

2001-11-28 Thread Dave Dykstra
You probably need to set read only = no in rsyncd.conf. - Dave On Wed, Nov 28, 2001 at 04:29:35PM +0100, Rok Krulec wrote: > Hello, > > when I do: > /opt/rsync/bin/rsync /etc/hosts targethost::bkp/ > > I get: > cannot create .hosts.b0WX1x : File exists > > I check the targethost and I get

Re: How to avoid copying empty directories?

2001-11-28 Thread Dave Dykstra
On Thu, Nov 29, 2001 at 09:23:18AM +1100, Martin Pool wrote: > On 28 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > > On Tue, Nov 27, 2001 at 04:03:58PM -0800, [EMAIL PROTECTED] wrote: > > > rsync -avu --include 'tmp1/*/*.c' --include "*/" --exclude "*" tmp1 tmp2 > > > > > > The above comman

Re: rsync server over SSH [includes code patches]

2001-11-28 Thread Dave Dykstra
On Thu, Nov 29, 2001 at 09:11:58AM +1100, Martin Pool wrote: ... > > 1. remove AC_FUNC_MEMCMP from configure.in because it causes Sunos > > 4.1.4 to die. memcmp() there fails the "8-bit clean" test, but it > > doesn't matter because memcmp() in rsync is only used to test if > > so

Re: How to avoid copying empty directories?

2001-11-28 Thread Martin Pool
On 28 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > On Tue, Nov 27, 2001 at 04:03:58PM -0800, [EMAIL PROTECTED] wrote: > > rsync -avu --include 'tmp1/*/*.c' --include "*/" --exclude "*" tmp1 tmp2 > > > > The above command copies all the empty directories under tmp1/ . Is there > > any way t

Re: rsync server over SSH [includes code patches]

2001-11-28 Thread Martin Pool
On 28 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > Yes, I had seen it but haven't volunteered my build machines because the > build servers download code to execute over the open internet using only > an rsync server, which gives no assurance that it hasn't been spoofed. > Hopefully after

Re: rsync server over SSH [includes code patches]

2001-11-28 Thread Dave Dykstra
On Wed, Nov 28, 2001 at 10:26:35AM +1100, Martin Pool wrote: ... > I'm not sure if you've seen this: > > http://build.samba.org:80/build.pl?tree=rsync&function=Recent+Builds > > It's a pretty good tool, since I don't have direct access to (for > example) a CRAY. The downside is that it requir

Re: Rsync: Re: patch to enable faster mirroring of large filesystems

2001-11-28 Thread Dave Dykstra
Rsync list: Alberto and I have done a couple more exchanges by private email, and we found that he wasn't turning on my include/exclude optimization in his test because he had an "exclude" directive in rsyncd.conf. He has now removed that and run the test again. His very interesting results are

Re: How to avoid copying empty directories?

2001-11-28 Thread btang
Dave Dykstra wrote: > > On Tue, Nov 27, 2001 at 04:03:58PM -0800, [EMAIL PROTECTED] wrote: > > rsync -avu --include 'tmp1/*/*.c' --include "*/" --exclude "*" tmp1 tmp2 > > > > The above command copies all the empty directories under tmp1/ . Is there > > any way to avoid it? > > Currently the onl

release 2.4.7pre4 - Thanks!

2001-11-28 Thread Dave Madole
Excellent work, Martin (and any others involved). No more hangs, and the more consistent and complete messages at the different levels of verbose are great. The "why is a path included or excluded" messages at -vv should cut the traffic on this list by about 25% (I wish I'd had them a couple of

Re: How to avoid copying empty directories?

2001-11-28 Thread btang
Dave Dykstra wrote: > > On Tue, Nov 27, 2001 at 04:03:58PM -0800, [EMAIL PROTECTED] wrote: > > rsync -avu --include 'tmp1/*/*.c' --include "*/" --exclude "*" tmp1 tmp2 > > > > The above command copies all the empty directories under tmp1/ . Is there > > any way to avoid it? > > Currently the onl

Re: More - cause - not all files synched - program hangs in select

2001-11-28 Thread Dave Dykstra
On Wed, Nov 28, 2001 at 02:38:04PM +1100, Martin Pool wrote: > On 27 Nov 2001, Dave Madole <[EMAIL PROTECTED]> wrote: > > > > The bug has something to do with verbosity - it works fine without verbosity > > on. The irony, of course, is that one turns verbosity on to fix these things > > (I have

Re: How to avoid copying empty directories?

2001-11-28 Thread Dave Dykstra
On Tue, Nov 27, 2001 at 04:03:58PM -0800, [EMAIL PROTECTED] wrote: > rsync -avu --include 'tmp1/*/*.c' --include "*/" --exclude "*" tmp1 tmp2 > > The above command copies all the empty directories under tmp1/ . Is there > any way to avoid it? Currently the only way is to explicitly include the p

Re: Not all files synched - hard link problems???

2001-11-28 Thread Dave Dykstra
On Wed, Nov 28, 2001 at 10:55:55AM +1100, Martin Pool wrote: > On 27 Nov 2001, Dave Dykstra <[EMAIL PROTECTED]> wrote: > > > > Unfortunately there is no way to search the archive. That would be very > > useful. > > Just use google and say > > site:lists.samba.org rsync mbp prototype > > or

Re: Rsync: Re: patch to enable faster mirroring of large filesystems

2001-11-28 Thread Dave Dykstra
On Tue, Nov 27, 2001 at 05:00:14PM -0500, Lenny Foner wrote: ... > [ . . . ] > > I'm pretty sure that rsync won't use up memory for excluded files so it > would make no difference. > > ...though this also implies (since you say it'd probably use basically > the same mechanism interna

cannot create .hosts.b0WX1x : File exists

2001-11-28 Thread Rok Krulec
Hello, when I do: /opt/rsync/bin/rsync /etc/hosts targethost::bkp/ I get: cannot create .hosts.b0WX1x : File exists I check the targethost and I get empty file .hosts.b0WX1x When trying with other targethost-s it works, but on this one it doesn't. On the other targethosts I have exactly the sa

RE: Files in use

2001-11-28 Thread matthew . 2 . burgess
Robert, >From our testing we did recently on Sun Solaris 2.6 then RSync copies the file up to the point at which it was last saved (i.e. before it was opened for editing). Dave & Martin will probably tell you that you shouldn't use Rsync on open files (results are undefined), but for the moment

Re: Files in use

2001-11-28 Thread robert
Hello all I have been watching and learning from this list for a couple of months now.. Here is my first question. If rsync comes across a file that is in use by somebody. What happens? Does the file get skipped or does the entire transfer halt? The command I am issuing is: rsync -a -c -v -o -e

Re: Find similarity between local and remote file before transferring

2001-11-28 Thread niels
> Rsync currently doesn't do that. That explains why I couldn't find anything usable on the man-page. :) > Would it suit your purposes if 'rsync -n' > reported the statistics of what it would transfer if -n were not used > rather that what it reports now (which appears to be the number of > by