Re: Using a real mirroring tool...

2002-04-30 Thread Earnie Boyd
You might want to check out http://mirrors.rcn.net/pub/mirror/index.html for a mirroring tool that uses perl for ftp/http access. Earnie. --- Begin Message --- Charles Wilson wrote: > So, if someone cares enough to do the work, there is still a need for > the "additional tool" that uses the se

Re: Using a real mirroring tool...

2002-04-30 Thread Michael A Chase
On Tue, 30 Apr 2002 16:00:52 +0200 Volker Quetschke <[EMAIL PROTECTED]> wrote: > I attached the modified clean_setup.pl plus a shell scrip to get the > missing files from a mirror. You have to modify the getmissing.sh to > choose your mirror and your target download directory. The directory and

Re: Using a real mirroring tool...

2002-04-30 Thread Volker Quetschke
Hi! > Charles Wilson wrote: > >> A few notes: >> ... >> rsync can't merge. > > Yes, but Michael A. Chases clean_setup.pl can! I allowed myself to add a > new option to clean_setup.pl, it exports the list of missing files to a > file. Then you can use wget to get all the missing files. > > I

Re: Using a real mirroring tool...

2002-04-30 Thread Volker Quetschke
Hi! Charles Wilson wrote: > A few notes: > > ... > > rsync can't merge. Yes, but Michael A. Chases clean_setup.pl can! I allowed myself to add a new option to clean_setup.pl, it exports the list of missing files to a file. Then you can use wget to get all the missing files. I attached the

RE: Using a real mirroring tool...

2002-04-30 Thread Robert Collins
> -Original Message- > From: Sam Edge [mailto:[EMAIL PROTECTED]] > Sent: Tuesday, April 30, 2002 10:18 PM > Or am I missing something? ("Again" do I hear from the > chorus? Kindly leave the auditorium, sir!) ;-) As you may know, you can use the md5sum files to verify what was downloa

Re: Using a real mirroring tool...

2002-04-30 Thread Sam Edge
Charles Wilson wrote in <[EMAIL PROTECTED]> in gmane.os.cygwin on Mon, 29 Apr 2002 16:04:14 -0400: > P.S. you might want to add --exclude *-src.tar.* to the option string, > if you don't want the -src tarballs. As I understand it you can also exclude the setup.hint and md5.sum files if you're j

Re: Using a real mirroring tool...

2002-04-29 Thread Charles Wilson
Charles Wilson wrote: > So, if someone cares enough to do the work, there is still a need for > the "additional tool" that uses the setup.exe codebase to do > "cygwin-specific distributed mirroring". See my earlier rant. Oh, I left out the most obvious reason why rsync won't solve all of our

Re: Using a real mirroring tool...

2002-04-29 Thread Charles Wilson
A few notes: Using rsync does not help the following problem: I have four favorite mirrors, plus a "private" setup-compatible website from my friend Bob. setup.exe will show me a merged view of the contents of all of those sites, insuring that I get the latest version of a package wherever it

Re: Using a real mirroring tool...

2002-04-29 Thread Charles Wilson
Actually, this is a better set of options: we don't need to preserve owner, groups, or devices, and the modify-window helps with the limited timestamp granularity of the FAT filesystem. Remember to fix LOCALDIR and remove --dry-run. - #!/bin/sh MIRROR=rsync://archive.proge

Using a real mirroring tool...

2002-04-29 Thread Charles Wilson
Poor archive.progeny.com ... First, rsync places a heavy load on the server, so please do not EVERYBODY run out and try this immediately. I suggest, for initial rsyncs (when you need to download EVERYTHING), that folks follow this rotation: Surname Begins With Initial rysnc ABC