Re: better RSYNC mirroring , for .debs and others

2000-03-10 Thread Edmund GRIMLEY EVANS
I'm not arguing the rest of your points, but I'm curious about this one. IIRC, the last thing a full bootstrap of GCC does, after building stage one binaries with the native compiler, Hum, It *used* to do this, can't seem to get it to do it today though oh well IIRC it only

Re: better RSYNC mirroring , for .debs and others

2000-03-10 Thread Jacob Kuntz
you're quite right. why are we using rsync anyway? in it's current state it's a waste of resources except for block-oriented files like cdimages. wouldn't it make more sense to use something like mirror or wget untill debdiff matures? are mirror admins required to use rsync? another tought: would

Re: better RSYNC mirroring , for .debs and others

2000-03-10 Thread Jason Gunthorpe
On Fri, 10 Mar 2000, Jacob Kuntz wrote: wouldn't it make more sense to use something like mirror or wget untill debdiff matures? are mirror admins required to use rsync? Sadly rsync is far, far better that mirror or wget, both of which are verging on useless for an archive of our size. We

better RSYNC mirroring , for .debs and others

2000-03-09 Thread Andrea Mennucc1
hi everybody I have implemented a good idea for reducing download stress for everybody who is mirroring a lot of data using rsync, like, the people who are mirroring Debian GNU/Linux: currently, many Debian leaf mirrors are using rsync for mirroring from the main .debian.org hosts. rsync

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread Jacob Kuntz
tom rothamel is working on a project called debdiff that works towards the same goal. please read his announcment thread, which is archived at http://www.debian.org/Lists-Archives/debian-devel-0002/msg00391.htm. i like the idea of rsync modules, but the concept you project misses is that even a

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread Jason Gunthorpe
On Thu, 9 Mar 2000, Andrea Mennucc1 wrote: rsync contains a wonderful algorithm to speedup downloads when mirroring files which have only minor differences; only problem is, this algorithm is ALMOST NEVER used when mirroring a debian repository Small detail here, .debs, like .gz files are

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread David Starner
On Thu, Mar 09, 2000 at 12:26:30PM -0700, Jason Gunthorpe wrote: differences very, very small. This is particularly true for .debs when you add in the fact that gcc never produces binary identical output on consecutive runs. I'm not arguing the rest of your points, but I'm curious about this

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread Jason Gunthorpe
On Thu, 9 Mar 2000, David Starner wrote: I'm not arguing the rest of your points, but I'm curious about this one. IIRC, the last thing a full bootstrap of GCC does, after building stage one binaries with the native compiler, Hum, It *used* to do this, can't seem to get it to do it today

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread Marcus Brinkmann
On Thu, Mar 09, 2000 at 12:46:05PM -0700, Jason Gunthorpe wrote: On Thu, 9 Mar 2000, David Starner wrote: I'm not arguing the rest of your points, but I'm curious about this one. IIRC, the last thing a full bootstrap of GCC does, after building stage one binaries with the native

Re: better RSYNC mirroring , for .debs and others

2000-03-09 Thread Tom Rothamel
On 9 Mar 2000 12:56:29 -0500, Jacob Kuntz wrote: tom rothamel is working on a project called debdiff that works towards the same goal. please read his announcment thread, which is archived at http://www.debian.org/Lists-Archives/debian-devel-0002/msg00391.htm. The code associated with this is