A blast from the past... On Fri 20 Nov 1998, James A. Treacy wrote: > > It would be useful if rsync gave you the ability to order the > mirroring process. A simple scheme, which would solve some > problems with the Debian mirrors, would allow you to specify the > order of the uploading of new files, modified files and deleting > of files.
The problem here is that to be able to efficiently determine what files need to be deleted, what files updated etc. the lists from both systems are sorted. This sorting precludes being able to specify the order. > The reason this would help Debian is that it would minimize the > time that mirrors of the archive are inconsistent. By having new > files mirrored, then modfied files and files deleted only at the > end, the archive would be inconsistent only for the short period > of time it took to update the modified files (which would include > Packages files). > > The current system of deleting files first is the worst thing > for us. To accomplish the same thing now would take three > passes of rsync(*) which is unacceptable given the load it takes > to retrieve the file list. There's now a --delete-after option, which should help a lot. I'd suggest first rsyncing the packages themselves, then doing the Packages files. As the Packages are in a different directory tree from the packages themselves (dists/ and pool/), this should no longer be a problem. (I realize that the pool wasn't (fully?) in use back in 1998.) Paul Slootman -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]
