Re: package uploading probs
On Mon, 30 Oct 1995, Ian Jackson wrote: chiark.chu.cam.ac.uk:/debian/private/Incoming Matt, can you mirror this somewhere ? /private/project/incoming-uk And should there be a doom subdirectory there? Just curious... Matt
Re: package uploading probs
Hallo Matthew Bailey! } directory across some sites with good connectivity and use rdist(1) to keep them } in sync? Major mirror sites might be good canditates for this. } }I would probably suggest just mirror as a program to keep them up to date. }If there is a SINGLE site then this would not be a problem. Are you sure that mirror is a good idea? How are files on a european mirror deleted? I won't make sense retrieving them again every hour. }I would mirror them into a directory called }private/project/incoming-europe I have talked about this before but I }beleive that no one was able to come up with a site. }Let me know the URL and I will begin an hourly mirror of it, asuming that }is OK with the rest of Devel. I think it's a good idea. There are some debian mirrors in europe I know of: ftp.leidenuniv.nl and somewhere at *.uni-dresden.de. If you decide to so, It would be a good idea if that machine gets an alias as ftp.europe.debian.org, so that it can be easily found and used. Regards, Joey -- / Martin Schulze * [EMAIL PROTECTED] * 26129 Oldenburg / / +49-441-777884 * LoginPasswd: nuucp * Index: ~/ls-lR.gz / / Germany.Net ist vergleichbar mit einem Telefon/ / ohne Waehlscheibe und Klingel... -- Lutz Donnerhacke / 30.10.95: Oldenburger Linux-Stammtisch, ab 20h im DaCapo
Re: package uploading probs
Just finished with my 1st cup of coffee today :) Nice to see there's some discussion on this topic underway. Martin Schulze writes: Hallo Matthew Bailey! } directory across some sites with good connectivity and use rdist(1) to keep them } in sync? Major mirror sites might be good canditates for this. } }I would probably suggest just mirror as a program to keep them up to date. }If there is a SINGLE site then this would not be a problem. Are you sure that mirror is a good idea? How are files on a european mirror deleted? I won't make sense retrieving them again every hour. Junk your mirror program, if it refetches files - at the very least rewrite it :) In my original post I proposed sort of a distributed package upload directory for developers. Despite the directory name, some of you guys 'n gals fetch packages from ftp.debian.org's incoming directory as soon as they are announced. At least that's what I conclude when seeing bug reports for packages not yet in public view. OTOH in general I don't like any polling approaches - maybe that's a personal preference. Why should you add to network traffic only to find out there's nothing to be mirrored? Are there any security problems when using rdist on mutually trusted sites? I'm using it only on a LAN where I'm the only user I wouldn't trust :) Sorry Matthew, I know you don't like rdist. Is there any compelling reason for your dislike? }I would mirror them into a directory called }private/project/incoming-europe I have talked about this before but I }beleive that no one was able to come up with a site. }Let me know the URL and I will begin an hourly mirror of it, asuming that }is OK with the rest of Devel. I think it's a good idea. There are some debian mirrors in europe I know of: ftp.leidenuniv.nl and somewhere at *.uni-dresden.de. ftp.uni-paderborn.de wasn't in debian.mirrors last time I checked. If you decide to so, It would be a good idea if that machine gets an alias as ftp.europe.debian.org, so that it can be easily found and used. That probably isn't a good idea. Since the primary purpose is a regional upload directory, it will be used only by a limited set of people who should know what they are doing. Regs -- Siggy
Re: package uploading probs
Matthew Bailey writes (Re: package uploading probs ): On Mon, 30 Oct 1995, Ian Jackson wrote: chiark.chu.cam.ac.uk:/debian/private/Incoming Matt, can you mirror this somewhere ? /private/project/incoming-uk And should there be a doom subdirectory there? Oops, that was a mistake. I meant to use and say chiark.chu.cam.ac.uk:/pub/debian/private/Incoming (note `pub'). I've moved the directory to that location, and added a symlink. There is a doom subdirectory at the same level as the debian subdirectory, under /pub. Ian.
package uploading probs
This message is intended in the first place for developers over here in Europe. I wonder if there are others experiencing the same problems that I have when uploading files to ftp.debian.org and are looking out for a solution. Since my account @uni-muenster.de is a rather limited one, I'm working almost exclusively on our tiny Debian/GNU Linux LAN at home and use PPP with dynamic IP addressing to connect to the net. Uploading large files (python* is approx. 4M) even during off-peak hours (0030-0130 UTC seems to be best) is prohibitively slow even with local phone rates (they are at 0.23DM/720s now and will go up to 0.12DM/240s next year). It wouldn't be much of a concern when succeeding on the first try, but I lost track of how many attempts failed for various reasons. The trans-atlantic links being slow as they are, a dual approach to mirroring FTP sites sprang to my mind. What if we are distributing the project's incoming directory across some sites with good connectivity and use rdist(1) to keep them in sync? Major mirror sites might be good canditates for this. Before going into greater detail, I'd like to read your comments. Thanks -- Siggy
Re: package uploading probs
On Sun, 29 Oct 1995, Siggy Brentrup wrote: I hate to follow-up to my own message, but it's only after it was out that I got this one in linux-announce: Heh. Siggy I have both rdist and ssh already running on this ftp server. NOTE: this server doesn't run linux do to hardware contraints it runs FreeBSD. The problem with using rdist and ssh is that ssh has a restrictive copyright a I prefer not to use it for that reason. besides I don't like rdist :) (anyone have a Win95 copy I could reall use it) :) Matt
Re: package uploading probs
Regional upload directories make sense. What we really need is a script (a hack of the mirror program) to mirror all files from a remote system and remove the files from the remote once they have been copied sucessfully. If we can't do that immediately, we can at least establish the regional upload sites and let their local caretakers remove files as appropriate. Note that the upload directory should not be part of your Debian mirror lest we create a short circuit and blow the main fuse of the Internet :-) . Ian Jackson, can you provide one in Cambridge? Is there someone who can provide one in Germany? There are lots of other places that need them as well. Thanks Bruce
Re: package uploading probs
Bruce Perens writes (Re: package uploading probs ): Regional upload directories make sense. What we really need is a script (a hack of the mirror program) to mirror all files from a remote system and remove the files from the remote once they have been copied sucessfully. If we can't do that immediately, we can at least establish the regional upload sites and let their local caretakers remove files as appropriate. Note that the upload directory should not be part of your Debian mirror lest we create a short circuit and blow the main fuse of the Internet :-) . Right. Ian Jackson, can you provide one in Cambridge? Is there someone who can provide one in Germany? There are lots of other places that need them as well. chiark.chu.cam.ac.uk:/debian/private/Incoming Matt, can you mirror this somewhere ? I have a script that one can run out of cron that uses rcp and rsh md5sum to upload a file. That might be suitable for use in these circumstances. Suppose we arrange for users to upload things to the `local' Incoming, and then rename them into a `togo' or `ok' directory. Then the script picks them up and rcp's them across, deleting them a while later. Hmm, I can do this. In the meantime, Matt, mirror that in a directory. Ian.
