Re: Download sources from servers that don't respond to ping

2009-10-05 Thread Rainer Müller
On 2009-10-06 00:15 , Perry Lee wrote: > How about using one of the time_ variables kept track of by curl? > > For example (from the man page): > > time_connect: The time, in seconds, it took from the start until the TCP > connect to the remote host (or proxy) was completed. Simultanously openi

Re: Download sources from servers that don't respond to ping

2009-10-05 Thread Perry Lee
Ryan Schmidt wrote: "curl --head" could be used to determine whether we can connect to a server, but it doesn't give you a quality indication that could be used to rank multiple available servers. "ping" tells you how many milliseconds it took to reach the server, which is how we sort distfile

Re: Download sources from servers that don't respond to ping

2009-10-04 Thread Ryan Schmidt
On Oct 4, 2009, at 23:16, Eric Hall wrote: Instead of using curl, why not use an internal socket connection on "the right port(s)" for the service used to deliver distfiles? That will be tcp/80 for most ports, some will have different ports (svn or ftp for example). svn/git/cvs type

Re: Download sources from servers that don't respond to ping

2009-10-04 Thread Eric Hall
On Sun, Oct 04, 2009 at 06:20:34PM -0500, Ryan Schmidt wrote: > On Oct 4, 2009, at 14:39, Scott Haneda wrote: > > >On Oct 3, 2009, at 3:18 PM, Ryan Schmidt wrote: > > > >>This is not perfect because as you say some servers might not > >>respond to pings (though hopefully that's rare), and some s

Re: Download sources from servers that don't respond to ping

2009-10-04 Thread Eric Hall
On Sat, Oct 03, 2009 at 06:51:55PM -0500, Ryan Schmidt wrote: [snip] > > Perhaps you could speak with the owners of that server about making it > pingable. > I wouldn't bother, people who block ICMP echo usually do so for a reason and are unlikely to open it up just because somebody el

Re: Download sources from servers that don't respond to ping

2009-10-04 Thread Ryan Schmidt
On Oct 4, 2009, at 14:39, Scott Haneda wrote: On Oct 3, 2009, at 3:18 PM, Ryan Schmidt wrote: This is not perfect because as you say some servers might not respond to pings (though hopefully that's rare), and some servers that respond quickly to pings may not actually be fast at sending t

Re: Download sources from servers that don't respond to ping

2009-10-04 Thread Scott Haneda
I had the misfortune of some bad routes with my colocation provider a while back. Traceroute being the main tool I was using. This combined with Comcast doing strange things on their routers gave me a chance to learn a little more about checking hosts. Rather than ping, what about "curl --h

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Jann Röder
> I'm still not clear how you ended up with a 0-sized file with obviously > mismatched checksums if no 0-sized file existed on any of the > master_sites. If you can reproduce that problem, please send the debug > output. Ok I'll try, it happened when I updated the file on the n.ethz.ch server (wi

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Ryan Schmidt
On Oct 3, 2009, at 18:46, Jann Röder wrote: Ryan Schmidt schrieb: On Oct 3, 2009, at 18:27, Jann Röšder wrote: I have seen an instance where the macports mirror servers were tried which did not have the file. The server specified in the port file was not tried at all. For some reason e

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Jann Röšder
It was the eiffelstudio65 port, I now added another source which does respond to ping requests - problem "solved". The n.ethz.ch server (which is not pingable) is still included in the source list. Ryan Schmidt schrieb: > > On Oct 3, 2009, at 18:27, Jann Röšder wrote: > >> I have seen an instanc

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Ryan Schmidt
On Oct 3, 2009, at 18:27, Jann Röšder wrote: I have seen an instance where the macports mirror servers were tried which did not have the file. The server specified in the port file was not tried at all. For some reason even though the macports mirror servers didn't have the file a file with siz

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Jann Röšder
> MacPorts 1.7 changed this to ping all download servers and try them in > ping order. If a server does not respond to ping or is offline, it > will be at the bottom of the list and will be tried last. I have seen an instance where the macports mirror servers were tried which did not have the file

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Ryan Schmidt
On Oct 3, 2009, at 11:58, Jann Röšder wrote: I noticed, that at the moment servers which do not respond to Pings are not considered as sources. This sounds reasonable, but unfortunately there are some servers out there that work just fine even though they do not respond to Ping messages. S

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Scott Haneda
What is the hostname of one of these servers for example? -- Scott * If you contact me off list replace talklists@ with scott@ * On Oct 3, 2009, at 10:04 AM, Jann Röšder wrote: Yes, but I still want to download stuff from them. Daniel J. Luke schrieb: On Oct 3, 2009, at 12:58 PM, Jann Röšd

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Jann Röšder
Yes, but I still want to download stuff from them. Daniel J. Luke schrieb: > On Oct 3, 2009, at 12:58 PM, Jann Röšder wrote: >> I noticed, that at the moment servers which do not respond to Pings are >> not considered as sources. This sounds reasonable, but unfortunately >> there are some servers

Re: Download sources from servers that don't respond to ping

2009-10-03 Thread Daniel J. Luke
On Oct 3, 2009, at 12:58 PM, Jann Röšder wrote: I noticed, that at the moment servers which do not respond to Pings are not considered as sources. This sounds reasonable, but unfortunately there are some servers out there that work just fine even though they do not respond to Ping messages.

Download sources from servers that don't respond to ping

2009-10-03 Thread Jann Röšder
I noticed, that at the moment servers which do not respond to Pings are not considered as sources. This sounds reasonable, but unfortunately there are some servers out there that work just fine even though they do not respond to Ping messages. So I request that sources with a ping value of 1 ar