Hey Folks, I updated the site to include the Apache mirror list for each file. I actually put it is the first download location, before the direct download link.
I played around with the mirror network a bit, the performance was not bad, based on sampling from a few vantage points. I found it to be always worse then CloudFront, but typically not *much* worse. So I actually think if we can find a way to have a direct link to the nearest Apache mirror, we could just remove the CloudFront link entirely. I looked into it and apparently we're not the first apache project to have this problem. Many of the bigger projects already use some fancy selection to embed a direct link to the closest mirror: http://httpd.apache.org/download.cgi - Patrick On Fri, Sep 27, 2013 at 10:10 AM, Chris Mattmann <[email protected]> wrote: > Yeah the sigs are usually available from here: > > http://www.apache.org/dist/<project name>/../ > > So for us: > > http://www.apache.org/dist/incubator/spark/spark-0.8.0-incubating/ > > > Cheers, > Chris > > > > -----Original Message----- > From: Matei Zaharia <[email protected]> > Reply-To: "[email protected]" <[email protected]> > Date: Friday, September 27, 2013 10:06 AM > To: "[email protected]" <[email protected]> > Subject: Re: Spark 0.8.0: bits need to come from ASF infrastructure > >>If the mirrors don't have the signatures, then we should probably link to >>the mirrors and the signatures separately. It's definitely important to >>have a link to the mirrors so people can get this through ASF >>infrastructure without hitting only the main server. >> >>It's true that they don't seem to have them, even for other projects -- >>for example check out >>http://mirror.tcpdiag.net/apache/hadoop/common/hadoop-2.0.5-alpha/. >> >>Matei >> >>On Sep 27, 2013, at 12:04 AM, Patrick Wendell <[email protected]> wrote: >> >>> On Thu, Sep 26, 2013 at 8:27 PM, Chris Mattmann <[email protected]> >>>wrote: >>>> Hey Matei yep they have the signatures on them too. >>>> >>>> Cheers, >>>> Chris >>> >>> Chris - I checked a bunch of the mirrors and none of them have the >>> signatures... am I looking in the wrong place? >>> >>> >>>http://www.interior-dsgn.com/apache/incubator/spark/spark-0.8.0-incubatin >>>g/ >>> http://mirror.tcpdiag.net/apache/incubator/spark/spark-0.8.0-incubating/ >>> http://apache.tradebit.com/pub/incubator/spark/spark-0.8.0-incubating/ >>> >>> In response to the comment about thousands of downloads - I didn't >>> mean at all to suggest that Apache couldn't handle this number, in >>> fact, I'm sure they can! I just wanted to point out that we are >>> keeping in mind the existing habits and processes of our user base, >>> and trying to make the transition smooth for them. >>> >>> - Patrick >> > >
