Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

Sounds good to me. For my purposes, I'm less concerned about old Spark artifacts and more concerned about the consistency of the set of artifacts that get generated with new releases. (e.g. Each new release will always include one artifact each for Hadoop 1, Hadoop 1 + Scala 2.11, etc...) It

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

This is about the s3.amazonaws.com files, not dist.apache.org right? or does it affect both? (BTW you can keep as many old release artifacts around on the apache.org archives as you like; I think the suggestion is to remove all but the most recent releases from the set that's replicated to all

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

I don't think we have a firm contract around that. So far we've never removed old artifacts, but the ASF has asked us at time to decrease the size of binaries we post. In the future at some point we may drop older ones since we keep adding new ones. If downstream projects are depending on our

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

Thanks guys. Regarding this earlier question: More importantly, is there some rough specification for what packages we should be able to expect in this S3 bucket with every release? Is the implied answer that we should continue to expect the same set of artifacts for every release for the

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

The missing artifacts are uploaded now. Things should propagate in the next 24 hours. If there are still issues past then ping this thread. Thanks! - Patrick On Mon, Oct 5, 2015 at 2:41 PM, Nicholas Chammas wrote: > Thanks for looking into this Josh. > > On Mon,

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

Also missing is http://s3.amazonaws.com/spark-related-packages/spark-1.5.1-bin-hadoop1.tgz which breaks spark-ec2 script. On Mon, Oct 5, 2015 at 5:20 AM, Ted Yu wrote: > hadoop1 package for Scala 2.10 wasn't in RC1 either: >

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

I'm working on a fix for this right now. I'm planning to re-run a modified copy of the release packaging scripts which will emit only the missing artifacts (so we won't upload new artifacts with different SHAs for the builds which *did* succeed). I expect to have this finished in the next day or

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

Thanks for looking into this Josh. On Mon, Oct 5, 2015 at 5:39 PM Josh Rosen wrote: > I'm working on a fix for this right now. I'm planning to re-run a modified > copy of the release packaging scripts which will emit only the missing > artifacts (so we won't upload new

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

Blaž said: Also missing is http://s3.amazonaws.com/spark-related-packages/spark-1.5.1-bin-hadoop1.tgz which breaks spark-ec2 script. This is the package I am referring to in my original email. Nick said: It appears that almost every version of Spark up to and including 1.5.0 has included a

Re: Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

hadoop1 package for Scala 2.10 wasn't in RC1 either: http://people.apache.org/~pwendell/spark-releases/spark-1.5.1-rc1-bin/ On Sun, Oct 4, 2015 at 5:17 PM, Nicholas Chammas wrote: > I’m looking here: > > https://s3.amazonaws.com/spark-related-packages/ > > I believe

Spark 1.5.1 - Scala 2.10 - Hadoop 1 package is missing from S3

I’m looking here: https://s3.amazonaws.com/spark-related-packages/ I believe this is where one set of official packages is published. Please correct me if this is not the case. It appears that almost every version of Spark up to and including 1.5.0 has included a --bin-hadoop1.tgz release (e.g.