Re: [ANNOUNCE] Nightly maven and package builds for Spark
This should be fixed now. I just triggered a manual build and the latest binaries are at http://people.apache.org/~pwendell/spark-nightly/spark-master-bin/spark-1.5.0-SNAPSHOT-2015_08_17_00_36-3ff81ad-bin/ Thanks Shivaram On Mon, Aug 17, 2015 at 12:26 AM, Olivier Girardot wrote: > thx for this, let me know if you need help > > 2015-08-16 23:38 GMT+02:00 Shivaram Venkataraman > : >> >> I just investigated this and this is happening because of a Maven >> version requirement not being met. I'll look at modifying the build >> scripts to use Maven 3.3.3 (with build/mvn --force ?) >> >> Shivaram >> >> On Sun, Aug 16, 2015 at 10:16 AM, Olivier Girardot >> wrote: >> > Hi Patrick, >> > is there any way for the nightly build to include common distributions >> > like >> > : with/without hive/yarn support, hadoop 2.4, 2.6 etc... ? >> > For now it seems that the nightly binary package builds actually ships >> > only >> > the source ? >> > I can help on that too if you want, >> > >> > Regards, >> > >> > Olivier. >> > >> > 2015-08-02 5:19 GMT+02:00 Bharath Ravi Kumar : >> >> >> >> Thanks for fixing it. >> >> >> >> On Sun, Aug 2, 2015 at 3:17 AM, Patrick Wendell >> >> wrote: >> >>> >> >>> Hey All, >> >>> >> >>> I got it up and running - it was a newly surfaced bug in the build >> >>> scripts. >> >>> >> >>> - Patrick >> >>> >> >>> On Wed, Jul 29, 2015 at 6:05 AM, Bharath Ravi Kumar >> >>> >> >>> wrote: >> >>> > Hey Patrick, >> >>> > >> >>> > Any update on this front please? >> >>> > >> >>> > Thanks, >> >>> > Bharath >> >>> > >> >>> > On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell >> >>> > >> >>> > wrote: >> >>> >> >> >>> >> Hey Bharath, >> >>> >> >> >>> >> There was actually an incompatible change to the build process that >> >>> >> broke several of the Jenkins builds. This should be patched up in >> >>> >> the >> >>> >> next day or two and nightly builds will resume. >> >>> >> >> >>> >> - Patrick >> >>> >> >> >>> >> On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar >> >>> >> wrote: >> >>> >> > I noticed the last (1.5) build has a timestamp of 16th July. Have >> >>> >> > nightly >> >>> >> > builds been discontinued since then? >> >>> >> > >> >>> >> > Thanks, >> >>> >> > Bharath >> >>> >> > >> >>> >> > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell >> >>> >> > >> >>> >> > wrote: >> >>> >> >> >> >>> >> >> Hi All, >> >>> >> >> >> >>> >> >> This week I got around to setting up nightly builds for Spark on >> >>> >> >> Jenkins. I'd like feedback on these and if it's going well I can >> >>> >> >> merge >> >>> >> >> the relevant automation scripts into Spark mainline and document >> >>> >> >> it >> >>> >> >> on >> >>> >> >> the website. Right now I'm doing: >> >>> >> >> >> >>> >> >> 1. SNAPSHOT's of Spark master and release branches published to >> >>> >> >> ASF >> >>> >> >> Maven snapshot repo: >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ >> >>> >> >> >> >>> >> >> These are usable by adding this repository in your build and >> >>> >> >> using >> >>> >> >> a >> >>> >> >> snapshot version (e.g. 1.3.2-SNAPSHOT). >> >>> >> >> >> >>> >> >> 2. Nightly binary package builds and doc builds of master and >> >>> >> >> release >> >>> >> >> versions. >> >>> >> >> >> >>> >> >> http://people.apache.org/~pwendell/spark-nightly/ >> >>> >> >> >> >>> >> >> These build 4 times per day and are tagged based on commits. >> >>> >> >> >> >>> >> >> If anyone has feedback on these please let me know. >> >>> >> >> >> >>> >> >> Thanks! >> >>> >> >> - Patrick >> >>> >> >> >> >>> >> >> >> >>> >> >> >> >>> >> >> - >> >>> >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> >>> >> >> For additional commands, e-mail: dev-h...@spark.apache.org >> >>> >> >> >> >>> >> > >> >>> > >> >>> > >> >> >> >> >> > >> > >> > >> > -- >> > Olivier Girardot | Associé >> > o.girar...@lateral-thoughts.com >> > +33 6 24 09 17 94 > > > > > -- > Olivier Girardot | Associé > o.girar...@lateral-thoughts.com > +33 6 24 09 17 94 - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: [ANNOUNCE] Nightly maven and package builds for Spark
I just investigated this and this is happening because of a Maven version requirement not being met. I'll look at modifying the build scripts to use Maven 3.3.3 (with build/mvn --force ?) Shivaram On Sun, Aug 16, 2015 at 10:16 AM, Olivier Girardot wrote: > Hi Patrick, > is there any way for the nightly build to include common distributions like > : with/without hive/yarn support, hadoop 2.4, 2.6 etc... ? > For now it seems that the nightly binary package builds actually ships only > the source ? > I can help on that too if you want, > > Regards, > > Olivier. > > 2015-08-02 5:19 GMT+02:00 Bharath Ravi Kumar : >> >> Thanks for fixing it. >> >> On Sun, Aug 2, 2015 at 3:17 AM, Patrick Wendell >> wrote: >>> >>> Hey All, >>> >>> I got it up and running - it was a newly surfaced bug in the build >>> scripts. >>> >>> - Patrick >>> >>> On Wed, Jul 29, 2015 at 6:05 AM, Bharath Ravi Kumar >>> wrote: >>> > Hey Patrick, >>> > >>> > Any update on this front please? >>> > >>> > Thanks, >>> > Bharath >>> > >>> > On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell >>> > wrote: >>> >> >>> >> Hey Bharath, >>> >> >>> >> There was actually an incompatible change to the build process that >>> >> broke several of the Jenkins builds. This should be patched up in the >>> >> next day or two and nightly builds will resume. >>> >> >>> >> - Patrick >>> >> >>> >> On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar >>> >> wrote: >>> >> > I noticed the last (1.5) build has a timestamp of 16th July. Have >>> >> > nightly >>> >> > builds been discontinued since then? >>> >> > >>> >> > Thanks, >>> >> > Bharath >>> >> > >>> >> > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell >>> >> > >>> >> > wrote: >>> >> >> >>> >> >> Hi All, >>> >> >> >>> >> >> This week I got around to setting up nightly builds for Spark on >>> >> >> Jenkins. I'd like feedback on these and if it's going well I can >>> >> >> merge >>> >> >> the relevant automation scripts into Spark mainline and document it >>> >> >> on >>> >> >> the website. Right now I'm doing: >>> >> >> >>> >> >> 1. SNAPSHOT's of Spark master and release branches published to ASF >>> >> >> Maven snapshot repo: >>> >> >> >>> >> >> >>> >> >> >>> >> >> >>> >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ >>> >> >> >>> >> >> These are usable by adding this repository in your build and using >>> >> >> a >>> >> >> snapshot version (e.g. 1.3.2-SNAPSHOT). >>> >> >> >>> >> >> 2. Nightly binary package builds and doc builds of master and >>> >> >> release >>> >> >> versions. >>> >> >> >>> >> >> http://people.apache.org/~pwendell/spark-nightly/ >>> >> >> >>> >> >> These build 4 times per day and are tagged based on commits. >>> >> >> >>> >> >> If anyone has feedback on these please let me know. >>> >> >> >>> >> >> Thanks! >>> >> >> - Patrick >>> >> >> >>> >> >> >>> >> >> - >>> >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >>> >> >> For additional commands, e-mail: dev-h...@spark.apache.org >>> >> >> >>> >> > >>> > >>> > >> >> > > > > -- > Olivier Girardot | Associé > o.girar...@lateral-thoughts.com > +33 6 24 09 17 94 - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Hi Patrick, is there any way for the nightly build to include common distributions like : with/without hive/yarn support, hadoop 2.4, 2.6 etc... ? For now it seems that the nightly binary package builds actually ships only the source ? I can help on that too if you want, Regards, Olivier. 2015-08-02 5:19 GMT+02:00 Bharath Ravi Kumar : > Thanks for fixing it. > > On Sun, Aug 2, 2015 at 3:17 AM, Patrick Wendell > wrote: > >> Hey All, >> >> I got it up and running - it was a newly surfaced bug in the build >> scripts. >> >> - Patrick >> >> On Wed, Jul 29, 2015 at 6:05 AM, Bharath Ravi Kumar >> wrote: >> > Hey Patrick, >> > >> > Any update on this front please? >> > >> > Thanks, >> > Bharath >> > >> > On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell >> wrote: >> >> >> >> Hey Bharath, >> >> >> >> There was actually an incompatible change to the build process that >> >> broke several of the Jenkins builds. This should be patched up in the >> >> next day or two and nightly builds will resume. >> >> >> >> - Patrick >> >> >> >> On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar >> >> wrote: >> >> > I noticed the last (1.5) build has a timestamp of 16th July. Have >> >> > nightly >> >> > builds been discontinued since then? >> >> > >> >> > Thanks, >> >> > Bharath >> >> > >> >> > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell > > >> >> > wrote: >> >> >> >> >> >> Hi All, >> >> >> >> >> >> This week I got around to setting up nightly builds for Spark on >> >> >> Jenkins. I'd like feedback on these and if it's going well I can >> merge >> >> >> the relevant automation scripts into Spark mainline and document it >> on >> >> >> the website. Right now I'm doing: >> >> >> >> >> >> 1. SNAPSHOT's of Spark master and release branches published to ASF >> >> >> Maven snapshot repo: >> >> >> >> >> >> >> >> >> >> >> >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ >> >> >> >> >> >> These are usable by adding this repository in your build and using a >> >> >> snapshot version (e.g. 1.3.2-SNAPSHOT). >> >> >> >> >> >> 2. Nightly binary package builds and doc builds of master and >> release >> >> >> versions. >> >> >> >> >> >> http://people.apache.org/~pwendell/spark-nightly/ >> >> >> >> >> >> These build 4 times per day and are tagged based on commits. >> >> >> >> >> >> If anyone has feedback on these please let me know. >> >> >> >> >> >> Thanks! >> >> >> - Patrick >> >> >> >> >> >> >> - >> >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> >> >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> >> >> >> > >> > >> > >> > > -- *Olivier Girardot* | Associé o.girar...@lateral-thoughts.com +33 6 24 09 17 94
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Thanks for fixing it. On Sun, Aug 2, 2015 at 3:17 AM, Patrick Wendell wrote: > Hey All, > > I got it up and running - it was a newly surfaced bug in the build scripts. > > - Patrick > > On Wed, Jul 29, 2015 at 6:05 AM, Bharath Ravi Kumar > wrote: > > Hey Patrick, > > > > Any update on this front please? > > > > Thanks, > > Bharath > > > > On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell > wrote: > >> > >> Hey Bharath, > >> > >> There was actually an incompatible change to the build process that > >> broke several of the Jenkins builds. This should be patched up in the > >> next day or two and nightly builds will resume. > >> > >> - Patrick > >> > >> On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar > >> wrote: > >> > I noticed the last (1.5) build has a timestamp of 16th July. Have > >> > nightly > >> > builds been discontinued since then? > >> > > >> > Thanks, > >> > Bharath > >> > > >> > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell > >> > wrote: > >> >> > >> >> Hi All, > >> >> > >> >> This week I got around to setting up nightly builds for Spark on > >> >> Jenkins. I'd like feedback on these and if it's going well I can > merge > >> >> the relevant automation scripts into Spark mainline and document it > on > >> >> the website. Right now I'm doing: > >> >> > >> >> 1. SNAPSHOT's of Spark master and release branches published to ASF > >> >> Maven snapshot repo: > >> >> > >> >> > >> >> > >> >> > https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ > >> >> > >> >> These are usable by adding this repository in your build and using a > >> >> snapshot version (e.g. 1.3.2-SNAPSHOT). > >> >> > >> >> 2. Nightly binary package builds and doc builds of master and release > >> >> versions. > >> >> > >> >> http://people.apache.org/~pwendell/spark-nightly/ > >> >> > >> >> These build 4 times per day and are tagged based on commits. > >> >> > >> >> If anyone has feedback on these please let me know. > >> >> > >> >> Thanks! > >> >> - Patrick > >> >> > >> >> - > >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > >> >> For additional commands, e-mail: dev-h...@spark.apache.org > >> >> > >> > > > > > >
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Hey All, I got it up and running - it was a newly surfaced bug in the build scripts. - Patrick On Wed, Jul 29, 2015 at 6:05 AM, Bharath Ravi Kumar wrote: > Hey Patrick, > > Any update on this front please? > > Thanks, > Bharath > > On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell wrote: >> >> Hey Bharath, >> >> There was actually an incompatible change to the build process that >> broke several of the Jenkins builds. This should be patched up in the >> next day or two and nightly builds will resume. >> >> - Patrick >> >> On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar >> wrote: >> > I noticed the last (1.5) build has a timestamp of 16th July. Have >> > nightly >> > builds been discontinued since then? >> > >> > Thanks, >> > Bharath >> > >> > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell >> > wrote: >> >> >> >> Hi All, >> >> >> >> This week I got around to setting up nightly builds for Spark on >> >> Jenkins. I'd like feedback on these and if it's going well I can merge >> >> the relevant automation scripts into Spark mainline and document it on >> >> the website. Right now I'm doing: >> >> >> >> 1. SNAPSHOT's of Spark master and release branches published to ASF >> >> Maven snapshot repo: >> >> >> >> >> >> >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ >> >> >> >> These are usable by adding this repository in your build and using a >> >> snapshot version (e.g. 1.3.2-SNAPSHOT). >> >> >> >> 2. Nightly binary package builds and doc builds of master and release >> >> versions. >> >> >> >> http://people.apache.org/~pwendell/spark-nightly/ >> >> >> >> These build 4 times per day and are tagged based on commits. >> >> >> >> If anyone has feedback on these please let me know. >> >> >> >> Thanks! >> >> - Patrick >> >> >> >> - >> >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> >> For additional commands, e-mail: dev-h...@spark.apache.org >> >> >> > > > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Hey Patrick, Any update on this front please? Thanks, Bharath On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell wrote: > Hey Bharath, > > There was actually an incompatible change to the build process that > broke several of the Jenkins builds. This should be patched up in the > next day or two and nightly builds will resume. > > - Patrick > > On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar > wrote: > > I noticed the last (1.5) build has a timestamp of 16th July. Have nightly > > builds been discontinued since then? > > > > Thanks, > > Bharath > > > > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell > wrote: > >> > >> Hi All, > >> > >> This week I got around to setting up nightly builds for Spark on > >> Jenkins. I'd like feedback on these and if it's going well I can merge > >> the relevant automation scripts into Spark mainline and document it on > >> the website. Right now I'm doing: > >> > >> 1. SNAPSHOT's of Spark master and release branches published to ASF > >> Maven snapshot repo: > >> > >> > >> > https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ > >> > >> These are usable by adding this repository in your build and using a > >> snapshot version (e.g. 1.3.2-SNAPSHOT). > >> > >> 2. Nightly binary package builds and doc builds of master and release > >> versions. > >> > >> http://people.apache.org/~pwendell/spark-nightly/ > >> > >> These build 4 times per day and are tagged based on commits. > >> > >> If anyone has feedback on these please let me know. > >> > >> Thanks! > >> - Patrick > >> > >> - > >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > >> For additional commands, e-mail: dev-h...@spark.apache.org > >> > > >
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Thanks Patrick. I'll await resumption of the master tree's nightly builds. -Bharath On Fri, Jul 24, 2015 at 8:38 PM, Patrick Wendell wrote: > Hey Bharath, > > There was actually an incompatible change to the build process that > broke several of the Jenkins builds. This should be patched up in the > next day or two and nightly builds will resume. > > - Patrick > > On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar > wrote: > > I noticed the last (1.5) build has a timestamp of 16th July. Have nightly > > builds been discontinued since then? > > > > Thanks, > > Bharath > > > > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell > wrote: > >> > >> Hi All, > >> > >> This week I got around to setting up nightly builds for Spark on > >> Jenkins. I'd like feedback on these and if it's going well I can merge > >> the relevant automation scripts into Spark mainline and document it on > >> the website. Right now I'm doing: > >> > >> 1. SNAPSHOT's of Spark master and release branches published to ASF > >> Maven snapshot repo: > >> > >> > >> > https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ > >> > >> These are usable by adding this repository in your build and using a > >> snapshot version (e.g. 1.3.2-SNAPSHOT). > >> > >> 2. Nightly binary package builds and doc builds of master and release > >> versions. > >> > >> http://people.apache.org/~pwendell/spark-nightly/ > >> > >> These build 4 times per day and are tagged based on commits. > >> > >> If anyone has feedback on these please let me know. > >> > >> Thanks! > >> - Patrick > >> > >> - > >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > >> For additional commands, e-mail: dev-h...@spark.apache.org > >> > > >
Re: [ANNOUNCE] Nightly maven and package builds for Spark
Hey Bharath, There was actually an incompatible change to the build process that broke several of the Jenkins builds. This should be patched up in the next day or two and nightly builds will resume. - Patrick On Fri, Jul 24, 2015 at 12:51 AM, Bharath Ravi Kumar wrote: > I noticed the last (1.5) build has a timestamp of 16th July. Have nightly > builds been discontinued since then? > > Thanks, > Bharath > > On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell wrote: >> >> Hi All, >> >> This week I got around to setting up nightly builds for Spark on >> Jenkins. I'd like feedback on these and if it's going well I can merge >> the relevant automation scripts into Spark mainline and document it on >> the website. Right now I'm doing: >> >> 1. SNAPSHOT's of Spark master and release branches published to ASF >> Maven snapshot repo: >> >> >> https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ >> >> These are usable by adding this repository in your build and using a >> snapshot version (e.g. 1.3.2-SNAPSHOT). >> >> 2. Nightly binary package builds and doc builds of master and release >> versions. >> >> http://people.apache.org/~pwendell/spark-nightly/ >> >> These build 4 times per day and are tagged based on commits. >> >> If anyone has feedback on these please let me know. >> >> Thanks! >> - Patrick >> >> - >> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org >> For additional commands, e-mail: dev-h...@spark.apache.org >> > - To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org For additional commands, e-mail: dev-h...@spark.apache.org
Re: [ANNOUNCE] Nightly maven and package builds for Spark
I noticed the last (1.5) build has a timestamp of 16th July. Have nightly builds been discontinued since then? Thanks, Bharath On Sun, May 24, 2015 at 1:11 PM, Patrick Wendell wrote: > Hi All, > > This week I got around to setting up nightly builds for Spark on > Jenkins. I'd like feedback on these and if it's going well I can merge > the relevant automation scripts into Spark mainline and document it on > the website. Right now I'm doing: > > 1. SNAPSHOT's of Spark master and release branches published to ASF > Maven snapshot repo: > > > https://repository.apache.org/content/repositories/snapshots/org/apache/spark/ > > These are usable by adding this repository in your build and using a > snapshot version (e.g. 1.3.2-SNAPSHOT). > > 2. Nightly binary package builds and doc builds of master and release > versions. > > http://people.apache.org/~pwendell/spark-nightly/ > > These build 4 times per day and are tagged based on commits. > > If anyone has feedback on these please let me know. > > Thanks! > - Patrick > > - > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
