Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread sebb
On 14 December 2013 03:13, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Spark > (incubating) version 0.8.1. > > The tag to be voted on is v0.8.1-incubating (commit b87d31d): > https://git-wip-us.apache.org/repos/asf/incubator-spark/repo?p=incubator-spark.git;

Recruit a Champion and Java developers for a new proposal Busilet.

2013-12-14 Thread Neng Geng Huang
Hello community, Please find below a proposal draft wish to submit to the ASF. The proposal is only a draft and persons interesting to this project are welcome to join. I am new here and also need help for the proposal and the further processing. A brief introduction of IDTP, UTID, and Busilet c

Re: [VOTE] Enable Release Checklist Experiment

2013-12-14 Thread Sergio Fernández
On 13/12/13 21:59, Marvin Humphrey wrote: Please vote: [ ] +1 Yes, apply the patch enabling the experiment. [ ] -1 No, do not apply the patch enabling the experiment. +1 -- Sergio Fernández Senior Researcher Knowledge and Media Technologies Salzburg Research Forschungsgesellschaft mbH Jakob-H

Re: [VOTE] Enable Release Checklist Experiment

2013-12-14 Thread Joseph Schaefer
+1 On Dec 13, 2013, at 11:31 PM, Henry Saputra wrote: > So it begins =) > > +1 > > Thanks for leading the effort, Marvin > > - Henry > > > On Fri, Dec 13, 2013 at 12:59 PM, Marvin Humphrey > wrote: >> Greetings, >> >> As the next step in our ongoing efforts to reform the release voting pr

Re: [VOTE] Enable Release Checklist Experiment

2013-12-14 Thread Dave
+1 On Sat, Dec 14, 2013 at 9:11 AM, Joseph Schaefer wrote: > +1 > > On Dec 13, 2013, at 11:31 PM, Henry Saputra > wrote: > > > So it begins =) > > > > +1 > > > > Thanks for leading the effort, Marvin > > > > - Henry > > > > > > On Fri, Dec 13, 2013 at 12:59 PM, Marvin Humphrey > > wrote: > >>

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Henry Saputra
Hi Sebb, thanks for the review. When you said "However they both contain binaries, which is not good." were you talking about the "spark-0.8.1-incubating-bin-* files ? - Henry On Fri, Dec 13, 2013 at 7:13 PM, Patrick Wendell wrote: > Please vote on releasing the following candidate as Apache Sp

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Marvin Humphrey
On Sat, Dec 14, 2013 at 10:37 AM, Henry Saputra wrote: > When you said "However they both contain binaries, which is not good." > were you talking about the "spark-0.8.1-incubating-bin-* files ? There seem to be compiled files in the source archive. marvin@knut:~/spark $ tar -zxf spark-0.8.1-inc

Re: [VOTE] Enable Release Checklist Experiment

2013-12-14 Thread Andy Seaborne
+1 On 14/12/13 14:42, Dave wrote: +1 On Sat, Dec 14, 2013 at 9:11 AM, Joseph Schaefer wrote: +1 On Dec 13, 2013, at 11:31 PM, Henry Saputra wrote: So it begins =) +1 Thanks for leading the effort, Marvin - Henry On Fri, Dec 13, 2013 at 12:59 PM, Marvin Humphrey wrote: Greetings,

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Patrick Wendell
> However they both contain binaries, which is not good. > Third party jars should *not* be included in SCM nor in source releases. These are not binary artifacts containing our project's code. They are our build tool and immediate dependencies that are not published in maven. I've looked around t

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Marvin Humphrey
On Sat, Dec 14, 2013 at 3:43 PM, Patrick Wendell wrote: >> However they both contain binaries, which is not good. >> Third party jars should *not* be included in SCM nor in source releases. > > These are not binary artifacts containing our project's code. They are > our build tool and immediate de

Re: IP Clearance before releasing

2013-12-14 Thread Marvin Humphrey
On Thu, Dec 12, 2013 at 12:20 AM, Upayavira wrote: > We should probably be clear about *who* can relax the rules, because > again this could become a fighting ground amongst 180 of us. Perhaps we can avert potential disputes by blocking graduation rather than releases. Every review item in the f

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Patrick Wendell
Hey Marvin, Is this policy actually written up anywhere (along with best practices on how to deal with this issue if you indeed have third party dependencies)? I'm just asking because I don't see an obvious "fix" for this based on the way Spark is built. Second - this issue was not brought to our

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Joseph Schaefer
The core issue is that what you are currently doing was actually the recommended way of dealing with external dependencies back when maven central didn't exist. We changed course a few years ago based on Roy's complaints about source packages consisting solely of source code. I don't remember

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Marvin Humphrey
On Sat, Dec 14, 2013 at 9:24 PM, Patrick Wendell wrote: > We are planning to do our next major release (Spark 0.9.0) while still > under incubation in the next few weeks. Could I propose that we create > a parallel discussion about how we might re-tool or build process with > the aim towards satis

Re: [VOTE] Release Apache Spark 0.8.0-incubating (rc4)

2013-12-14 Thread Patrick Wendell
Thanks Marvin and Joe, Do you know which other projects/people we might reach out to for institutional knowledge of how this is done? Our specific issue is that while 99% of our dependencies are in maven, there are a small # of dependencies that don't publish anywhere via maven. One solution woul