Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-06 Thread Arun C Murthy
Looks like we are all clear now, I'll create an RC presently. Thanks everyone. Arun On Oct 1, 2013, at 8:59 PM, Arun C Murthy wrote: > Yes, sorry if it wasn't clear. > > As others seem to agree, I think we'll be better getting a protocol/api > stable GA done and then iterating on bugs etc. >

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-02 Thread Colin McCabe
I don't think HADOOP-9972 is a must-do for the next Apache release, whatever version number it ends up having. It's just adding a new API, not changing any existing ones, and it can be done entirely in generic code. (The globber doesn't involve FileSystem or AFS subclasses). My understanding is

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-02 Thread Roman Shaposhnik
On Tue, Oct 1, 2013 at 5:15 PM, Vinod Kumar Vavilapalli wrote: > +1. We should get an RC as soon as possible so that we can get all the > downstream components to sign off. > The earlier the better. On this very note -- would there be any interest in joining efforts with the Bigtop integration a

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-02 Thread Colin McCabe
On Tue, Oct 1, 2013 at 8:59 PM, Arun C Murthy wrote: > Yes, sorry if it wasn't clear. > > As others seem to agree, I think we'll be better getting a protocol/api > stable GA done and then iterating on bugs etc. > > I'm not super worried about HADOOP-9984 since symlinks just made it to > branch-2

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Arun C Murthy
Yes, sorry if it wasn't clear. As others seem to agree, I think we'll be better getting a protocol/api stable GA done and then iterating on bugs etc. I'm not super worried about HADOOP-9984 since symlinks just made it to branch-2.1 recently. Currently we only have 2 blockers: HADOOP-9984 & MAP

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Vinod Kumar Vavilapalli
+1. We should get an RC as soon as possible so that we can get all the downstream components to sign off. The earlier the better. Thanks, +Vinod On Oct 1, 2013, at 4:15 PM, Arun C Murthy wrote: > Guys, > > I took a look at the content in 2.1.2-beta so far, other than the critical > fixes such

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Suresh Srinivas
(This time copying all the lists) I am +1 for naming the new branch 2.2.0. On Tue, Oct 1, 2013 at 4:15 PM, Arun C Murthy wrote: > Guys, > > I took a look at the content in 2.1.2-beta so far, other than the > critical fixes such as HADOOP-9984 (symlinks) and few others in YARN/MR, > there is f

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Suresh Srinivas
I am +1 for naming the new branch 2.2.0. On Tue, Oct 1, 2013 at 4:15 PM, Arun C Murthy wrote: > Guys, > > I took a look at the content in 2.1.2-beta so far, other than the > critical fixes such as HADOOP-9984 (symlinks) and few others in YARN/MR, > there is fairly little content (unit tests fi

Re: 2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Alejandro Abdelnur
Arun, Does this mean that you want to skip a beta release and go straight to GA with the next release? thx On Tue, Oct 1, 2013 at 4:15 PM, Arun C Murthy wrote: > Guys, > > I took a look at the content in 2.1.2-beta so far, other than the > critical fixes such as HADOOP-9984 (symlinks) and fe

2.1.2 (Was: Re: [VOTE] Release Apache Hadoop 2.1.1-beta)

2013-10-01 Thread Arun C Murthy
Guys, I took a look at the content in 2.1.2-beta so far, other than the critical fixes such as HADOOP-9984 (symlinks) and few others in YARN/MR, there is fairly little content (unit tests fixes etc.) Furthermore, it's standing up well in testing too. Plus, the protocols look good for now (I

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-30 Thread Arun C Murthy
Done. On Sep 27, 2013, at 9:07 AM, Robert Kanter wrote: > Hi, > > When will the 2.1.1-beta jars be published in maven so downstream projects > can start using them? I only see 2.1.0-beta. > > thanks > - Robert > > > On Tue, Sep 24, 2013 at 4:24 PM, Zhijie Shen wrote: > >> I've added MAPRE

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-27 Thread Robert Kanter
Hi, When will the 2.1.1-beta jars be published in maven so downstream projects can start using them? I only see 2.1.0-beta. thanks - Robert On Tue, Sep 24, 2013 at 4:24 PM, Zhijie Shen wrote: > I've added MAPREDUCE-5531 to the blocker list. - Zhijie > > > On Tue, Sep 24, 2013 at 3:41 PM, Aru

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Zhijie Shen
I've added MAPREDUCE-5531 to the blocker list. - Zhijie On Tue, Sep 24, 2013 at 3:41 PM, Arun C Murthy wrote: > With 4 +1s (3 binding) and no -1s the vote passes. I'll push it out… I'll > make it clear on the release page, that there are some known issues and > that we will follow up very short

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Arun C Murthy
With 4 +1s (3 binding) and no -1s the vote passes. I'll push it out… I'll make it clear on the release page, that there are some known issues and that we will follow up very shortly with another release. Meanwhile, let's fix the remaining blockers (please mark them as such with Target Version 2

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Vinod Kumar Vavilapalli
I ran through my usual check-list for validating the RC. I only checked the source tarball. - Signatures and message digests all good. I guess because of differences in gpg2's version, the message digest has different text wrapping. Anyways. - The top level full LICENSE, NOTICE and README are g

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Arun C Murthy
I've created 2.1.2-beta release version. Please use that for any *critical* commits on branch-2.1-beta branch. Please be careful, let's keep #commits here very small. thanks, Arun On Sep 24, 2013, at 2:07 PM, Andrew Wang wrote: > Hey Arun, > > That plan sounds good to me, thanks for being on

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Roman Shaposhnik
On Tue, Sep 24, 2013 at 1:39 PM, Arun C Murthy wrote: > Rather than spin another RC, let's get this out and follow up with the next > release - especially since it's not clear how long it will take for the > symlink stuff to sort itself out. > > Getting this out will help downstream projects, eve

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Arun C Murthy
Rather than spin another RC, let's get this out and follow up with the next release - especially since it's not clear how long it will take for the symlink stuff to sort itself out. Getting this out will help downstream projects, even if it does so in small way. Arun On Sep 23, 2013, at 5:36 P

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Chris Nauroth
Update: HDFS-5228 has been resolved. It was committed to branch-2.1-beta, so I think there was an assumption that this would warrant a new RC. (If that's not the case, then we ought to pull HDFS-5228 back out of branch-2.1-beta to avoid confusion.) Chris Nauroth Hortonworks http://hortonworks.co

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-24 Thread Alejandro Abdelnur
ping On Tue, Sep 24, 2013 at 2:36 AM, Alejandro Abdelnur wrote: > Vote for the 2.1.1-beta release is closing tonight, while we had quite a > few +1s, it seems we need to address the following before doing a release: > > symlink discussion: get a concrete and explicit understanding on what we > w

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-23 Thread Alejandro Abdelnur
Vote for the 2.1.1-beta release is closing tonight, while we had quite a few +1s, it seems we need to address the following before doing a release: symlink discussion: get a concrete and explicit understanding on what we will do and in what release(s). Also, the following JIRAs seem nasty enough

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-23 Thread Suresh Srinivas
+1 (binding) Verified the signatures and hashes for both src and binary tars. Built from the source, the binary distribution and the documentation. Started a single node cluster and tested the following: # Started HDFS cluster, verified the hdfs CLI commands such ls, copying data back and forth,

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-23 Thread Alejandro Abdelnur
Are we doing a new RC for 2.1.1-beta? On Mon, Sep 23, 2013 at 9:04 PM, Vinod Kumar Vavilapalli wrote: > Correct me if I am wrong, but FWIU, we already released a beta with the > same symlink issues. Given 2.1.1 is just another beta, I believe we can go > ahead with it and resolve the issues in

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-23 Thread Vinod Kumar Vavilapalli
Correct me if I am wrong, but FWIU, we already released a beta with the same symlink issues. Given 2.1.1 is just another beta, I believe we can go ahead with it and resolve the issues in the final GA release. Instead of resetting the testing done by everyone. It's a hard story to sell but beta

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-22 Thread Roman Shaposhnik
On Mon, Sep 16, 2013 at 11:38 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would > like to get > released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as > a result of significant amounts of testing. > > If things

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-19 Thread Chris Nauroth
I suspect that HDFS-5228 needs to be a blocker for the RC, considering the impact on client code. Existing working client code can now get a NullPointerException as a result of this bug. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Sep 18, 2013 at 3:41 PM, Roman Shaposhnik wrote:

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-18 Thread Roman Shaposhnik
On Tue, Sep 17, 2013 at 9:58 PM, Roman Shaposhnik wrote: > I'm also running the tests on fully distributed clusters in Bigtop -- > will report the findings tomorrow. The first result of my test run is this: https://issues.apache.org/jira/browse/HDFS-5225 Not sure it it qualifies as a blocker

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-18 Thread Alejandro Abdelnur
On Wed, Sep 18, 2013 at 12:03 AM, Karthik Kambatla wrote: > Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to > have a single version of avro. > > It depends if there is a known and non-workaroundable issue at runtime because of this. If not I wouldn't say it is a blocker.

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Roman Shaposhnik
On Mon, Sep 16, 2013 at 11:38 PM, Arun C Murthy wrote: > Folks, > > I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would > like to get > released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as > a result of significant amounts of testing. > > If things

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Karthik Kambatla
Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to have a single version of avro. On Tue, Sep 17, 2013 at 6:51 AM, Andrew Wang wrote: > Hey all, > > Sorry to hijack the vote thread, but it'd be good to get some input on my > email from yesterday re: symlink support in branc

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Alejandro Abdelnur
Thanks Arun. +1 * Downloaded source tarball. * Verified MD5 * Verified signature * run apache-rat:check ok after minor tweak (see NIT1 below) * checked CHANGES.txt headers (see NIT2 below) * built DIST from source * verified hadoop version of Hadoop JARs * configured pseudo cluster * tested HttpF

[VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-16 Thread Arun C Murthy
Folks, I've created a release candidate (rc0) for hadoop-2.1.1-beta that I would like to get released - this release fixes a number of bugs on top of hadoop-2.1.0-beta as a result of significant amounts of testing. If things go well, this might be the last of the *beta* releases of hadoop-2.x.