Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-23 Thread Arun C Murthy
On May 15, 2012, at 7:20 PM, Arun C Murthy wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/ The maven artifacts are available via repository.apache.org.

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-23 Thread Matt Foley
On Wed, May 23, 2012 at 10:22 AM, Arun C Murthy a...@hortonworks.com wrote: On May 15, 2012, at 7:20 PM, Arun C Murthy wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at:

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-22 Thread sanjay Radia
+1, downloaded, tried a few things on a one node cluster. sanjay On May 15, 2012, at 7:20 PM, Arun C Murthy wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-22 Thread Suresh Srinivas
+1. Verified with HDFS and MR validation tests and on a single node cluster. On Tue, May 15, 2012 at 7:20 PM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at:

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-22 Thread Ahmed Radwan
+1 Downloaded the tarball and tested MapReduce and Distributed Shell jobs on a single node cluster. Everything works fine. On Tue, May 15, 2012 at 7:20 PM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-22 Thread Tsz Wo (Nicholas), Sze
+1 verified all signatures and message digests. Tsz-Wo From: Arun C Murthy a...@hortonworks.com To: general@hadoop.apache.org Sent: Tuesday, May 15, 2012 7:20 PM Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1 I've created a release candidate (rc1) for hadoop

RE: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Devaraj k
@hadoop.apache.org Cc: Arun C Murthy Subject: Re: [VOTE] Release hadoop-2.0.0-alpha-rc1 +1 Downloaded and verified basic sanity. On Thu, May 17, 2012 at 8:16 AM, Thomas Graves tgra...@yahoo-inc.comwrote: +1, src tarball contents look good, builds, and ran some jobs on a single node cluster using both built

RE: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Uma Maheswara Rao G
+1, Downloaded and verified HDFS tests and small MR job.. Thanks a lot Arun. Thanks Regards, Uma From: Arun C Murthy [a...@hortonworks.com] Sent: Wednesday, May 16, 2012 7:50 AM To: general@hadoop.apache.org Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Matt Foley
Regards, Uma From: Arun C Murthy [a...@hortonworks.com] Sent: Wednesday, May 16, 2012 7:50 AM To: general@hadoop.apache.org Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1 I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Mahadev Konar
7:50 AM To: general@hadoop.apache.org Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1 I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/ The maven artifacts are available

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Devaraj Das
, May 16, 2012 7:50 AM To: general@hadoop.apache.org Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1 I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/ The maven

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-21 Thread Siddharth Seth
and small MR job.. Thanks a lot Arun. Thanks Regards, Uma From: Arun C Murthy [a...@hortonworks.com] Sent: Wednesday, May 16, 2012 7:50 AM To: general@hadoop.apache.org Subject: [VOTE] Release hadoop-2.0.0-alpha-rc1 I've created

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-17 Thread Thomas Graves
+1, src tarball contents look good, builds, and ran some jobs on a single node cluster using both built from source and binary. Thanks, Tom On 5/15/12 9:20 PM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-17 Thread Roman Shaposhnik
On Thu, May 17, 2012 at 8:16 AM, Thomas Graves tgra...@yahoo-inc.com wrote: +1, src tarball contents look good, builds, and ran some jobs on a single node cluster using both built from source and binary. +1 based on the Bigtop 0.4.0-SNAPSHOT test results. There were a couple of Mahout

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-17 Thread Jitendra Pandey
+1 Downloaded and verified basic sanity. On Thu, May 17, 2012 at 8:16 AM, Thomas Graves tgra...@yahoo-inc.comwrote: +1, src tarball contents look good, builds, and ran some jobs on a single node cluster using both built from source and binary. Thanks, Tom On 5/15/12 9:20 PM, Arun C

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-16 Thread Todd Lipcon
OK, the fixes to CHANGES.txt and JIRA are complete. Sorry for the mail bomb ;-) -Todd On Tue, May 15, 2012 at 10:30 PM, Todd Lipcon t...@cloudera.com wrote: Thanks for posting the new RC. Will take a look tomorrow. Meanwhile, I'm going through CHANGES.txt and JIRA and moving things that didn't

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-16 Thread Steve Loughran
On 15 May 2012 19:20, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/ The maven artifacts are available via

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Kumar Ravi
Subject:Re: [VOTE] Release hadoop-2.0.0-alpha Hey Arun, One more thing on the rc tarball: the source artifact

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Todd Lipcon
: Todd Lipcon t...@cloudera.com To: general@hadoop.apache.org Date: 05/14/2012 11:21 PM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha -- Hey Arun, One more thing on the rc tarball: the source artifact doesn't appear to be an exact svn

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Arun C Murthy
: Sent: Monday, May 14, 2012 11:07 AM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366. Thanks. Tsz-Wo - Original Message - From: Uma Maheswara Rao G mahesw...@huawei.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Arun C Murthy
- From: Tsz Wo Sze szets...@yahoo.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 11:07 AM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366. Thanks. Tsz-Wo - Original Message - From: Uma

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Todd Lipcon
(without it, 2.0.0-alphaand 2.0.0 will be incompatible.) Tsz-Wo - Original Message - From: Tsz Wo Sze szets...@yahoo.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 11:07 AM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-15 Thread Eli Collins
Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366.  Thanks. Tsz-Wo - Original Message - From: Uma Maheswara Rao G mahesw...@huawei.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 10:56 AM Subject

[VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-15 Thread Arun C Murthy
I've created a release candidate (rc1) for hadoop-2.0.0-alpha that I would like to release. It is available at: http://people.apache.org/~acmurthy/hadoop-2.0.0-alpha-rc1/ The maven artifacts are available via repository.apache.org. Please try the release and vote; the vote will run for the

Re: [VOTE] Release hadoop-2.0.0-alpha-rc1

2012-05-15 Thread Todd Lipcon
Thanks for posting the new RC. Will take a look tomorrow. Meanwhile, I'm going through CHANGES.txt and JIRA and moving things that didn't make the 2.0.0 cut to 2.0.1. So, if folks commit things tomorrow, please check to put it in the right spot in CHANGES.txt and in JIRA. I'll take care of

RE: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Uma Maheswara Rao G
From: Arun C Murthy [a...@hortonworks.com] Sent: Monday, May 14, 2012 10:24 PM To: general@hadoop.apache.org Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Todd, Please go ahead and merge changes into branch-2.0.0-alpha and I'll roll RC1. thanks, Arun On May 12, 2012, at 10:05 PM, Todd Lipcon

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Arun C Murthy
10:56 AM Subject: RE: [VOTE] Release hadoop-2.0.0-alpha a) Revert HDFS-3157 and commit HADOOP-8285 and HADOOP-8366 on branch-2.0.0-alpha, so these are the only changes since rc0. Roll a new rc1 from here. I have merged HDFS-3157 revert. Do you mind taking a look at HADOOP-8285 and HADOOP-8366

RE: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Uma Maheswara Rao G
Great! Thanks a lot Nicholas! From: Tsz Wo Sze [szets...@yahoo.com] Sent: Monday, May 14, 2012 11:37 PM To: general@hadoop.apache.org Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366. Thanks. Tsz-Wo - Original

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Eli Collins
(without it, 2.0.0-alphaand 2.0.0 will be incompatible.) Tsz-Wo - Original Message - From: Tsz Wo Sze szets...@yahoo.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 11:07 AM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Siddharth Seth
hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366. Thanks. Tsz-Wo - Original Message - From: Uma Maheswara Rao G mahesw...@huawei.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 10:56 AM Subject: RE: [VOTE] Release

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-14 Thread Todd Lipcon
Message - From: Tsz Wo Sze szets...@yahoo.com To: general@hadoop.apache.org general@hadoop.apache.org Cc: Sent: Monday, May 14, 2012 11:07 AM Subject: Re: [VOTE] Release hadoop-2.0.0-alpha Let me merge HADOOP-8285 and HADOOP-8366.  Thanks. Tsz-Wo - Original Message

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-12 Thread Todd Lipcon
Looking at the release tag vs the current state of branch-2, I have two concerns from the point of view of HDFS: 1) We reverted HDFS-3157 in branch-2 because it sends deletions for corrupt replicas without properly going through the corrupt block path. We saw this cause data loss in

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-11 Thread Eli Collins
+1 I installed the build on a 6 node cluster and kicked the tires, didn't find any blocking issues. Btw in the future better to build from the svn repo so the revision is an svn rev from the release branch. Eg 1336254 instead of 40e90d3c7 which is from the git mirror, this way we're consistent

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-10 Thread Andrew Purtell
Hi Todd, Have you seen the new MiniMRClientCluster class? It's meant to be what you describe - a minicluster which only exposes external APIs -- most importantly a way of getting at a JobClient to submit jobs. We have it implemented in both 1.x and 2.x at this point, though I don't recall if

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-10 Thread Andrew Purtell
Let's take one basic case, how does one find the address of the job tracker in a version agnostic way? Pardon, I should also have included the other half of that particular problem: How does one set the address of the job tracker in a version agnostic way? Configuration conf =

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Eli Collins
Arun, Awesome, thanks for working on this. I'll definitely kick the tires. Noticed the mvn version is 2.0.0-alpha, should we make it 2.0.0-alpha1 in case we need to roll multiple alpha releases? Thanks, Eli On Wed, May 9, 2012 at 9:58 AM, Arun C Murthy a...@hortonworks.com wrote: I've created

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Andrew Purtell
-1 (nonbinding), we are currently facing a minicluster semantic change of some kind, or more than one: https://issues.apache.org/jira/browse/HBASE-5966 There are other HBase JIRAs related to 2.0.0-alpha that we are working on, but I'd claim those are all our fault for breaking abstractions

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Robert Evans
+1 I downloaded it and run a few simple tests wordcount etc. on a single node cluster with no security. --Bobby Evans On 5/9/12 11:58 AM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate for hadoop-2.0.0-alpha that I would like to release. It is available at:

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Arun C Murthy
On May 9, 2012, at 10:05 AM, Eli Collins wrote: Arun, Awesome, thanks for working on this. I'll definitely kick the tires. Noticed the mvn version is 2.0.0-alpha, should we make it 2.0.0-alpha1 in case we need to roll multiple alpha releases? I was thinking 2.0.1-alpha, or

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Andrew Purtell
Sounds good Arun. How should we consider the suitability and stability of MiniMRCluster for downstream projects? On Wed, May 9, 2012 at 11:30 AM, Arun C Murthy a...@hortonworks.com wrote: No worries Andy. I can spin an rc1 once we can pin-point the bug. thanks, Arun On May 9, 2012, at

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Suresh Srinivas
For this reason, in HDFS, we change MiniDFSCluster to LimitedPrivate and not treat it as such: @InterfaceAudience.LimitedPrivate({HBase, HDFS, Hive, MapReduce, Pig}) @InterfaceStability.Unstable public class MiniDFSCluster { ...} On Wed, May 9, 2012 at 11:33 AM, Andrew Purtell

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Ahmed Radwan
+1 (non-binding) Downloaded the tarball and ran example mr jobs on a single node cluster, also tried distributed shell jobs. Best Regards Ahmed On Wed, May 9, 2012 at 9:58 AM, Arun C Murthy a...@hortonworks.com wrote: I've created a release candidate for hadoop-2.0.0-alpha that I would like to

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Andrew Purtell
Hi Suresh, The unstable designation makes sense. As would one for MiniMRCluster. I was over the top initially to surprise. I'm sure the MR minicluster seems a minor detail. Maybe it's worth thinking about the miniclusters differently? Please pardon if I am rehashing an old discussion.

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Todd Lipcon
Hi Andrew, Have you seen the new MiniMRClientCluster class? It's meant to be what you describe - a minicluster which only exposes external APIs -- most importantly a way of getting at a JobClient to submit jobs. We have it implemented in both 1.x and 2.x at this point, though I don't recall if

Re: [VOTE] Release hadoop-2.0.0-alpha

2012-05-09 Thread Eli Collins
On Wed, May 9, 2012 at 11:28 AM, Arun C Murthy a...@hortonworks.com wrote: On May 9, 2012, at 10:05 AM, Eli Collins wrote: Arun, Awesome, thanks for working on this. I'll definitely kick the tires. Noticed the mvn version is 2.0.0-alpha, should we make it 2.0.0-alpha1 in case we need to