hadoop-2.1.1-beta & hadoop-2.2.0 (GA)

2013-08-16 Thread Arun C Murthy
Gang, I spent time looking through changes slated for hadoop-2.1.1-beta and things look fairly contained (~10 or so changes for each of Common, HDFS, YARN & MapReduce). Can I, henceforth, request committers to exercise large dollops of caution when committing to branch-2.1-beta? This way I h

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
Yep, there are quite a number of such fixes in 2.1.1 ATM, I think it will serve us better to get 2.1.0 out and then quickly turn around to make 2.1.1. My current plan is to start work on 2.1.1 right after this release gets complete… hopefully next week. thanks, Arun On Aug 16, 2013, at 4:36 PM

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
There are other such isolated and well understood bug-fixes that we pushed to 2.1.1 in the interesting of making progress with 2.1.0 and the corresponding API changes. 2.1.1 should happen soon enough after this. Thanks, +Vinod On Aug 16, 2013, at 4:22 PM, Roman Shaposhnik wrote: > What are t

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Roman Shaposhnik
What are the downsides of getting this fix into the 2.1? It appears that the fix is pretty isolated and well understood. Thoughts? Thanks, Roman. On Fri, Aug 16, 2013 at 3:04 PM, Kihwal Lee wrote: > I've changed the target version of HADOOP-9880 to 2.1.1. Please change it > back, if you feel

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
I've changed the target version of HADOOP-9880 to 2.1.1.  Please change it back, if you feel that it needs to be in 2.1.0-beta. Kihwal From: Kihwal Lee To: Arun Murthy ; "common-...@hadoop.apache.org" Cc: "mapreduce-dev@hadoop.apache.org" ; "hdfs-...@hado

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
It's your call, Arun.  I.e. as long you believe rc2 meets the expectations and objectives of 2.1.0-beta. Kihwal From: Arun Murthy To: "common-...@hadoop.apache.org" Cc: Kihwal Lee ; "mapreduce-dev@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "yarn-.

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun Murthy
That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli wrote: > > We need to make a call on what blockers will be. From my limited > understanding, this doesn't seem like a API or a compatibility issue. Can we > not fix it in subsequent bug-fix releases? > > I do see a lo

Re: Proxying FileSystem.get()

2013-08-16 Thread Jay Vyas
Well I want the method calls to be wrapped dynamically, rather than individually wrapping each one of them and manually wrapping the calls. That way the Wrapping file system can be used with any underlying FileSystem base from any version . If manually wrapping the underlying FileSystem, then und

Re: Proxying FileSystem.get()

2013-08-16 Thread Vinod Kumar Vavilapalli
Not sure about your final intention, but a new FileSystem impl wrapping/composing the underlying file system should work. No? Thanks, +Vinod On Aug 16, 2013, at 11:08 AM, Jay Vyas wrote: > Hi mapred: > > I'd like to proxy calls made to the FileSystem's created during mapreduce > jobs. > > How

Proxying FileSystem.get()

2013-08-16 Thread Jay Vyas
Hi mapred: I'd like to proxy calls made to the FileSystem's created during mapreduce jobs. However, since the common way jobs work is to use the FileSystem.get(..), it doesnt seem like an InvocationHandler will be a solution (because it requires use of the Proxy.newInstance operation). Any good

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Vinod Kumar Vavilapalli
We need to make a call on what blockers will be. From my limited understanding, this doesn't seem like a API or a compatibility issue. Can we not fix it in subsequent bug-fix releases? I do see a lot of follow up releases to 2.1.0. Getting this release out will help downstream projects start t

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

2013-08-16 Thread Steve Loughran
On 16 August 2013 02:50, Jun Ping Du wrote: > Hi Tsuyoshi, >I just checked Hadoop wiki on HowToContribute and it points > ProtocolBuffer things to YARN Readme which is already updated to 2.5.0 now. > > Thanks, > > Junping > > I remember spending time on that page trying to document protobuf,

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun C Murthy
Ok, I'll spin RC3. Can you please help get this in asap? Thanks, much appreciated! Arun On Aug 16, 2013, at 10:13 AM, Kihwal Lee wrote: > We have found HADOOP-9880, which prevents Namenode HA from running with > security. > > > > Kihwal > > > > From: Arun

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-...@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-dev@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thurs

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Kihwal Lee
We have found HADOOP-9880, which prevents Namenode HA from running with security. Kihwal From: Arun C Murthy To: "common-...@hadoop.apache.org" ; "hdfs-...@hadoop.apache.org" ; "mapreduce-dev@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" Sent: Thursda

Hadoop-Mapreduce-trunk - Build # 1520 - Still Failing

2013-08-16 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1520/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 31878 lines...] Running org.apache.hadoop.mapreduce.

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

2013-08-16 Thread Jun Ping Du
Hi Tsuyoshi, I just checked Hadoop wiki on HowToContribute and it points ProtocolBuffer things to YARN Readme which is already updated to 2.5.0 now. Thanks, Junping - Original Message - From: "Tsuyoshi OZAWA" To: hdfs-...@hadoop.apache.org Cc: common-...@hadoop.apache.org, yarn-...@