Re: [VOTE] Release Apache Hadoop 2.7.0 RC0

2015-04-11 Thread Arun Murthy
+1 (binding) Arun On Fri, Apr 10, 2015 at 4:44 PM -0700, Vinod Kumar Vavilapalli vino...@apache.orgmailto:vino...@apache.org wrote: Hi all, I've created a release candidate RC0 for Apache Hadoop 2.7.0. The RC is available at: http://people.apache.org/~vinodkv/hadoop-2.7.0-RC0/ The RC

Re: Hadoop 3.x: what about shipping trunk as a 2.x release in 2015?

2015-03-09 Thread Arun Murthy
Steve, From: Steve Loughran ste...@hortonworks.com Sent: Monday, March 09, 2015 2:15 PM To: mapreduce-...@hadoop.apache.org; hdfs-...@hadoop.apache.org; common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org Subject: Hadoop 3.x: what about shipping

Hadoop - Major releases

2015-03-09 Thread Arun Murthy
Over the last few days, we have had lots of discussions that have intertwined several major themes: # When/why do we make major Hadoop releases? # When/how do we move to major JDK versions? # To a lesser extent, we have debated another theme: what do we do about trunk? For now, let's park

Re: Looking to a Hadoop 3 release

2015-03-03 Thread Arun Murthy
Awesome, looks like we can just do this in a compatible manner - nothing else on the list seems like it warrants a (premature) major release. Thanks Vinod. Arun From: Vinod Kumar Vavilapalli vino...@hortonworks.com Sent: Tuesday, March 03, 2015 2:30 PM

Re: Looking to a Hadoop 3 release

2015-03-02 Thread Arun Murthy
Andrew, Thanks for bringing up this discussion. I'm a little puzzled for I feel like we are rehashing the same discussion from last year - where we agreed on a different course of action w.r.t switch to JDK7. IAC, breaking compatibility for hadoop-3 is a pretty big cost - particularly for

Re: 2.7 status

2015-03-01 Thread Arun Murthy
Sounds good, thanks for the help Vinod! Arun From: Vinod Kumar Vavilapalli Sent: Sunday, March 01, 2015 11:43 AM To: Hadoop Common; Jason Lowe; Arun Murthy Subject: Re: 2.7 status Agreed. How about we roll an RC end of this week? As a Java 7+ release

Re: 2.7 status

2015-02-13 Thread Arun Murthy
My bad, been sorted distracted. I agree, we should just roll fwd a 2.7 ASAP with all the goodies. What sort of timing makes sense? 2 week hence? thanks, Arun From: Jason Lowe jl...@yahoo-inc.com.INVALID Sent: Friday, February 13, 2015 8:11 AM To:

Thinking ahead to hadoop-2.7

2014-12-01 Thread Arun Murthy
Folks, With hadoop-2.6 out it's time to think ahead. As we've discussed in the past, 2.6 was the last release which supports JDK6. I'm thinking it's best to try get 2.7 out in a few weeks (maybe by the holidays) with just the switch to JDK7 (HADOOP-10530) and possibly support for JDK-1.8 (as a

Re: [VOTE] Release Apache Hadoop 2.6.0

2014-11-10 Thread Arun Murthy
Duh! $ chmod a+r * Please try now. Thanks! Arun On Mon, Nov 10, 2014 at 7:06 PM, Tsuyoshi OZAWA ozawa.tsuyo...@gmail.com wrote: Hi Arun, Could you confirm the link and permission to the files is correct? I got a following error: Forbidden You don't have permission to access

Re: In hindsight... Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Sorry, coming to discussion late. We all agreed that 2.6 would the *last* release supporting JDK6 and hadoop-2.7 would drop support for JDK6. We could easily do 2.7 right after 2.6 (maybe with few critical bug-fixes) with the defining feature of 2.7 being *JDK7 only*. I've checked with HBase, Pig

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Looks like most of the content is in and hadoop-2.6 is shaping up nicely. I'll create branch-2.6 by end of the week and we can go from there to stabilize it - hopefully in the next few weeks. Thoughts? thanks, Arun On Tue, Aug 12, 2014 at 1:34 PM, Arun C Murthy a...@hortonworks.com wrote:

Re: Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-20 Thread Arun Murthy
, Alejandro Abdelnur t...@cloudera.com wrote: agree with Steve, lets do a 2.5.1 just with those txt files. On Tue, Aug 19, 2014 at 2:29 PM, Steve Loughran ste...@hortonworks.com wrote: On 19 August 2014 18:35, Arun Murthy a...@hortonworks.com wrote: I suggest we do a 2.5.1

Re: Apache Hadoop 2.5.0 published tarballs are missing some txt files

2014-08-19 Thread Arun Murthy
I suggest we do a 2.5.1 (with potentially other bug fixes) rather than fix existing tarballs. thanks, Arun On Mon, Aug 18, 2014 at 12:42 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi devs Tsuyoshi just brought it to my notice that the published tarballs don't have LICENSE, NOTICE and

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-12 Thread Arun Murthy
We don't involve press@ typically... Arun On Aug 12, 2014, at 4:22 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks Steve for pointing me to press@. I hadn't realized we need to include them. Just sent an email. On Tue, Aug 12, 2014 at 9:39 AM, Steve Loughran ste...@hortonworks.com

Re: Moving to JDK7, JDK8 and new major releases

2014-06-24 Thread Arun Murthy
Alejandro, On Tue, Jun 24, 2014 at 4:44 PM, Alejandro Abdelnur t...@cloudera.com wrote: After reading this thread and thinking a bit about it, I think it should be OK such move up to JDK7 in Hadoop 2 for the following reasons: * Existing Hadoop 2 releases and related projects are running

Re: [DISCUSS] Change by-laws on release votes: 5 days instead of 7

2014-06-23 Thread Arun Murthy
Thanks everyone. I'll start a vote tmrw if there are no objections. Arun On Mon, Jun 23, 2014 at 12:06 PM, Jitendra Pandey jiten...@hortonworks.com wrote: +1, sounds good! On Mon, Jun 23, 2014 at 12:02 PM, Andrew Wang andrew.w...@cloudera.com wrote: +1 here as well, let's do a vote

Re: hadoop-2.4.1

2014-05-20 Thread Arun Murthy
Akira, Waiting for one more issue, stay tuned. thanks, Arun On Mon, May 19, 2014 at 11:40 PM, Akira AJISAKA ajisa...@oss.nttdata.co.jpwrote: Hi Arun, I'd like to know when to release Hadoop 2.4.1. It looks like all of the blockers have been resolved. Thanks, Akira (2014/04/24

Re-swizzle 2.3

2014-01-23 Thread Arun Murthy
Based on the discussion at common-dev@, we've decided to target 2.3 off the tip of branch-2 based on the 2 major HDFS features which are Heterogenous Storage (HDFS-2832) and HDFS Cache (HDFS-4949). I'll create a new branch-2.3 on (1/24) at 6pm PST. thanks, Arun -- CONFIDENTIALITY NOTICE

Re: Logistics for releasing 2.4

2014-01-22 Thread Arun Murthy
Thanks Vinod. I'll start the work to re-spin 2.3 by changing jira numbers, CHANGES.txt etc. now. Arun On Wed, Jan 22, 2014 at 5:59 PM, Vinod Kumar Vavilapalli vino...@apache.org wrote: On Jan 22, 2014, at 5:36 PM, Arun C Murthy a...@hortonworks.com wrote: Agree 2.3 is now very stale.

Re: Logistics for releasing 2.4

2014-01-22 Thread Arun Murthy
Sounds good, thanks. I'll ping you off-thread. Arun On Wed, Jan 22, 2014 at 6:01 PM, Andrew Wang andrew.w...@cloudera.comwrote: Hi Arun, thanks for the reply. I hope that I've come across as an earnest and motivated contributor who wants to help make high-quality releases. Volunteering

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-16 Thread Arun Murthy
That makes sense too. On Aug 16, 2013, at 10:39 AM, Vinod Kumar Vavilapalli vino...@hortonworks.com wrote: We need to make a call on what blockers will be. From my limited understanding, this doesn't seem like a API or a compatibility issue. Can we not fix it in subsequent bug-fix

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-10 Thread Arun Murthy
Ok, I'll spin rc1 after. Thanks. Sent from my iPhone On Apr 10, 2013, at 11:44 AM, Siddharth Seth seth.siddha...@gmail.com wrote: Arun, MAPREDUCE-5094 would be a useful jira to include in the 2.0.4-alpha release. It's not an absolute blocker since the values can be controlled explicitly by

Re: Branch for Hadoop on Windows

2012-06-21 Thread Arun Murthy
Sounds great, I'll create the branch for you. Thanks for the your efforts on this so far! On Thu, Jun 21, 2012 at 4:58 PM, Bikas Saha bi...@hortonworks.com wrote: Hi, branch-1-win was created to stage the work needed to make Hadoop run natively on Windows. There has been great progress on it

Re: hadoop 23.0 contents

2012-01-11 Thread Arun Murthy
Eli, I'd check against the svn tag which corresponds to the release... I'm traveling right now, let get back in a bit. thanks, Arun Sent from my iPhone On Jan 10, 2012, at 9:55 PM, Eli Collins e...@cloudera.com wrote: Hey Arun, Was looking at the 23.0 release bits and noticed that the

Re: how to check which scheduler is currently running on hadoop

2011-12-01 Thread Arun Murthy
Depending on the version of Hadoop you are using, you can goto http://jthost:50030/scheduler to check. This will work from hadoop-0.20.203 onwards. Arun Sent from my iPhone On Nov 30, 2011, at 5:38 PM, shivam tiwari shivam.tiwari2...@gmail.com wrote: Hi, please tell me how I can check

Re: Hadoop + MPI

2011-11-23 Thread Arun Murthy
Awesome, thanks to both you guys! It's very exciting to see this progress! Arun Sent from my iPhone On Nov 23, 2011, at 5:14 PM, Ralph Castain r...@open-mpi.org wrote: FWIW: I can commit the OMPI part of your patch for you. The CCLA is intended to ensure that people realize the need to

Re: [ANNOUNCE] Intend to build a 0.20.205.1 candidate next Friday 11 Nov.

2011-11-23 Thread Arun Murthy
On Nov 23, 2011, at 5:32 PM, Roman Shaposhnik r...@apache.org wrote: Hi Matt, quick question: any reason we are ignoring multifilewc from hadoop examples? Roman - It isn't marked as a blocker nor is there a patch. Can you provide one? Arun

Re: 0.21 stable schedule?

2011-11-14 Thread Arun Murthy
Tim, It's highly unlikely you'll see a stable 0.21 at this point. You can ask for a backport to 0.20.2xx (pls open a jira, better yet, a patch :) ) or consider trying hadoop-0.23 which we just released. Fair warning: 0.23 is very much 'alpha' quality currently. thanks, Arun Sent from my iPhone

Re: how to pass a hdfs file to a c++ process

2011-08-23 Thread Arun Murthy
That is a normal use case. I'd encourage you to use Java MR (even pig/hive). If you really want to use your legacy app use streaming with a map cmd such as 'hadoop fs -cat file | mylegacyexe' Arun Sent from my iPhone On Aug 23, 2011, at 8:00 AM, Zhixuan Zhu z...@calpont.com wrote: I'll