[jira] [Created] (MAPREDUCE-6105) Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percent

2014-09-23 Thread Dongwook Kwon (JIRA)
Dongwook Kwon created MAPREDUCE-6105: Summary: Inconsistent configuration in property mapreduce.reduce.shuffle.merge.percent Key: MAPREDUCE-6105 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6105

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Tsz Wo (Nicholas), Sze
Hi, I am worry about KMS and transparent encryption since there are quite many bugs discovered after it got merged to branch-2. It gives us an impression that the feature is not yet well tested. Indeed, transparent encryption is a complicated feature which changes the core part of HDFS. It i

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Sangjin Lee
I am also +1 for the end of next week. YARN-1492 (shared cache) is near the final stages of the review, and with a little more time it would make it easier to put it in. On Tue, Sep 23, 2014 at 4:48 PM, Subramaniam V K wrote: > +1 for end of next week. > > We have got all the patches for YARN-10

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Subramaniam V K
+1 for end of next week. We have got all the patches for YARN-1051 committed to the branch. We are currently fixing test-patch & plan to call a merge vote soon. Hopefully it will go through by end of next week. Thanks, Subru On Tue, Sep 23, 2014 at 4:31 PM, Karthik Kambatla wrote: > Looking at

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Karthik Kambatla
Looking at the patches, we might be able to get most of YARN-1492 in by the end of next week. There would be a couple of security items still remaining, but we can may be call the feature alpha-ready without them. On Tue, Sep 23, 2014 at 4:25 PM, Chris Trezzo wrote: > I would like to see the sha

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Andrew Wang
I think we should delay cutting the branch beyond the end of the week then, seeing as the HDFS-6581 merge vote (assuming it goes through) doesn't close until 12am on Tuesday next week. Archival storage is also still finishing up user APIs and I had a few other q's posted on HDFS-7081, so again migh

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Chris Trezzo
I would like to see the shared cache (YARN-1492) make it in as well. We are going through the final review process (with Karthik and Vinod) and should be fairly close to complete. This is another feature that has been under development for a while. Thanks, Chris On Tue, Sep 23, 2014 at 4:00 PM, S

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Suresh Srinivas
I actually would like to see both archival storage and single replica memory writes to be in 2.6 release. Archival storage is in the final stages of getting ready for branch-2 merge as Nicholas has already indicated on the dev mailing list. Hopefully HDFS-6581 gets ready sooner. Both of these featu

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Andrew Wang
Hey Arun, Maybe we could do a quick run through of the Roadmap wiki and add/retarget things accordingly? I think the KMS and transparent encryption are ready to go. We've got a very few further bug fixes pending, but that's it. Two HDFS things that I think probably won't make the end of the week

Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Looks like most of the content is in and hadoop-2.6 is shaping up nicely. I'll create branch-2.6 by end of the week and we can go from there to stabilize it - hopefully in the next few weeks. Thoughts? thanks, Arun On Tue, Aug 12, 2014 at 1:34 PM, Arun C Murthy wrote: > Folks, > > With hadoo

Re: In hindsight... Re: Thinking ahead to hadoop-2.6

2014-09-23 Thread Arun Murthy
Sorry, coming to discussion late. We all agreed that 2.6 would the *last* release supporting JDK6 and hadoop-2.7 would drop support for JDK6. We could easily do 2.7 right after 2.6 (maybe with few critical bug-fixes) with the defining feature of 2.7 being *JDK7 only*. I've checked with HBase, Pig

[jira] [Created] (MAPREDUCE-6104) TestJobHistoryParsing.testPartialJob fails in branch-2

2014-09-23 Thread Mit Desai (JIRA)
Mit Desai created MAPREDUCE-6104: Summary: TestJobHistoryParsing.testPartialJob fails in branch-2 Key: MAPREDUCE-6104 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6104 Project: Hadoop Map/Reduc

Hadoop-Mapreduce-trunk - Build # 1905 - Still Failing

2014-09-23 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1905/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 29119 lines...] [INFO] hadoop-mapreduce-client-jobcl