[VOTE] Migration from subversion to git for version control

2014-08-08 Thread Karthik Kambatla
I have put together this proposal based on recent discussion on this topic. Please vote on the proposal. The vote runs for 7 days. 1. Migrate from subversion to git for version control. 2. Force-push to be disabled on trunk and branch-* branches. Applying changes from any of

Re: [VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-06 Thread Karthik Kambatla
-test-options.xml for the contract tests. All passed On 6 August 2014 01:37, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc1) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC1

[VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-06 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc2) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC2/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc2/ The maven artifacts are staged at:

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-06 Thread Karthik Kambatla
, Karthik Kambatla ka...@cloudera.com wrote: If we are to start a vote thread, will people prefer a vote thread that includes potential workflows as well? On Tue, Aug 5, 2014 at 5:40 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for your

Re: [VOTE] Release Apache Hadoop 2.5.0 RC2

2014-08-06 Thread Karthik Kambatla
+1 (non-binding) Brought up a pseudo distributed cluster. Ran a few HDFS operations and a couple of example MR jobs. Checked metrics being written out through FileSink. On Wed, Aug 6, 2014 at 1:59 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release

[VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-05 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc1) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC1/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc1/ The maven artifacts are staged at:

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-05 Thread Karthik Kambatla
This vote is cancelled due to the incompatible issue. On Fri, Aug 1, 2014 at 5:28 PM, Karthik Kambatla ka...@cloudera.com wrote: Missed Andrew's email in the other thread. Looks like we might need HDFS-6793. I ll wait to see if others find any other issues, so I can address them all

Re: [VOTE] Release Apache Hadoop 2.5.0 RC1

2014-08-05 Thread Karthik Kambatla
+1 (non-binding) Brought up a pseudo distributed cluster. Ran a few HDFS operations and a couple of example MR jobs. Checked metrics being written out through FileSink. On Tue, Aug 5, 2014 at 5:37 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-05 Thread Karthik Kambatla
review board is great. One concern is that the development workflow can change and it can confuse us. What do you think? Thanks, - Tsuyoshi On Sat, Aug 2, 2014 at 8:43 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, From what I hear, a lot of devs use the git mirror

Re: [DISCUSS] Migrate from svn to git for source control?

2014-08-05 Thread Karthik Kambatla
If we are to start a vote thread, will people prefer a vote thread that includes potential workflows as well? On Tue, Aug 5, 2014 at 5:40 PM, Karthik Kambatla ka...@cloudera.com wrote: Thanks for your opinions, everyone. Looks like most people are for the change and no one is against it. Let

Re: Branching 2.5

2014-08-01 Thread Karthik Kambatla
, Jul 29, 2014 at 5:41 PM, Karthik Kambatla ka...@cloudera.com wrote: Devs, I created branch-2.5.0 and was trying to cut an RC, but ran into issues with creating one. If anyone knows what is going on, please help me out. I ll continue looking into it otherwise. https

[VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
Hi folks, I have put together a release candidate (rc0) for Hadoop 2.5.0. The RC is available at: http://people.apache.org/~kasha/hadoop-2.5.0-RC0/ The RC tag in svn is here: https://svn.apache.org/repos/asf/hadoop/common/tags/release-2.5.0-rc0/ The maven artifacts are staged at

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
I am obviously a +1 (non-binding). I brought a pseudo-distributed cluster and ran a few HDFS commands and MR jobs. On Fri, Aug 1, 2014 at 4:16 PM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, I have put together a release candidate (rc0) for Hadoop 2.5.0. The RC is available

[DISCUSS] Migrate from svn to git for source control?

2014-08-01 Thread Karthik Kambatla
Hi folks, From what I hear, a lot of devs use the git mirror for development/reviews and use subversion primarily for checking code in. I was wondering if it would make more sense just to move to git. In addition to subjective liking of git, I see the following advantages in our workflow: 1.

Re: Branching 2.5

2014-08-01 Thread Karthik Kambatla
Tom White helped me figure it out, and closed the Nexus repository for me. Thanks Tom for helping and Stack for offering to help. On Fri, Aug 1, 2014 at 11:28 AM, Karthik Kambatla ka...@cloudera.com wrote: Folks, I think we are very close to voting on RC0. Just wanted to check one

Re: [VOTE] Release Apache Hadoop 2.5.0

2014-08-01 Thread Karthik Kambatla
Missed Andrew's email in the other thread. Looks like we might need HDFS-6793. I ll wait to see if others find any other issues, so I can address them all together. On Fri, Aug 1, 2014 at 4:25 PM, Karthik Kambatla ka...@cloudera.com wrote: I am obviously a +1 (non-binding). I brought

Re: Branching 2.5

2014-07-30 Thread Karthik Kambatla
at 11:09 AM, Zhijie Shen zs...@hortonworks.com wrote: I've just committed YARN-2247, which is the last 2.5 blocker from YARN. On Sat, Jul 26, 2014 at 5:02 AM, Karthik Kambatla ka...@cloudera.com wrote: A quick update: All remaining blockers are on the verge of getting committed

Re: Branching 2.5

2014-07-29 Thread Karthik Kambatla
committed YARN-2247, which is the last 2.5 blocker from YARN. On Sat, Jul 26, 2014 at 5:02 AM, Karthik Kambatla ka...@cloudera.com wrote: A quick update: All remaining blockers are on the verge of getting committed. Once that is done, I plan to cut a branch for 2.5.0 and get an RC out

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-25 Thread Karthik Kambatla
is consistent with what we publish for our JavaDocs. IncludePublicAnnotationsStandardDoclet, used in the root pom.xml, filters out classes that don't explicitly have the Public annotation. Chris Nauroth Hortonworks http://hortonworks.com/ On Wed, Jul 23, 2014 at 10:55 AM, Karthik Kambatla ka

Re: Branching 2.5

2014-07-25 Thread Karthik Kambatla
if there's any related issues to me. :) Thanks, Wangda On Thu, Jul 17, 2014 at 5:54 AM, Karthik Kambatla ka...@cloudera.com wrote: We are down to 4 blockers and looks like they are all actively being worked on. Please reconsider marking new

Re: [DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-23 Thread Karthik Kambatla
to track those rather than track all the classes that should be @Private. Hopefully if users understand that's how things work they'll help file JIRAs for interfaces that need to be @Public to get their work done. Jason On 07/22/2014 04:54 PM, Karthik Kambatla wrote: Hi devs As you might

[DISCUSS] Assume Private-Unstable for classes that are not annotated

2014-07-22 Thread Karthik Kambatla
Hi devs As you might have noticed, we have several classes and methods in them that are not annotated at all. This is seldom intentional. Avoiding incompatible changes to all these classes can be considerable baggage. I was wondering if we should add an explicit disclaimer in our compatibility

Re: Branching 2.5

2014-07-16 Thread Karthik Kambatla
We are down to 4 blockers and looks like they are all actively being worked on. Please reconsider marking new JIRAs as blockers. Thanks Karthik PS: I moved out a couple of JIRAs that didn't seem like true blockers to 2.6. On Wed, Jul 9, 2014 at 11:43 AM, Karthik Kambatla ka...@cloudera.com

Re: Branching 2.5

2014-07-09 Thread Karthik Kambatla
, Karthik Kambatla ka...@cloudera.com wrote: I just 1. moved non-blocker 2.5 JIRAs to 2.6. 2. created branch-2.5 and added sections for 2.6.0 in all CHANGES.txt in trunk and branch-2. 3. Will create branch-2.5.0 when we are ready to create an RC There are 11 pending blockers for 2.5.0: http

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
I was trying to do a JIRA bulk update to target all non-blockers to 2.6, but doesn't look like the bulk-update tool doesn't have Target Version. Does anyone know if that is true or if it is me not having permissions? On Thu, Jun 26, 2014 at 12:08 AM, Karthik Kambatla ka...@cloudera.com wrote

Re: Moving to JDK7, JDK8 and new major releases

2014-06-27 Thread Karthik Kambatla
As someone else already mentioned, we should announce one future release (may be, 2.5) as the last JDK6-based release before making the move to JDK7. I am comfortable calling 2.5 the last JDK6 release. On Fri, Jun 27, 2014 at 11:26 AM, Andrew Wang andrew.w...@cloudera.com wrote: Hi all,

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
till that point of time. I am also pushing for Shared Cache: YARN-1492 reviews. Again, like I said before, we can take it as we go. +Vinod Hortonworks Inc. http://hortonworks.com/ On Thu, Jun 26, 2014 at 12:08 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks, For 2.5, looks

Re: Moving to JDK7, JDK8 and new major releases

2014-06-27 Thread Karthik Kambatla
JDK6 release and solicit their feedback. Once they are comfortable we can pull the trigger in 2.7. thanks, Arun On Jun 27, 2014, at 11:34 AM, Karthik Kambatla ka...@cloudera.com wrote: As someone else already mentioned, we should announce one future release (may be, 2.5) as the last

Re: hadoop-2.5 - June end?

2014-06-27 Thread Karthik Kambatla
Spoke to Vinod offline. The tentative plan is cut branch-2.5 middle of next week and work towards getting the remaining blockers in as soon as possible. On Fri, Jun 27, 2014 at 12:56 PM, Karthik Kambatla ka...@cloudera.com wrote: Including YARN-1695 makes sense, just made it a blocker

Re: [VOTE] Release Apache Hadoop 0.23.11

2014-06-25 Thread Karthik Kambatla
+1 (non-binding) Stood up a pseudo-dist cluster and ran a few MR jobs. On Wed, Jun 25, 2014 at 9:05 AM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 (binding) - Verified signatures and digests - Deployed binary tarball to a single-node cluster and ran some MR example jobs - Built

Re: [VOTE] Change by-laws on release votes: 5 days instead of 7

2014-06-24 Thread Karthik Kambatla
+1 (non-binding) On Tue, Jun 24, 2014 at 8:54 AM, Jason Lowe jl...@yahoo-inc.com.invalid wrote: +1 (binding) Jason On 06/24/2014 03:53 AM, Arun C Murthy wrote: Folks, As discussed, I'd like to call a vote on changing our by-laws to change release votes from 7 days to 5. I've

Re: hadoop-2.5 - June end?

2014-06-23 Thread Karthik Kambatla
I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might need some help from someone more familiar with HDFS. On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd appreciate some help here. Due to family reasons (all good ones), I'll be

Re: hadoop-2.5 - June end?

2014-06-23 Thread Karthik Kambatla
PM, Karthik Kambatla ka...@cloudera.com wrote: I can pick up the RM duties for 2.5. If I run into any HDFS doubts, I might need some help from someone more familiar with HDFS. On Mon, Jun 23, 2014 at 12:07 PM, Arun C Murthy a...@hortonworks.com wrote: Folks, I'd

[jira] [Resolved] (MAPREDUCE-5777) Support utf-8 text with BOM (byte order marker)

2014-06-18 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5777. - Resolution: Fixed Fix Version/s: 1.3.0 Support utf-8 text with BOM

[jira] [Reopened] (MAPREDUCE-5777) Support utf-8 text with BOM (byte order marker)

2014-06-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened MAPREDUCE-5777: - Reopening to take care of branch-1. Support utf-8 text with BOM (byte order

Re: hadoop-2.5 - June end?

2014-06-11 Thread Karthik Kambatla
+1 to getting 2.5 by end of June. I would love to help with the release in any way. Some of the YARN features like work-preserving RM/ NM restart seem to going well; it would be great to get 2.6 out as soon as they are done, may be end of July. Again, I am willing to volunteer to do the necessary

[jira] [Created] (MAPREDUCE-5877) Inconsistency between JT/TT for tasks taking a long time to launch

2014-05-05 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5877: --- Summary: Inconsistency between JT/TT for tasks taking a long time to launch Key: MAPREDUCE-5877 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5877

Re: Typo in org.apache.hadoop.examples.RandomTextWriter

2014-04-15 Thread Karthik Kambatla
Great way to start contributing. You would want to create a MAPREDUCE jira for it and post a patch. One of the committers will take a look and commit the patch. Welcome to hadoop dev. On Tuesday, April 15, 2014, Dharmesh Kakadia dhkaka...@gmail.com wrote: Hi, I think there is a small typo in

Re: Policy on adding timeouts to tests

2014-04-15 Thread Karthik Kambatla
becomes questionable, because now the fast machine is running with the longer timeout too. Chris Nauroth Hortonworks http://hortonworks.com/ On Mon, Apr 14, 2014 at 9:41 AM, Karthik Kambatla ka...@cloudera.com wrote: Hi folks Just wanted to check what our policy for adding timeouts

Policy on adding timeouts to tests

2014-04-14 Thread Karthik Kambatla
Hi folks Just wanted to check what our policy for adding timeouts to tests is. Do we encourage/discourage using timeouts for tests? If we discourage using timeouts for tests in general, are we okay with adding timeouts for a few tests where we explicitly want the test to fail if it takes longer

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Karthik Kambatla
We should definitely get YARN-1726 in, if we are spinning a new RC. Otherwise, I guess we could include it in 2.4.1, along with any other critical issues that get reported on 2.4.0 or have missed this RC. On Thu, Apr 3, 2014 at 12:45 PM, Sandy Ryza sandy.r...@cloudera.com wrote: While the

Re: [DISCUSS] Clarification on Compatibility Policy: Upgraded Client + Old Server

2014-03-19 Thread Karthik Kambatla
+1 on supporting new clients with old servers of the same major version, and updating the policy to capture that clearly. On Wed, Mar 19, 2014 at 1:59 PM, Chris Nauroth cnaur...@hortonworks.comwrote: I'd like to discuss clarification of part of our compatibility policy. Here is a link to the

[jira] [Resolved] (MAPREDUCE-5795) Job should be marked as Falied if it is recovered from commit.

2014-03-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5795. - Resolution: Duplicate Job should be marked as Falied if it is recovered

[jira] [Resolved] (MAPREDUCE-5110) Kill task early in case of long task launch delays

2014-03-12 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5110. - Resolution: Won't Fix Resolving this as Won't Fix for inactivity. Please re

[jira] [Resolved] (MAPREDUCE-5418) JobHistoryServer has no information about applications if the MR-AM crashes

2014-02-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5418. - Resolution: Fixed Robert seems to be working on this in MAPREDUCE-5641

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-12 Thread Karthik Kambatla
+1 (non-binding) Built source. Brought up a pseudo-cluster with manual RM HA. Ran a few MR examples. On Tue, Feb 11, 2014 at 10:40 PM, Roman Shaposhnik r...@apache.org wrote: Very nice! I'll take it for the usual round of testing in Bigtop. Should take a few days, but I'll keep you guys

[jira] [Resolved] (MAPREDUCE-5744) Job hangs because RMContainerAllocator$AssignedRequests.preemptReduce() violates the comparator contract

2014-02-06 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5744. - Resolution: Incomplete Resolving and re-opening to see if Submit patch shows

[jira] [Created] (MAPREDUCE-5741) JobClient should let querying for jobs that match certain tags

2014-02-05 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5741: --- Summary: JobClient should let querying for jobs that match certain tags Key: MAPREDUCE-5741 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5741

[jira] [Created] (MAPREDUCE-5729) mapred job -list throws NPE

2014-01-20 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5729: --- Summary: mapred job -list throws NPE Key: MAPREDUCE-5729 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5729 Project: Hadoop Map/Reduce

[jira] [Resolved] (MAPREDUCE-5628) Tracking ids only for HDFS tokens should be included in jobconf

2014-01-15 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5628. - Resolution: Not A Problem My bad. Token#getTrackingId() never returns null

[jira] [Resolved] (MAPREDUCE-5720) RM occur exception while unregistering

2014-01-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5720. - Resolution: Invalid Release Note: JIRA is for developers to track

[jira] [Created] (MAPREDUCE-5718) MR AM should tolerate RM failover during commit

2014-01-10 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5718: --- Summary: MR AM should tolerate RM failover during commit Key: MAPREDUCE-5718 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5718 Project: Hadoop

[jira] [Resolved] (MAPREDUCE-5618) Allow setting lineage information

2014-01-08 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5618. - Resolution: Duplicate This is being fixed as part of MAPREDUCE-5699. Allow

[jira] [Created] (MAPREDUCE-5702) TaskLogServlet#printTaskLog has spurious HTML closing tags

2013-12-30 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5702: --- Summary: TaskLogServlet#printTaskLog has spurious HTML closing tags Key: MAPREDUCE-5702 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5702

[jira] [Created] (MAPREDUCE-5699) Tagging support for MR jobs

2013-12-26 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5699: --- Summary: Tagging support for MR jobs Key: MAPREDUCE-5699 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5699 Project: Hadoop Map/Reduce

Re: Next releases

2013-12-05 Thread Karthik Kambatla
We should be able to ship YARN HA in Jan. We are two sub-tasks away from main functionality (patches in progress for both). YARN-149 has some duplicate sub-tasks. We should definitely be able to test / fix any critical issues by Jan. On Thu, Dec 5, 2013 at 3:57 PM, Arun C Murthy

[jira] [Created] (MAPREDUCE-5658) JHS API and other changes to support tags

2013-11-28 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5658: --- Summary: JHS API and other changes to support tags Key: MAPREDUCE-5658 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5658 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5652) ShuffleHandler should handle NM restarts

2013-11-25 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5652: --- Summary: ShuffleHandler should handle NM restarts Key: MAPREDUCE-5652 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5652 Project: Hadoop Map

Re: sclipse plugin

2013-11-17 Thread Karthik Kambatla
Something that I wrote up a while ago - http://blog.cloudera.com/blog/2013/05/how-to-configure-eclipse-for-hadoop-contributions/ I think the wiki has also been updated recently, not certain though. I have since moved to IntelliJ IDEA and it works seamlessly, in case you want to try that. On

[jira] [Created] (MAPREDUCE-5628) Tracking ids only for HDFS tokens should be included in jobconf

2013-11-14 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5628: --- Summary: Tracking ids only for HDFS tokens should be included in jobconf Key: MAPREDUCE-5628 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5628

[jira] [Created] (MAPREDUCE-5618) Make applicationType pluggable

2013-11-10 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5618: --- Summary: Make applicationType pluggable Key: MAPREDUCE-5618 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5618 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5594) Combiner in mapred API gets only a dummy reporter

2013-10-24 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5594: --- Summary: Combiner in mapred API gets only a dummy reporter Key: MAPREDUCE-5594 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5594 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.1.1-beta

2013-09-17 Thread Karthik Kambatla
Not sure if this should be a blocker for 2.1.1, but filed HADOOP-9976 to have a single version of avro. On Tue, Sep 17, 2013 at 6:51 AM, Andrew Wang andrew.w...@cloudera.comwrote: Hey all, Sorry to hijack the vote thread, but it'd be good to get some input on my email from yesterday re:

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-08-13 Thread Karthik Kambatla
Hi Arun, Would it be possible to include YARN-1056 in the next RC - it is a straight-forward config change. I marked it as a blocker for 2.1.0. Thanks Karthik On Thu, Aug 8, 2013 at 8:14 AM, Kihwal Lee kih...@yahoo-inc.com wrote: Another blocker, HADOOP-9850, has been committed. Kihwal

[jira] [Created] (MAPREDUCE-5454) TestDFSIO fails intermittently on JDK7

2013-08-09 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5454: --- Summary: TestDFSIO fails intermittently on JDK7 Key: MAPREDUCE-5454 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5454 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5418) JobHistoryServer has no information about applications if the MR-AM crashes

2013-07-24 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5418: --- Summary: JobHistoryServer has no information about applications if the MR-AM crashes Key: MAPREDUCE-5418 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5418

[jira] [Resolved] (MAPREDUCE-5407) How to process 1 lack records to show a graph with 12 points

2013-07-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5407. - Resolution: Invalid How to process 1 lack records to show a graph

[jira] [Created] (MAPREDUCE-5384) Race in DelegationTokenRenewal#RenewalTimerTask

2013-07-11 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5384: --- Summary: Race in DelegationTokenRenewal#RenewalTimerTask Key: MAPREDUCE-5384 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5384 Project: Hadoop

[jira] [Reopened] (MAPREDUCE-5364) Deadlock between RenewalTimerTask methods cancel() and run()

2013-07-09 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened MAPREDUCE-5364: - Reopening to get the addendum reviewed and committed. Deadlock

[jira] [Created] (MAPREDUCE-5250) Searching for ';' in JobTracker History throws ArrayOutOfBoundException

2013-05-15 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5250: --- Summary: Searching for ';' in JobTracker History throws ArrayOutOfBoundException Key: MAPREDUCE-5250 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5250

[jira] [Resolved] (MAPREDUCE-5243) MRAdmin is removed from M/R while RMAdmin is added to Yarn

2013-05-13 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5243. - Resolution: Duplicate Marking this as a duplicate of MAPREDUCE-5214

[jira] [Created] (MAPREDUCE-5218) Annotate (comment) internal classes as Private

2013-05-07 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5218: --- Summary: Annotate (comment) internal classes as Private Key: MAPREDUCE-5218 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5218 Project: Hadoop

[jira] [Created] (MAPREDUCE-5222) Add missing methods to JobClient

2013-05-07 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5222: --- Summary: Add missing methods to JobClient Key: MAPREDUCE-5222 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5222 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5213) Annotate TokenCache methods as Public or LimitedPrivate

2013-05-06 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5213: --- Summary: Annotate TokenCache methods as Public or LimitedPrivate Key: MAPREDUCE-5213 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5213 Project

[jira] [Created] (MAPREDUCE-5214) Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin

2013-05-06 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5214: --- Summary: Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin Key: MAPREDUCE-5214 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5214

[jira] [Created] (MAPREDUCE-5200) FS: maxAssign is not honored

2013-04-30 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5200: --- Summary: FS: maxAssign is not honored Key: MAPREDUCE-5200 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5200 Project: Hadoop Map/Reduce

Re: Why number of reducers should be less than number of reducer slots.

2013-04-23 Thread Karthik Kambatla
I wonder how accurate that is. However, by setting the number of reducers slightly lesser than the reduce slots, the difference acts as headroom for speculative reduce tasks. And, the goal of a single wave is also preserved. On Mon, Apr 22, 2013 at 11:10 PM, Darpan R darpa...@gmail.com wrote:

[jira] [Created] (MAPREDUCE-5110) Long task launch delays can lead to multiple parallel attempts of the task

2013-03-27 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5110: --- Summary: Long task launch delays can lead to multiple parallel attempts of the task Key: MAPREDUCE-5110 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5110

[jira] [Resolved] (MAPREDUCE-4239) gridmix has 11 findbugs warnings

2013-03-26 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-4239. - Resolution: Duplicate gridmix has 11 findbugs warnings

[jira] [Created] (MAPREDUCE-5098) Fix findbugs warnings in gridmix

2013-03-22 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5098: --- Summary: Fix findbugs warnings in gridmix Key: MAPREDUCE-5098 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5098 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-5099) mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2

2013-03-22 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5099: --- Summary: mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2 Key: MAPREDUCE-5099 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (MAPREDUCE-5099) mapreduce.lib.jobcontrol.JobControl API Incompatibility between branch-1 and branch-2

2013-03-22 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5099. - Resolution: Not A Problem Not an issue - was looking at JobControl from

[jira] [Resolved] (MAPREDUCE-5089) Remove TestProcfsBasedProcessTree from mapreduce-client-jobclient

2013-03-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5089. - Resolution: Duplicate In addition to TestProcfsBasedProcessTree, MAPREDUCE

[jira] [Created] (MAPREDUCE-5077) Cleanup: mapreduce.util.ResourceCalculatorPlugin and related code should be removed

2013-03-18 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5077: --- Summary: Cleanup: mapreduce.util.ResourceCalculatorPlugin and related code should be removed Key: MAPREDUCE-5077 URL: https://issues.apache.org/jira/browse

[jira] [Resolved] (MAPREDUCE-5031) Maps hitting IndexOutOfBoundsException for higher values of mapreduce.task.io.sort.mb

2013-03-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5031. - Resolution: Duplicate Closing as a duplicate of MAPREDUCE-5028

[jira] [Created] (MAPREDUCE-5030) YARNClientImpl logging too aggressively

2013-02-26 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5030: --- Summary: YARNClientImpl logging too aggressively Key: MAPREDUCE-5030 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5030 Project: Hadoop Map

[jira] [Created] (MAPREDUCE-5031) Maps hitting IndexOutOfBoundsException for higher values of mapreduce.task.io.sort.mb

2013-02-26 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5031: --- Summary: Maps hitting IndexOutOfBoundsException for higher values of mapreduce.task.io.sort.mb Key: MAPREDUCE-5031 URL: https://issues.apache.org/jira/browse

[jira] [Created] (MAPREDUCE-5028) Maps fail when io.sort.mb is set to high value

2013-02-25 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5028: --- Summary: Maps fail when io.sort.mb is set to high value Key: MAPREDUCE-5028 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5028 Project: Hadoop

[jira] [Created] (MAPREDUCE-5022) Tasklogs disappear if JVM reuse is enabled

2013-02-21 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5022: --- Summary: Tasklogs disappear if JVM reuse is enabled Key: MAPREDUCE-5022 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5022 Project: Hadoop Map

[jira] [Resolved] (MAPREDUCE-5011) While Running Word Count in Hadoop showing following errors

2013-02-17 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-5011. - Resolution: Invalid The command is missing the _class to run_ immediately

[jira] [Created] (MAPREDUCE-5005) TestProcfsProcessTree#testProcessTree() doesn't wait long enough for the process to die

2013-02-13 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-5005: --- Summary: TestProcfsProcessTree#testProcessTree() doesn't wait long enough for the process to die Key: MAPREDUCE-5005 URL: https://issues.apache.org/jira/browse

[jira] [Created] (MAPREDUCE-4990) Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput()

2013-02-07 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4990: --- Summary: Construct debug strings conditionally in ShuffleHandler.Shuffle#sendMapOutput() Key: MAPREDUCE-4990 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Resolved] (MAPREDUCE-4973) Backport history clean up configurations to branch-1

2013-02-04 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved MAPREDUCE-4973. - Resolution: Duplicate Backport history clean up configurations

[jira] [Created] (MAPREDUCE-4973) Backport history clean up configurations to branch-1

2013-02-01 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4973: --- Summary: Backport history clean up configurations to branch-1 Key: MAPREDUCE-4973 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4973 Project

[jira] [Created] (MAPREDUCE-4964) JobLocalizer#localizeJobFiles can potentially write job.xml to the wrong user's directory

2013-01-26 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4964: --- Summary: JobLocalizer#localizeJobFiles can potentially write job.xml to the wrong user's directory Key: MAPREDUCE-4964 URL: https://issues.apache.org/jira/browse

[jira] [Created] (MAPREDUCE-4930) Backport MAPREDUCE-4678 to branch-2, branch-0.23 and branch-1

2013-01-10 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4930: --- Summary: Backport MAPREDUCE-4678 to branch-2, branch-0.23 and branch-1 Key: MAPREDUCE-4930 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4930

[jira] [Reopened] (MAPREDUCE-4678) Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException

2013-01-10 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened MAPREDUCE-4678: - Reopening the patch for it to be committed to branch-2 and branch-0.23

[jira] [Created] (MAPREDUCE-4925) Backport MAPREDUCE-4678 to branch-1

2013-01-07 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4925: --- Summary: Backport MAPREDUCE-4678 to branch-1 Key: MAPREDUCE-4925 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4925 Project: Hadoop Map/Reduce

[jira] [Created] (MAPREDUCE-4873) TestQueueManagerForJobKillAndJobPriority is failing on branch-1

2012-12-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4873: --- Summary: TestQueueManagerForJobKillAndJobPriority is failing on branch-1 Key: MAPREDUCE-4873 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4873

[jira] [Created] (MAPREDUCE-4874) TestQueueManagerForJobKillAndNonDefaultQueue fails in branch-1

2012-12-12 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created MAPREDUCE-4874: --- Summary: TestQueueManagerForJobKillAndNonDefaultQueue fails in branch-1 Key: MAPREDUCE-4874 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4874

<    1   2   3   >