[jira] [Created] (MAPREDUCE-6490) Facilitate the application life time out in mapreduce applications.

2015-09-24 Thread nijel (JIRA)
nijel created MAPREDUCE-6490: Summary: Facilitate the application life time out in mapreduce applications. Key: MAPREDUCE-6490 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6490 Project: Hadoop Map

[jira] [Moved] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-2369 to MAPREDUCE-6491: - Affects Version/s: (was: 2.2.0) 2.2.0

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906493#comment-14906493 ] zhihai xu commented on MAPREDUCE-6484: -- Committed it to branch-2 and trunk. > Ya

[jira] [Updated] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6484: - Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availabl

[jira] [Commented] (MAPREDUCE-2064) Tutorial should mention SetMapOutputKeyClass

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906496#comment-14906496 ] Neelesh Srinivas Salian commented on MAPREDUCE-2064: The latter pa

[jira] [Resolved] (MAPREDUCE-2064) Tutorial should mention SetMapOutputKeyClass

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian resolved MAPREDUCE-2064. Resolution: Fixed Fix Version/s: 1.0.4 > Tutorial should

[jira] [Updated] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated MAPREDUCE-6449: --- Attachment: MAPREDUCE-6449.001.patch Attached the 1st version of t

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906522#comment-14906522 ] Jason Lowe commented on MAPREDUCE-6491: --- bq. sorry this took so long, I got side

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906521#comment-14906521 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk-J

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906537#comment-14906537 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-trunk-Commit #851

[jira] [Updated] (MAPREDUCE-604) Streaming use static methods to get/set jobconf parameters.

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated MAPREDUCE-604: -- Issue Type: Improvement (was: Bug) > Streaming use static methods to

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906556#comment-14906556 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8

[jira] [Commented] (MAPREDUCE-4032) org.apache.hadoop.util.RunJar continues to run even after Hadoop Streaming Job is killed

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906557#comment-14906557 ] Neelesh Srinivas Salian commented on MAPREDUCE-4032: Hi [~rahuldev

[jira] [Commented] (MAPREDUCE-4522) DBOutputFormat Times out on large batch inserts

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906610#comment-14906610 ] Neelesh Srinivas Salian commented on MAPREDUCE-4522: [~jarusn], is

[jira] [Assigned] (MAPREDUCE-5383) Deprecate to mapreduce.jobtracker.staging.root.dir to yarn.app.mapreduce.am.staging-dir

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian reassigned MAPREDUCE-5383: -- Assignee: Neelesh Srinivas Salian > Deprecate to mapreduce.

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906660#comment-14906660 ] Hadoop QA commented on MAPREDUCE-6491: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6473: -- Target Version/s: 2.8.0 Status: Open (was: Patch Available) Thanks for the pa

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906720#comment-14906720 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #2353

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906744#comment-14906744 ] Hudson commented on MAPREDUCE-6484: --- SUCCESS: Integrated in Hadoop-Yarn-trunk #1175

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906756#comment-14906756 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-6484) Yarn Client uses local address instead of RM address as token renewer in a secure cluster when RM HA is enabled.

2015-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906845#comment-14906845 ] Hudson commented on MAPREDUCE-6484: --- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Status: Patch Available (was: Open) > Job submission can take a long time during Cluster

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: MAPREDUCE-6473-v5.patch Added a volatile boolean to ensure the provider list i

[jira] [Commented] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906947#comment-14906947 ] Jason Lowe commented on MAPREDUCE-5003: --- Thanks for updating the patch, Chang!

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906953#comment-14906953 ] Jason Lowe commented on MAPREDUCE-6473: --- Curious, why are we using a separate bo

[jira] [Updated] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated MAPREDUCE-6491: --- Attachment: YARN-2369-8.patch [~jlowe] thanks for the quick review. I've fixed those nits

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906977#comment-14906977 ] Kuhu Shukla commented on MAPREDUCE-6473: Thank you [~jlowe] . I thought of mak

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906982#comment-14906982 ] Dustin Cote commented on MAPREDUCE-6491: Whoops, looks like my Configuration.j

[jira] [Updated] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Dustin Cote (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dustin Cote updated MAPREDUCE-6491: --- Attachment: YARN-2369-9.patch Version 9 should be good to go. > Environment variable hand

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907012#comment-14907012 ] Jason Lowe commented on MAPREDUCE-6473: --- The problem is this step: bq. T1 hasn't

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: MAPREDUCE-6473-v6.patch Got it! Thank you [~jlowe]. Updated patch. > Job subm

[jira] [Updated] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated MAPREDUCE-6449: --- Status: Patch Available (was: Open) > MR Code should not throw an

[jira] [Updated] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated MAPREDUCE-6449: --- Labels: mapre (was: ) > MR Code should not throw and catch YarnRu

[jira] [Updated] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

2015-09-24 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated MAPREDUCE-6449: --- Labels: mapreduce (was: mapre) > MR Code should not throw and cat

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907215#comment-14907215 ] Hadoop QA commented on MAPREDUCE-6473: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: MAPREDUCE-6473-v7.patch > Job submission can take a long time during Cluster i

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: (was: MAPREDUCE-6473-v6.patch) > Job submission can take a long time durin

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: (was: MAPREDUCE-6473-v7.patch) > Job submission can take a long time durin

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated MAPREDUCE-6473: --- Attachment: MAPREDUCE-6473-v6.patch > Job submission can take a long time during Cluster i

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907268#comment-14907268 ] Hadoop QA commented on MAPREDUCE-6491: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Commented] (MAPREDUCE-6449) MR Code should not throw and catch YarnRuntimeException to communicate internal exceptions

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907284#comment-14907284 ] Hadoop QA commented on MAPREDUCE-6449: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907303#comment-14907303 ] Hadoop QA commented on MAPREDUCE-6473: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2015-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907404#comment-14907404 ] Hadoop QA commented on MAPREDUCE-6473: -- \\ \\ | (x) *{color:red}-1 overall{color}

[jira] [Commented] (MAPREDUCE-6471) Document distcp incremental copy

2015-09-24 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907446#comment-14907446 ] Harsh J commented on MAPREDUCE-6471: The changes in the options section look good

[jira] [Updated] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-24 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianyin Xin updated MAPREDUCE-6485: --- Attachment: MAPREDUCE-6845.002.patch Thanks for review, [~rohithsharma] {quote} Can you ad

[jira] [Commented] (MAPREDUCE-6485) MR job hanged forever because all resources are taken up by reducers and the last map attempt never get resource to run

2015-09-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907693#comment-14907693 ] Rohith Sharma K S commented on MAPREDUCE-6485: -- Thinking that TaskAttempt