[jira] [Updated] (MAPREDUCE-7011) TestClientDistributedCacheManager::testDetermineCacheVisibilities assumes all parent dirs set other exec

2021-08-03 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7011: -- Fix Version/s: 2.10.2 I cherry-picked this to 2.10, since we are seeing this there. >

[jira] [Reopened] (MAPREDUCE-7203) TestRuntimeEstimators fails intermittent

2021-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne reopened MAPREDUCE-7203: --- Sorry! I was in the wrong window! > TestRuntimeEstimators fails intermittent >

[jira] [Updated] (MAPREDUCE-7203) TestRuntimeEstimators fails intermittent

2021-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7203: -- Fix Version/s: (was: 3.3.2) (was: 3.2.3)

[jira] [Resolved] (MAPREDUCE-7203) TestRuntimeEstimators fails intermittent

2021-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved MAPREDUCE-7203. --- Fix Version/s: 3.3.2 3.2.3 2.10.2

[jira] [Commented] (MAPREDUCE-7353) Mapreduce job fails when NM is stopped

2021-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376831#comment-17376831 ] Eric Payne commented on MAPREDUCE-7353: --- +1. Will commit now. Thanks very much, [~BilwaST]. >

[jira] [Commented] (MAPREDUCE-7353) Mapreduce job fails when NM is stopped

2021-07-07 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376772#comment-17376772 ] Eric Payne commented on MAPREDUCE-7353: --- Thanks a lot, [~BilwaST], for the patch update. The

[jira] [Commented] (MAPREDUCE-7353) Mapreduce job fails when NM is stopped

2021-06-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17368405#comment-17368405 ] Eric Payne commented on MAPREDUCE-7353: --- [~BilwaST], the changes LGTM. Would it be possible to

[jira] [Commented] (MAPREDUCE-7353) Mapreduce job fails when NM is stopped

2021-06-17 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17364967#comment-17364967 ] Eric Payne commented on MAPREDUCE-7353: --- [~BilwaST], thanks for raising this. I have

[jira] [Comment Edited] (MAPREDUCE-7227) Fix job staging directory residual problem in a big yarn cluster composed of multiple independent hdfs clusters

2021-01-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271674#comment-17271674 ] Eric Payne edited comment on MAPREDUCE-7227 at 1/25/21, 9:00 PM: -

[jira] [Commented] (MAPREDUCE-7227) Fix job staging directory residual problem in a big yarn cluster composed of multiple independent hdfs clusters

2021-01-25 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17271674#comment-17271674 ] Eric Payne commented on MAPREDUCE-7227: --- [~luoyuan], I'm sorry for the long delay. bq. I Set up

[jira] [Commented] (MAPREDUCE-7314) Job will hang if NM is restarted while its running

2021-01-20 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17268715#comment-17268715 ] Eric Payne commented on MAPREDUCE-7314: --- [~BilwaST], on what version are you seeing this? >

[jira] [Updated] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7277: -- Fix Version/s: 3.4.0 2.10.1 3.2.2

[jira] [Commented] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094010#comment-17094010 ] Eric Payne commented on MAPREDUCE-7277: --- [~jeagles], there are a couple of findbugs warnings.

[jira] [Comment Edited] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093910#comment-17093910 ] Eric Payne edited comment on MAPREDUCE-7277 at 4/27/20, 8:30 PM: -

[jira] [Commented] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093910#comment-17093910 ] Eric Payne commented on MAPREDUCE-7277: --- [~jeagles], we want this backported to 2.10, correct?

[jira] [Commented] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-27 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093847#comment-17093847 ] Eric Payne commented on MAPREDUCE-7277: --- Thanks [~jeagles] for your explanations, comments, and

[jira] [Commented] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-23 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090762#comment-17090762 ] Eric Payne commented on MAPREDUCE-7277: --- bq. In the following code, if ever mapId is in queue

[jira] [Commented] (MAPREDUCE-7277) IndexCache totalMemoryUsed differs from cache contents.

2020-04-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17090063#comment-17090063 ] Eric Payne commented on MAPREDUCE-7277: --- Thanks a lot [~jeagles] for raising this issue and

[jira] [Comment Edited] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082631#comment-17082631 ] Eric Payne edited comment on MAPREDUCE-7272 at 4/13/20, 8:37 PM: - I

[jira] [Updated] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7272: -- Fix Version/s: 3.4.0 2.9.3 > TaskAttemptListenerImpl excessive log

[jira] [Updated] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7272: -- Fix Version/s: 2.10.1 3.2.2 3.1.4

[jira] [Commented] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-13 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17082512#comment-17082512 ] Eric Payne commented on MAPREDUCE-7272: --- +1. [~ahussein], thanks for providing fixes for this

[jira] [Commented] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-10 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080635#comment-17080635 ] Eric Payne commented on MAPREDUCE-7272: --- Thanks for the new patch [~ahussein]! It looks like

[jira] [Commented] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080031#comment-17080031 ] Eric Payne commented on MAPREDUCE-7272: --- {quote} {noformat} if (LOG.isDebugEnabled()) {

[jira] [Commented] (MAPREDUCE-7272) TaskAttemptListenerImpl excessive log messages

2020-04-09 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17080012#comment-17080012 ] Eric Payne commented on MAPREDUCE-7272: --- Thanks [~ahussein] for reporting this issue and

[jira] [Updated] (MAPREDUCE-7079) JobHistory#ServiceStop implementation is incorrect

2020-01-29 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7079: -- Fix Version/s: 2.10.1 3.2.2 3.1.4

[jira] [Commented] (MAPREDUCE-7079) JobHistory#ServiceStop implementation is incorrect

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025412#comment-17025412 ] Eric Payne commented on MAPREDUCE-7079: --- It backports cleanly to branch-2.10. I'll wait for

[jira] [Commented] (MAPREDUCE-7079) JobHistory#ServiceStop implementation is incorrect

2020-01-28 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17025405#comment-17025405 ] Eric Payne commented on MAPREDUCE-7079: --- [~ahussein], +1. Latest patch LGTM. I assume we want

[jira] [Commented] (MAPREDUCE-7079) JobHistory#ServiceStop implementation is incorrect

2020-01-24 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17023281#comment-17023281 ] Eric Payne commented on MAPREDUCE-7079: --- Thanks [~ahussein] for providing this patch! Just a

[jira] [Commented] (MAPREDUCE-7079) TestMRIntermediateDataEncryption is failing in precommit builds

2020-01-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17021306#comment-17021306 ] Eric Payne commented on MAPREDUCE-7079: --- bq. 1000l is 1000 followed by "l". Thanks [~ahussein],

[jira] [Commented] (MAPREDUCE-7079) TestMRIntermediateDataEncryption is failing in precommit builds

2020-01-15 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17016276#comment-17016276 ] Eric Payne commented on MAPREDUCE-7079: --- Hi [~ahussein]. I'm still working my way through the

[jira] [Commented] (MAPREDUCE-7227) Fix job staging directory residual problem in a big yarn cluster composed of multiple independent hdfs clusters

2019-08-22 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913358#comment-16913358 ] Eric Payne commented on MAPREDUCE-7227: --- [~luoyuan], I am having trouble reproducing this

[jira] [Commented] (MAPREDUCE-7227) Fix job staging directory residual problem in a big yarn cluster composed of multiple independent hdfs clusters

2019-08-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903892#comment-16903892 ] Eric Payne commented on MAPREDUCE-7227: --- [~luoyuan], thank you for raising this issue and

[jira] [Updated] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

2018-09-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-3801: -- Resolution: Fixed Fix Version/s: 2.8.6 3.1.2

[jira] [Commented] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

2018-09-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619665#comment-16619665 ] Eric Payne commented on MAPREDUCE-3801: --- Thanks for the patch [~jlowe]. +1 Will commit

[jira] [Comment Edited] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

2018-05-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367455#comment-16367455 ] Eric Payne edited comment on MAPREDUCE-7053 at 5/7/18 1:15 PM: --- Thanks

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

2018-05-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465895#comment-16465895 ] Eric Payne commented on MAPREDUCE-7053: --- bq. Thanks for the work here. I noticed that you

[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

2018-02-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7053: -- Resolution: Fixed Fix Version/s: 3.0.2 2.8.4

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

2018-02-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16367455#comment-16367455 ] Eric Payne commented on MAPREDUCE-7053: --- Thanks [~jlowe]. I committed MAPREDUCE-7053.001.patch

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

2018-02-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366263#comment-16366263 ] Eric Payne commented on MAPREDUCE-7053: --- Thanks [~jlowe] for fixing this problem, and thanks

[jira] [Updated] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

2018-02-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-7033: -- Resolution: Fixed Fix Version/s: 3.0.1 3.1.0 Status:

[jira] [Commented] (MAPREDUCE-7033) Map outputs implicitly rely on permissive umask for shuffle

2018-01-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347646#comment-16347646 ] Eric Payne commented on MAPREDUCE-7033: --- +1 [~jlowe] thanks for taking the time to fix this

[jira] [Created] (MAPREDUCE-6976) mapred job -set-priority claims to set priority higher than yarn.cluster.max-application-priority

2017-10-05 Thread Eric Payne (JIRA)
Eric Payne created MAPREDUCE-6976: - Summary: mapred job -set-priority claims to set priority higher than yarn.cluster.max-application-priority Key: MAPREDUCE-6976 URL:

[jira] [Updated] (MAPREDUCE-6960) Shuffle Handler prints disk error stack traces for every read failure.

2017-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6960: -- Resolution: Fixed Fix Version/s: 2.8.3 3.1.0

[jira] [Commented] (MAPREDUCE-6960) Shuffle Handler prints disk error stack traces for every read failure.

2017-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171910#comment-16171910 ] Eric Payne commented on MAPREDUCE-6960: --- Thanks [~kshukla]. Patch LGTM. Will commit to 3.1.0,

[jira] [Commented] (MAPREDUCE-6960) Shuffle Handler prints disk error stack traces for every read failure.

2017-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171872#comment-16171872 ] Eric Payne commented on MAPREDUCE-6960: --- Sure [~kshukla], I'll take a look. > Shuffle Handler

[jira] [Commented] (MAPREDUCE-6958) Shuffle audit logger should log size of shuffle transfer

2017-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171858#comment-16171858 ] Eric Payne commented on MAPREDUCE-6958: --- Thanks [~jlowe] The branch-2.8 patch LGTM. +1 >

[jira] [Commented] (MAPREDUCE-6944) MR job got hanged forever when some NMs unstable for some time

2017-08-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141978#comment-16141978 ] Eric Payne commented on MAPREDUCE-6944: --- [~daemon], what version of Hadoop are you running? >

[jira] [Updated] (MAPREDUCE-6801) Fix flaky TestKill.testKillJob()

2017-01-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6801: -- Fix Version/s: 2.8.0 Thanks [~haibochen] for the fix. I have backported this to branch-2.8.

[jira] [Updated] (MAPREDUCE-6675) TestJobImpl.testUnusableNode failed

2017-01-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6675: -- Fix Version/s: 2.8.0 Thanks [~haibochen] for the fix. I have backported this to branch-2.8.

[jira] [Created] (MAPREDUCE-6812) Capacity Scheduler: Support user-specific minimum user limit percent

2016-11-16 Thread Eric Payne (JIRA)
Eric Payne created MAPREDUCE-6812: - Summary: Capacity Scheduler: Support user-specific minimum user limit percent Key: MAPREDUCE-6812 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6812

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317290#comment-15317290 ] Eric Payne commented on MAPREDUCE-5044: --- bq. The patch doesn't resolve automatically for

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-06 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316754#comment-15316754 ] Eric Payne commented on MAPREDUCE-5044: --- - FindBugs warning is not related. It pertains to

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.013.patch {{MAPREDUCE-5044.013.patch}} addresses most of the

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15313187#comment-15313187 ] Eric Payne commented on MAPREDUCE-5044: --- Thanks [~aw]. I will look into those warnings. > Have

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312847#comment-15312847 ] Eric Payne commented on MAPREDUCE-5044: --- I looked at the unit test failures from the pre-commit

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.012.patch The new test case

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-27 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15304512#comment-15304512 ] Eric Payne commented on MAPREDUCE-5044: --- Of the unit tests that failed in the precommit build,

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Status: Patch Available (was: Open) > Have AM trigger jstack on task attempts that timeout

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Status: Open (was: Patch Available) It looks like the pre-commit build faild:

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-25 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.011.patch Thanks for the continuing review, [~mingma]. I made

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.010.patch Thank you very much, [~mingma], for your review and

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15291977#comment-15291977 ] Eric Payne commented on MAPREDUCE-5044: --- [~mingma], thank you for your reply and explanation.

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289975#comment-15289975 ] Eric Payne commented on MAPREDUCE-5044: --- [~mingma], thank you very much for the comments. I have

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-05-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.009.patch [~jlowe], [~jira.shegalov], [~mingma], [~xgong], Patch

[jira] [Updated] (MAPREDUCE-6678) Allow ShuffleHandler readahead without drop-behind

2016-05-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6678: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-6678) Allow ShuffleHandler readahead without drop-behind

2016-05-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15276694#comment-15276694 ] Eric Payne commented on MAPREDUCE-6678: --- Thanks, [~nroberts], for raising this issue and

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-04-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.008.patch [~jira.shegalov], [~mingma], [~xgong], [~jlowe],

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2016-04-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245966#comment-15245966 ] Eric Payne commented on MAPREDUCE-6633: --- Thanks [~shahrs87]. I cherry picked this back to 2.7.

[jira] [Updated] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2016-04-18 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6633: -- Fix Version/s: (was: 2.8.0) 2.7.3 > AM should retry map attempts if

[jira] [Commented] (MAPREDUCE-6649) getFailureInfo not returning any failure info

2016-04-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1529#comment-1529 ] Eric Payne commented on MAPREDUCE-6649: --- [~ebadger], I have checked this fix into trunk,

[jira] [Commented] (MAPREDUCE-6649) getFailureInfo not returning any failure info

2016-04-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15244429#comment-15244429 ] Eric Payne commented on MAPREDUCE-6649: --- Thanks [~ebadger] for finding and fixing this problem.

[jira] [Updated] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2016-04-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6633: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2016-04-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15233181#comment-15233181 ] Eric Payne commented on MAPREDUCE-6633: --- {quote} In this case the decompressor threw

[jira] [Commented] (MAPREDUCE-6334) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

2016-04-04 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15224413#comment-15224413 ] Eric Payne commented on MAPREDUCE-6334: --- [~vishal.rajan], what version of Hadoop are you

[jira] [Commented] (MAPREDUCE-6633) AM should retry map attempts if the reduce task encounters commpression related errors.

2016-03-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15219077#comment-15219077 ] Eric Payne commented on MAPREDUCE-6633: --- Thanks [~shahrs87] for reporting this issue and

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-03-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198447#comment-15198447 ] Eric Payne commented on MAPREDUCE-5044: --- [~mingma], [~xgong], [~jlowe], [~jira.shegalov], did

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-02-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Target Version/s: 2.8.0, 2.7.3 (was: 2.8.0) Status: Patch Available (was:

[jira] [Updated] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-02-20 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-5044: -- Attachment: MAPREDUCE-5044.v07.local.patch Thanks, [~jira.shegalov] for all of the work

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-02-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15154866#comment-15154866 ] Eric Payne commented on MAPREDUCE-5044: --- Thanks, [~jira.shegalov]. Would it be okay if I

[jira] [Commented] (MAPREDUCE-5044) Have AM trigger jstack on task attempts that timeout before killing them

2016-02-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15144582#comment-15144582 ] Eric Payne commented on MAPREDUCE-5044: --- Hi [~jira.shegalov]. I would like to see this

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2016-01-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15094249#comment-15094249 ] Eric Payne commented on MAPREDUCE-6473: --- bq. In the above scenario when thread 2 comes along and

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

2016-01-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15092785#comment-15092785 ] Eric Payne commented on MAPREDUCE-6473: --- [~kshukla], Thanks for documenting this problem and

[jira] [Resolved] (MAPREDUCE-2011) Reduce number of getFileStatus call made from every task(TaskDistributedCache) setup

2016-01-11 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-2011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne resolved MAPREDUCE-2011. --- Resolution: Won't Fix [~knoguchi], here are [~jlowe]'s comments from an offline

[jira] [Commented] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

2015-10-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14942414#comment-14942414 ] Eric Payne commented on MAPREDUCE-6451: --- +1 (non-binding) Thanks [~kshukla] for reworking the

[jira] [Commented] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

2015-10-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14940334#comment-14940334 ] Eric Payne commented on MAPREDUCE-6451: --- [~kshukla], Thanks for providing this fix! It looks

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

2015-09-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14739504#comment-14739504 ] Eric Payne commented on MAPREDUCE-5870: --- {quote} As discussed if option-2 is fine, I will raise

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

2015-09-09 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14737076#comment-14737076 ] Eric Payne commented on MAPREDUCE-5870: --- {quote} There's only two ways I can currently think of

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

2015-08-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703789#comment-14703789 ] Eric Payne commented on MAPREDUCE-5870: --- [~sunilg], bq. As YARN-4014 is getting

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

2015-08-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14663133#comment-14663133 ] Eric Payne commented on MAPREDUCE-5870: --- Hi [~sunilg], One thing I forgot to

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

2015-08-07 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14662064#comment-14662064 ] Eric Payne commented on MAPREDUCE-5870: --- [~sunilg], for what it's worth, I have

[jira] [Commented] (MAPREDUCE-6420) Interrupted Exception in LocalContainerLauncher should be logged in warn/info levle

2015-06-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608298#comment-14608298 ] Eric Payne commented on MAPREDUCE-6420: --- [~lichangleo], thank you for fixing

[jira] [Commented] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-06-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14574711#comment-14574711 ] Eric Payne commented on MAPREDUCE-6174: --- Thank you, [~jira.shegalov]! Combine

[jira] [Updated] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-06-03 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6174: -- Attachment: MAPREDUCE-6174.007.patch Thanks [~jira.shegalov]. {quote} We can argue, leave

[jira] [Commented] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-06-02 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569056#comment-14569056 ] Eric Payne commented on MAPREDUCE-6174: --- Thanks, [~jira.shegalov], for your

[jira] [Updated] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6174: -- Status: Patch Available (was: Open) Combine common stream code into parent class for

[jira] [Commented] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-06-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14567430#comment-14567430 ] Eric Payne commented on MAPREDUCE-6174: --- The checkstyle warning is because the

[jira] [Updated] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-05-30 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6174: -- Attachment: MAPREDUCE-6174.006.patch Thank you, [~jira.shegalov], for your detailed

[jira] [Updated] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-05-23 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated MAPREDUCE-6174: -- Attachment: MAPREDUCE-6174.005.patch {quote} This call to the OnDiskMapOutputConstructor

[jira] [Commented] (MAPREDUCE-6174) Combine common stream code into parent class for InMemoryMapOutput and OnDiskMapOutput.

2015-05-16 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14546877#comment-14546877 ] Eric Payne commented on MAPREDUCE-6174: --- Thanks [~jira.shegalov], for your

  1   2   >