[jira] [Commented] (MAPREDUCE-6533) testDetermineCacheVisibilities of TestClientDistributedCacheManager is broken

[ https://issues.apache.org/jira/browse/MAPREDUCE-6533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14985502#comment-14985502 ] Jason Lowe commented on MAPREDUCE-6533: --- Could you elaborate on what the problem

[jira] [Commented] (MAPREDUCE-6529) AppMaster will not retry to request resource if AppMaster happens to decide to not use the resource

[ https://issues.apache.org/jira/browse/MAPREDUCE-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14983230#comment-14983230 ] Jason Lowe commented on MAPREDUCE-6529: --- bq. For example, in a heterogeneous clu

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6528: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.6.3

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982690#comment-14982690 ] Jason Lowe commented on MAPREDUCE-6528: --- +1, committing this. > Memory leak for

[jira] [Updated] (MAPREDUCE-6273) HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state

[ https://issues.apache.org/jira/browse/MAPREDUCE-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6273: -- Fix Version/s: 2.6.3 I committed this to branch-2.6 as well. > HistoryFileManager should ch

[jira] [Commented] (MAPREDUCE-6529) AppMaster will not retry to request resource if AppMaster happens to decide to not use the resource

[ https://issues.apache.org/jira/browse/MAPREDUCE-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14982611#comment-14982611 ] Jason Lowe commented on MAPREDUCE-6529: --- I'm a little confused based on the word

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6528: -- Target Version/s: 2.7.2 (was: 2.8.0) > Memory leak for HistoryFileManager.getJobSummary() >

[jira] [Updated] (MAPREDUCE-6273) HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state

[ https://issues.apache.org/jira/browse/MAPREDUCE-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6273: -- Fix Version/s: (was: 2.8.0) 2.7.2 Thanks, [~zxu]! I committed this t

[jira] [Updated] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6515: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Updated] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6515: -- Fix Version/s: (was: 2.7.2) 2.8.0 > Update Application priority in AM

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980924#comment-14980924 ] Jason Lowe commented on MAPREDUCE-6515: --- +1, latest patch lgtm. Committing this

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14974980#comment-14974980 ] Jason Lowe commented on MAPREDUCE-6515: --- Thanks for updating the patch, Sunil!

[jira] [Commented] (MAPREDUCE-6523) hadoop-yarn Avoid unsafe split and append on fields that might be IPv6 literals

[ https://issues.apache.org/jira/browse/MAPREDUCE-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971683#comment-14971683 ] Jason Lowe commented on MAPREDUCE-6523: --- Sorry, meant to state that I just added

[jira] [Commented] (MAPREDUCE-6523) hadoop-yarn Avoid unsafe split and append on fields that might be IPv6 literals

[ https://issues.apache.org/jira/browse/MAPREDUCE-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971682#comment-14971682 ] Jason Lowe commented on MAPREDUCE-6523: --- bq. It seems I cannot assign JIRA under

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14971056#comment-14971056 ] Jason Lowe commented on MAPREDUCE-6515: --- Thanks for the patch, Sunil! I think w

[jira] [Updated] (MAPREDUCE-6518) Set SO_KEEPALIVE on shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6518: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Commented] (MAPREDUCE-6518) Set SO_KEEPALIVE on shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14968009#comment-14968009 ] Jason Lowe commented on MAPREDUCE-6518: --- +1 lgtm. Committing this. > Set SO_KE

[jira] [Updated] (MAPREDUCE-6518) Set SO_KEEPALIVE on shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6518: -- Summary: Set SO_KEEPALIVE on shuffle connections (was: Set SO_KEEPALIVE on NM servers) Tha

[jira] [Moved] (MAPREDUCE-6518) Set SO_KEEPALIVE on NM servers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-4052 to MAPREDUCE-6518: - Affects Version/s: (was: 2.7.1) 2.7.1

[jira] [Updated] (MAPREDUCE-6489) Fail fast rogue tasks that write too much to local disk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6489: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6489) Fail fast rogue tasks that write too much to local disk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14966849#comment-14966849 ] Jason Lowe commented on MAPREDUCE-6489: --- +1, committing this. > Fail fast rogue

[jira] [Commented] (MAPREDUCE-6489) Fail fast rogue tasks that write too much to local disk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965902#comment-14965902 ] Jason Lowe commented on MAPREDUCE-6489: --- +1 latest patch looks good to me. Howe

[jira] [Commented] (MAPREDUCE-6516) JVM reuse in Yarn

[ https://issues.apache.org/jira/browse/MAPREDUCE-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14965842#comment-14965842 ] Jason Lowe commented on MAPREDUCE-6516: --- Moved this to MAPREDUCE. JVM reuse is

[jira] [Moved] (MAPREDUCE-6516) JVM reuse in Yarn

[ https://issues.apache.org/jira/browse/MAPREDUCE-6516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-4282 to MAPREDUCE-6516: - Key: MAPREDUCE-6516 (was: YARN-4282) Project: Hadoop Map/Redu

[jira] [Resolved] (MAPREDUCE-4938) Job submission to unknown queue can leave staging directory behind

[ https://issues.apache.org/jira/browse/MAPREDUCE-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4938. --- Resolution: Duplicate > Job submission to unknown queue can leave staging directory behind

[jira] [Commented] (MAPREDUCE-4938) Job submission to unknown queue can leave staging directory behind

[ https://issues.apache.org/jira/browse/MAPREDUCE-4938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14959787#comment-14959787 ] Jason Lowe commented on MAPREDUCE-4938: --- This is fixed by YARN-3131 since applic

[jira] [Commented] (MAPREDUCE-6489) Fail fast rogue tasks that write too much to local disk

[ https://issues.apache.org/jira/browse/MAPREDUCE-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14950551#comment-14950551 ] Jason Lowe commented on MAPREDUCE-6489: --- Thanks for the patch, Maysam! I think

[jira] [Commented] (MAPREDUCE-6302) Incorrect headroom can lead to a deadlock between map and reduce allocations

[ https://issues.apache.org/jira/browse/MAPREDUCE-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14941135#comment-14941135 ] Jason Lowe commented on MAPREDUCE-6302: --- Since the old code also doesn't preempt

[jira] [Commented] (MAPREDUCE-6302) Incorrect headroom can lead to a deadlock between map and reduce allocations

[ https://issues.apache.org/jira/browse/MAPREDUCE-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14940173#comment-14940173 ] Jason Lowe commented on MAPREDUCE-6302: --- bq. Aren't all reducers in SHUFFLE phas

[jira] [Commented] (MAPREDUCE-6302) Incorrect headroom can lead to a deadlock between map and reduce allocations

[ https://issues.apache.org/jira/browse/MAPREDUCE-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939976#comment-14939976 ] Jason Lowe commented on MAPREDUCE-6302: --- I think it's reasonable. There were a

[jira] [Updated] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6492: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Commented] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934162#comment-14934162 ] Jason Lowe commented on MAPREDUCE-6492: --- +1 lgtm. Committing this. > AsyncDisp

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14934111#comment-14934111 ] Jason Lowe commented on MAPREDUCE-6491: --- Latest patch looks good to me, but when

[jira] [Commented] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933583#comment-14933583 ] Jason Lowe commented on MAPREDUCE-6492: --- Yeah, we can just protect sendJHStartEv

[jira] [Comment Edited] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933527#comment-14933527 ] Jason Lowe edited comment on MAPREDUCE-6492 at 9/28/15 4:30 PM:

[jira] [Commented] (MAPREDUCE-6492) AsyncDispatcher exit with NPE on TaskAttemptImpl#sendJHStartEventForAssignedFailTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14933527#comment-14933527 ] Jason Lowe commented on MAPREDUCE-6492: --- Thanks for the report and patch, Bibin!

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14907012#comment-14907012 ] Jason Lowe commented on MAPREDUCE-6473: --- The problem is this step: bq. T1 hasn't

[jira] [Commented] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906953#comment-14906953 ] Jason Lowe commented on MAPREDUCE-6473: --- Curious, why are we using a separate bo

[jira] [Commented] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906947#comment-14906947 ] Jason Lowe commented on MAPREDUCE-5003: --- Thanks for updating the patch, Chang!

[jira] [Updated] (MAPREDUCE-6473) Job submission can take a long time during Cluster initialization

[ https://issues.apache.org/jira/browse/MAPREDUCE-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6473: -- Target Version/s: 2.8.0 Status: Open (was: Patch Available) Thanks for the pa

[jira] [Commented] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14906522#comment-14906522 ] Jason Lowe commented on MAPREDUCE-6491: --- bq. sorry this took so long, I got side

[jira] [Moved] (MAPREDUCE-6491) Environment variable handling assumes values should be appended

[ https://issues.apache.org/jira/browse/MAPREDUCE-6491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-2369 to MAPREDUCE-6491: - Affects Version/s: (was: 2.2.0) 2.2.0

[jira] [Updated] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5982: -- Fix Version/s: (was: 2.8.0) 2.7.2 Thanks Chang! +1 for the branch-2.

[jira] [Updated] (MAPREDUCE-6481) LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6481: -- Fix Version/s: (was: 2.8.0) 2.7.2 I committed this to branch-2.7 as w

[jira] [Updated] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5948: -- Fix Version/s: (was: 2.8.0) 2.7.2 I committed this to branch-2.7 as w

[jira] [Commented] (MAPREDUCE-6481) LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875728#comment-14875728 ] Jason Lowe commented on MAPREDUCE-6481: --- Sure, I'll pull both of them into the 2

[jira] [Updated] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5982: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14804557#comment-14804557 ] Jason Lowe commented on MAPREDUCE-5982: --- +1 latest patch lgtm. Committing this.

[jira] [Updated] (MAPREDUCE-5002) AM could potentially allocate a reduce container to a map attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5002: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-5002) AM could potentially allocate a reduce container to a map attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14803165#comment-14803165 ] Jason Lowe commented on MAPREDUCE-5002: --- +1 latest patch lgtm. Committing this.

[jira] [Updated] (MAPREDUCE-6481) LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6481: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6481) LineRecordReader may give incomplete record and wrong position/key information for uncompressed input sometimes.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14802970#comment-14802970 ] Jason Lowe commented on MAPREDUCE-6481: --- Nice catch! Excellent analysis, and pa

[jira] [Updated] (MAPREDUCE-6472) MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6472: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Commented] (MAPREDUCE-6472) MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14746012#comment-14746012 ] Jason Lowe commented on MAPREDUCE-6472: --- +1 lgtm. Committing this. > MapReduce

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745511#comment-14745511 ] Jason Lowe commented on MAPREDUCE-5870: --- I too struggle with whether it's worth

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14743954#comment-14743954 ] Jason Lowe commented on MAPREDUCE-5870: --- I honestly don't know how much the prio

[jira] [Updated] (MAPREDUCE-6474) ShuffleHandler can possibly exhaust nodemanager file descriptors

[ https://issues.apache.org/jira/browse/MAPREDUCE-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6474: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Updated] (MAPREDUCE-6474) ShuffleHandler can possibly exhaust nodemanager file descriptors

[ https://issues.apache.org/jira/browse/MAPREDUCE-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6474: -- Summary: ShuffleHandler can possibly exhaust nodemanager file descriptors (was: Nodemanager

[jira] [Moved] (MAPREDUCE-6474) Nodemanager ShuffleHandler can possible exhaust file descriptors

[ https://issues.apache.org/jira/browse/MAPREDUCE-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-2410 to MAPREDUCE-6474: - Affects Version/s: (was: 2.5.0) 2.5.0

[jira] [Commented] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737484#comment-14737484 ] Jason Lowe commented on MAPREDUCE-5003: --- Thanks for updating the patch, Chang!

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14737035#comment-14737035 ] Jason Lowe commented on MAPREDUCE-5870: --- bq. AppReport has the information about

[jira] [Commented] (MAPREDUCE-6415) Create a tool to combine aggregated logs into HAR files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14736983#comment-14736983 ] Jason Lowe commented on MAPREDUCE-6415: --- +1 latest patch looks good to me. Will

[jira] [Updated] (MAPREDUCE-5982) Task attempts that fail from the ASSIGNED state can disappear

[ https://issues.apache.org/jira/browse/MAPREDUCE-5982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5982: -- Status: Open (was: Patch Available) Thanks for the patch, Chang! Note that the point of th

[jira] [Commented] (MAPREDUCE-5002) AM could potentially allocate a reduce container to a map attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735595#comment-14735595 ] Jason Lowe commented on MAPREDUCE-5002: --- Thanks for the patch, Chang! Main chan

[jira] [Created] (MAPREDUCE-6472) MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks

Jason Lowe created MAPREDUCE-6472: - Summary: MapReduce AM should have java.io.tmpdir=./tmp to be consistent with tasks Key: MAPREDUCE-6472 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6472 Pro

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735105#comment-14735105 ] Jason Lowe commented on MAPREDUCE-5870: --- Thanks for updating the patch! We cann

[jira] [Commented] (MAPREDUCE-6442) Stack trace missing for client protocol provider creation error

[ https://issues.apache.org/jira/browse/MAPREDUCE-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727713#comment-14727713 ] Jason Lowe commented on MAPREDUCE-6442: --- Latest patch looks good. Was this one

[jira] [Commented] (MAPREDUCE-6415) Create a tool to combine aggregated logs into HAR files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723969#comment-14723969 ] Jason Lowe commented on MAPREDUCE-6415: --- mvn dependency:analyze says there's a n

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14723469#comment-14723469 ] Jason Lowe commented on MAPREDUCE-5870: --- Thanks for updating the patch, Sunil!

[jira] [Commented] (MAPREDUCE-6415) Create a tool to combine aggregated logs into HAR files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14720191#comment-14720191 ] Jason Lowe commented on MAPREDUCE-6415: --- Have been very busy, but I will try to

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14703060#comment-14703060 ] Jason Lowe commented on MAPREDUCE-5870: --- bq. But now YARN has the capability to

[jira] [Commented] (MAPREDUCE-5870) Support for passing Job priority through Application Submission Context in Mapreduce Side

[ https://issues.apache.org/jira/browse/MAPREDUCE-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14702081#comment-14702081 ] Jason Lowe commented on MAPREDUCE-5870: --- Thanks for the patch, Sunil. Looks goo

[jira] [Commented] (MAPREDUCE-6439) AM may fail instead of retrying if RM is restarting/shutting down during the allocate call

[ https://issues.apache.org/jira/browse/MAPREDUCE-6439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14653796#comment-14653796 ] Jason Lowe commented on MAPREDUCE-6439: --- I think a Mapreduce AM client-side fix

[jira] [Updated] (MAPREDUCE-6442) Stack trace missing for client protocol provider creation error

[ https://issues.apache.org/jira/browse/MAPREDUCE-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6442: -- Summary: Stack trace missing for client protocol provider creation error (was: whe

[jira] [Updated] (MAPREDUCE-6394) Speed up Task processing loop in HsTasksBlock#render()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6394: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6394) Speed up Task processing loop in HsTasksBlock#render()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14649589#comment-14649589 ] Jason Lowe commented on MAPREDUCE-6394: --- +1 for the latest patch. Committing th

[jira] [Commented] (MAPREDUCE-6394) Speed up Task processing loop in HsTasksBlock#render()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14646327#comment-14646327 ] Jason Lowe commented on MAPREDUCE-6394: --- Thanks for updating the patch. I think

[jira] [Commented] (MAPREDUCE-6394) Speed up Task processing loop in HsTasksBlock#render()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643434#comment-14643434 ] Jason Lowe commented on MAPREDUCE-6394: --- Thanks for updating the patch, Ray! In

[jira] [Commented] (MAPREDUCE-6415) Create a tool to combine aggregated logs into HAR files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635992#comment-14635992 ] Jason Lowe commented on MAPREDUCE-6415: --- Note that container IDs are not guarant

[jira] [Commented] (MAPREDUCE-6394) Speed up Task processing loop in HsTasksBlock#render()

[ https://issues.apache.org/jira/browse/MAPREDUCE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635878#comment-14635878 ] Jason Lowe commented on MAPREDUCE-6394: --- Thanks for the analysis and patch, Ray!

[jira] [Commented] (MAPREDUCE-6437) Add retry on some connection exception on job commit phase

[ https://issues.apache.org/jira/browse/MAPREDUCE-6437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635151#comment-14635151 ] Jason Lowe commented on MAPREDUCE-6437: --- There are a couple of problems here. F

[jira] [Updated] (MAPREDUCE-6418) MRApp should not shutdown LogManager during shutdown

[ https://issues.apache.org/jira/browse/MAPREDUCE-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6418: -- Affects Version/s: 2.3.0 Hadoop Flags: Reviewed Component/s: test +1 lgtm

[jira] [Updated] (MAPREDUCE-6418) MRApp should not shutdown LogManager during shutdown

[ https://issues.apache.org/jira/browse/MAPREDUCE-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6418: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availa

[jira] [Updated] (MAPREDUCE-6420) Interrupted Exception in LocalContainerLauncher should be logged in warn/info level

[ https://issues.apache.org/jira/browse/MAPREDUCE-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6420: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (MAPREDUCE-6420) Interrupted Exception in LocalContainerLauncher should be logged in warn/info level

[ https://issues.apache.org/jira/browse/MAPREDUCE-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6420: -- Summary: Interrupted Exception in LocalContainerLauncher should be logged in warn/info level

[jira] [Commented] (MAPREDUCE-6420) Interrupted Exception in LocalContainerLauncher should be logged in warn/info levle

[ https://issues.apache.org/jira/browse/MAPREDUCE-6420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610708#comment-14610708 ] Jason Lowe commented on MAPREDUCE-6420: --- +1, committing this. > Interrupted Exc

[jira] [Updated] (MAPREDUCE-6376) Add avro binary support for jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6376: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6376) Add avro binary support for jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14610523#comment-14610523 ] Jason Lowe commented on MAPREDUCE-6376: --- +1. Committing this. > Add avro binar

[jira] [Updated] (MAPREDUCE-6384) Add the last reporting reducer info for too many fetch failure diagnostics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6384: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (MAPREDUCE-6384) Add the last reporting reducer info for too many fetch failure diagnostics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6384: -- Summary: Add the last reporting reducer info for too many fetch failure diagnostics (was: a

[jira] [Commented] (MAPREDUCE-6384) add the last reporting reducer host info and attempt id on the map error message due to too many fetch failure

[ https://issues.apache.org/jira/browse/MAPREDUCE-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14609033#comment-14609033 ] Jason Lowe commented on MAPREDUCE-6384: --- +1 lgtm. Committing this. > add the l

[jira] [Commented] (MAPREDUCE-6376) Add avro binary support for jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14608615#comment-14608615 ] Jason Lowe commented on MAPREDUCE-6376: --- Couple of issues with the new log warni

[jira] [Commented] (MAPREDUCE-6384) add the last reporting reducer host info and attempt id on the map error message due to too many fetch failure

[ https://issues.apache.org/jira/browse/MAPREDUCE-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606397#comment-14606397 ] Jason Lowe commented on MAPREDUCE-6384: --- Thanks for updating the patch, just a c

[jira] [Commented] (MAPREDUCE-6418) MRApp should not shutdown LogManager during shutdown

[ https://issues.apache.org/jira/browse/MAPREDUCE-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606332#comment-14606332 ] Jason Lowe commented on MAPREDUCE-6418: --- Nit: The comment wording could be impro

[jira] [Commented] (MAPREDUCE-6418) MRApp should not shutdown LogManager during shutdown

[ https://issues.apache.org/jira/browse/MAPREDUCE-6418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606037#comment-14606037 ] Jason Lowe commented on MAPREDUCE-6418: --- Thanks for the patch, Chang! There's a

[jira] [Updated] (MAPREDUCE-6376) Add avro binary support for jhist files

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6376: -- Summary: Add avro binary support for jhist files (was: Fix long load times of .jhist file i

[jira] [Commented] (MAPREDUCE-6376) Fix long load times of .jhist file in JobHistoryServer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603688#comment-14603688 ] Jason Lowe commented on MAPREDUCE-6376: --- It's complaining about pre-patch trunk,

[jira] [Updated] (MAPREDUCE-6413) TestLocalJobSubmission is failing with unknown host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6413: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availa

[jira] [Updated] (MAPREDUCE-6413) TestLocalJobSubmission is failing with unknown host

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6413: -- Affects Version/s: (was: 2.7.1) 2.8.0 Hadoop Flags: Revie

[jira] [Commented] (MAPREDUCE-6413) TestLocalJobSubmission is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601664#comment-14601664 ] Jason Lowe commented on MAPREDUCE-6413: --- +1 pending Jenkins. > TestLocalJobSubm

<    1   2   3   4   5   6   7   8   9   10   >