[jira] [Commented] (MAPREDUCE-6413) TestLocalJobSubmission is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14601271#comment-14601271 ] Jason Lowe commented on MAPREDUCE-6413: --- I think using localhost can work. If y

[jira] [Updated] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5003: -- Status: Open (was: Patch Available) Thanks for picking this up, [~lichangleo]! This change

[jira] [Commented] (MAPREDUCE-6384) add the last reporting reducer host info and attempt id on the map error message due to too many fetch failure

[ https://issues.apache.org/jira/browse/MAPREDUCE-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14600136#comment-14600136 ] Jason Lowe commented on MAPREDUCE-6384: --- Thanks for the patch [~lichangleo]! Pa

[jira] [Commented] (MAPREDUCE-6413) TestLocalJobSubmission is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599901#comment-14599901 ] Jason Lowe commented on MAPREDUCE-6413: --- Thanks for picking this up, [~zxu]. Do

[jira] [Updated] (MAPREDUCE-6400) Multiple shuffle transfer fails because input is closed too early

[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6400: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Updated] (MAPREDUCE-6400) Multiple shuffle transfer fails because input is closed too early

[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6400: -- Summary: Multiple shuffle transfer fails because input is closed too early (was: TestReduce

[jira] [Commented] (MAPREDUCE-6400) TestReduceFetchFromPartialMem fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14599566#comment-14599566 ] Jason Lowe commented on MAPREDUCE-6400: --- I suspect that connection.disconnect()

[jira] [Commented] (MAPREDUCE-6413) TestLocalJobSubmission is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14597867#comment-14597867 ] Jason Lowe commented on MAPREDUCE-6413: --- This appears to have been broken by MAP

[jira] [Created] (MAPREDUCE-6413) TestLocalJobSubmission is failing

Jason Lowe created MAPREDUCE-6413: - Summary: TestLocalJobSubmission is failing Key: MAPREDUCE-6413 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6413 Project: Hadoop Map/Reduce Issue T

[jira] [Updated] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5948: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6409) NM restarts could lead to app failures

[ https://issues.apache.org/jira/browse/MAPREDUCE-6409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596356#comment-14596356 ] Jason Lowe commented on MAPREDUCE-6409: --- I think it's a little harsh to treat NM

[jira] [Commented] (MAPREDUCE-6400) TestReduceFetchFromPartialMem fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14595999#comment-14595999 ] Jason Lowe commented on MAPREDUCE-6400: --- bq. do you mean iFin in the 003 patch

[jira] [Commented] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593729#comment-14593729 ] Jason Lowe commented on MAPREDUCE-5948: --- +1 for the latest patch. This should r

[jira] [Commented] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593600#comment-14593600 ] Jason Lowe commented on MAPREDUCE-5948: --- Thanks for taking this up, Akira. Will

[jira] [Commented] (MAPREDUCE-6400) TestReduceFetchFromPartialMem fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-6400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592637#comment-14592637 ] Jason Lowe commented on MAPREDUCE-6400: --- Sorry for arriving late. I'm a bit con

[jira] [Commented] (MAPREDUCE-6376) Fix long load times of .jhist file in JobHistoryServer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592564#comment-14592564 ] Jason Lowe commented on MAPREDUCE-6376: --- Sorry for the delay getting to this. b

[jira] [Updated] (MAPREDUCE-6354) ShuffleHandler should be able to log shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6354: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availa

[jira] [Updated] (MAPREDUCE-6354) ShuffleHandler should be able to log shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6354: -- Issue Type: Improvement (was: Bug) Summary: ShuffleHandler should be able to log

[jira] [Updated] (MAPREDUCE-6354) A

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6354: -- Summary: A (was: shuffle handler should log connection info) > A > - > > Ke

[jira] [Commented] (MAPREDUCE-6354) shuffle handler should log connection info

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14573328#comment-14573328 ] Jason Lowe commented on MAPREDUCE-6354: --- Thanks for updating the patch, Chang.

[jira] [Commented] (MAPREDUCE-6354) shuffle handler should log connection info

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571628#comment-14571628 ] Jason Lowe commented on MAPREDUCE-6354: --- Thanks for updating the patch, Chang.

[jira] [Updated] (MAPREDUCE-6374) Distributed Cache File visibility should check permission of full path

[ https://issues.apache.org/jira/browse/MAPREDUCE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6374: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6374) Distributed Cache File visibility should check permission of full path

[ https://issues.apache.org/jira/browse/MAPREDUCE-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571573#comment-14571573 ] Jason Lowe commented on MAPREDUCE-6374: --- +1 lgtm. Committing this. > Distribut

[jira] [Commented] (MAPREDUCE-6369) MR compile shouldn't depend on nodemanager

[ https://issues.apache.org/jira/browse/MAPREDUCE-6369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14550944#comment-14550944 ] Jason Lowe commented on MAPREDUCE-6369: --- Ignoring dependencies due to unit tests

[jira] [Commented] (MAPREDUCE-6222) HistoryServer Hangs Processing Large Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14544289#comment-14544289 ] Jason Lowe commented on MAPREDUCE-6222: --- I'm more worried about the fact that us

[jira] [Commented] (MAPREDUCE-6222) HistoryServer Hangs Processing Large Jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14543753#comment-14543753 ] Jason Lowe commented on MAPREDUCE-6222: --- Doesn't this break searching/sorting in

[jira] [Commented] (MAPREDUCE-5951) Add support for the YARN Shared Cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-5951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14542840#comment-14542840 ] Jason Lowe commented on MAPREDUCE-5951: --- bq. MRApps - we are using "*" instead o

[jira] [Updated] (MAPREDUCE-5465) Tasks are often killed before they exit on their own

[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5465: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Updated] (MAPREDUCE-5465) Tasks are often killed before they exit on their own

[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5465: -- Summary: Tasks are often killed before they exit on their own (was: Container killed before

[jira] [Updated] (MAPREDUCE-4750) Enable NNBenchWithoutMR in MapredTestDriver

[ https://issues.apache.org/jira/browse/MAPREDUCE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4750: -- Labels: BB2015-05-RFC (was: ) Target Version/s: 2.8.0 Status: Pa

[jira] [Updated] (MAPREDUCE-4750) Enable NNBenchWithoutMR in MapredTestDriver

[ https://issues.apache.org/jira/browse/MAPREDUCE-4750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-4750: -- Attachment: MAPREDUCE-4750.002.patch Uploading previous patch with minor whitespace fix. >

[jira] [Updated] (MAPREDUCE-5248) Let NNBenchWithoutMR specify the replication factor for its test

[ https://issues.apache.org/jira/browse/MAPREDUCE-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5248: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Availa

[jira] [Updated] (MAPREDUCE-5248) Let NNBenchWithoutMR specify the replication factor for its test

[ https://issues.apache.org/jira/browse/MAPREDUCE-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5248: -- Labels: (was: BB2015-05-RFC) +1 lgtm. Test failure is unrelated. Committing this. > Let

[jira] [Updated] (MAPREDUCE-3383) Duplicate job.getOutputValueGroupingComparator() in ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3383: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-3383) Duplicate job.getOutputValueGroupingComparator() in ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535479#comment-14535479 ] Jason Lowe commented on MAPREDUCE-3383: --- +1 lgtm. Committing this. > Duplicate

[jira] [Updated] (MAPREDUCE-3383) Duplicate job.getOutputValueGroupingComparator() in ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-3383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3383: -- Labels: (was: BB2015-05-RFC) > Duplicate job.getOutputValueGroupingComparator() in ReduceT

[jira] [Commented] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14535390#comment-14535390 ] Jason Lowe commented on MAPREDUCE-5465: --- _Finally_ carved out some time to take

[jira] [Updated] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5465: -- Labels: (was: BB2015-05-RFC) > Container killed before hprof dumps profile.out > -

[jira] [Updated] (MAPREDUCE-6279) AM should explicity exit JVM after all services have stopped

[ https://issues.apache.org/jira/browse/MAPREDUCE-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6279: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Updated] (MAPREDUCE-6279) AM should explicity exit JVM after all services have stopped

[ https://issues.apache.org/jira/browse/MAPREDUCE-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6279: -- Labels: (was: BB2015-05-TBR) > AM should explicity exit JVM after all services have stoppe

[jira] [Commented] (MAPREDUCE-6279) AM should explicity exit JVM after all services have stopped

[ https://issues.apache.org/jira/browse/MAPREDUCE-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14533458#comment-14533458 ] Jason Lowe commented on MAPREDUCE-6279: --- +1 lgtm. Committing this. > AM should

[jira] [Commented] (MAPREDUCE-6336) Enable v2 FileOutputCommitter by default

[ https://issues.apache.org/jira/browse/MAPREDUCE-6336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14531436#comment-14531436 ] Jason Lowe commented on MAPREDUCE-6336: --- I'm +1 for trunk, assuming there hasn't

[jira] [Updated] (MAPREDUCE-6354) shuffle handler should log connection info

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6354: -- Target Version/s: 2.8.0 Status: Open (was: Patch Available) OK, let's go with

[jira] [Commented] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527367#comment-14527367 ] Jason Lowe commented on MAPREDUCE-6355: --- Here's a snippet from a 2.5 client subm

[jira] [Created] (MAPREDUCE-6355) 2.5 client cannot communicate with 2.5 job on 2.6 cluster

Jason Lowe created MAPREDUCE-6355: - Summary: 2.5 client cannot communicate with 2.5 job on 2.6 cluster Key: MAPREDUCE-6355 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6355 Project: Hadoop Map/

[jira] [Updated] (MAPREDUCE-6259) IllegalArgumentException due to missing job submit time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6259: -- Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status:

[jira] [Updated] (MAPREDUCE-6259) IllegalArgumentException due to missing job submit time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6259: -- Summary: IllegalArgumentException due to missing job submit time (was: -1 job submit time c

[jira] [Commented] (MAPREDUCE-6259) -1 job submit time cause IllegalArgumentException when parse the Job history file name and JOB_INIT_FAILED cause -1 job submit time in JobIndexInfo.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527236#comment-14527236 ] Jason Lowe commented on MAPREDUCE-6259: --- Apologies for the long delay. +1 lgtm.

[jira] [Updated] (MAPREDUCE-5649) Reduce cannot use more than 2G memory for the final merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5649: -- Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-5649) Reduce cannot use more than 2G memory for the final merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527070#comment-14527070 ] Jason Lowe commented on MAPREDUCE-5649: --- +1 lgtm. Committing this. > Reduce ca

[jira] [Commented] (MAPREDUCE-6354) shuffle handler should log connection info

[ https://issues.apache.org/jira/browse/MAPREDUCE-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14527018#comment-14527018 ] Jason Lowe commented on MAPREDUCE-6354: --- bq. I don't think this is a good idea.

[jira] [Commented] (MAPREDUCE-6351) Reducer hung in copy phase.

[ https://issues.apache.org/jira/browse/MAPREDUCE-6351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14526636#comment-14526636 ] Jason Lowe commented on MAPREDUCE-6351: --- I suspect this is a duplicate of MAPRED

[jira] [Updated] (MAPREDUCE-6334) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6334: -- Resolution: Fixed Fix Version/s: 2.7.1 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6334) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14517922#comment-14517922 ] Jason Lowe commented on MAPREDUCE-6334: --- +1 lgtm. Committing this. > Fetcher#c

[jira] [Commented] (MAPREDUCE-6334) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

[ https://issues.apache.org/jira/browse/MAPREDUCE-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14515065#comment-14515065 ] Jason Lowe commented on MAPREDUCE-6334: --- Thanks for the patch, Eric! I think th

[jira] [Commented] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1457#comment-1457 ] Jason Lowe commented on MAPREDUCE-6324: --- bq. One nit: testAllocResponseId is not

[jira] [Updated] (MAPREDUCE-5948) org.apache.hadoop.mapred.LineRecordReader does not handle multibyte record delimiters well

[ https://issues.apache.org/jira/browse/MAPREDUCE-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5948: -- Target Version/s: 2.7.1 (was: 2.6.0) Status: Open (was: Patch Available) Sor

[jira] [Commented] (MAPREDUCE-5649) Reduce cannot use more than 2G memory for the final merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509866#comment-14509866 ] Jason Lowe commented on MAPREDUCE-5649: --- In general looks OK to me. Couple of n

[jira] [Updated] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6324: -- Attachment: MAPREDUCE-6324.002.patch Patch that adds a unit test. > Uber jobs fail to updat

[jira] [Commented] (MAPREDUCE-6279) AM should explicity exit JVM after all services have stopped

[ https://issues.apache.org/jira/browse/MAPREDUCE-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507940#comment-14507940 ] Jason Lowe commented on MAPREDUCE-6279: --- Thanks for picking this up, Eric! Sorr

[jira] [Commented] (MAPREDUCE-6329) Failure of start map task on NM cause job hang

[ https://issues.apache.org/jira/browse/MAPREDUCE-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507718#comment-14507718 ] Jason Lowe commented on MAPREDUCE-6329: --- bq. This would be probably because duri

[jira] [Commented] (MAPREDUCE-6329) Failure of start map task on NM cause job hang

[ https://issues.apache.org/jira/browse/MAPREDUCE-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507595#comment-14507595 ] Jason Lowe commented on MAPREDUCE-6329: --- The RM log shows the two map containers

[jira] [Commented] (MAPREDUCE-6328) NPE in TaskAttemptContextImpl.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507103#comment-14507103 ] Jason Lowe commented on MAPREDUCE-6328: --- FileBench is attempting to wield Sequen

[jira] [Commented] (MAPREDUCE-6329) Failure of start map task on NM cause job hang

[ https://issues.apache.org/jira/browse/MAPREDUCE-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14507067#comment-14507067 ] Jason Lowe commented on MAPREDUCE-6329: --- Scanning the AM logs, it looks like thi

[jira] [Commented] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14505805#comment-14505805 ] Jason Lowe commented on MAPREDUCE-6324: --- Thanks for the review, Robert! Yes, th

[jira] [Updated] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6324: -- Attachment: MAPREDUCE-6324.001.patch Patch that fixes two problems with the LocalContainerAl

[jira] [Updated] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

[ https://issues.apache.org/jira/browse/MAPREDUCE-6324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6324: -- Status: Patch Available (was: Open) > Uber jobs fail to update AMRM token when it rolls ove

[jira] [Created] (MAPREDUCE-6324) Uber jobs fail to update AMRM token when it rolls over

Jason Lowe created MAPREDUCE-6324: - Summary: Uber jobs fail to update AMRM token when it rolls over Key: MAPREDUCE-6324 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6324 Project: Hadoop Map/Red

[jira] [Commented] (MAPREDUCE-5465) Container killed before hprof dumps profile.out

[ https://issues.apache.org/jira/browse/MAPREDUCE-5465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14504966#comment-14504966 ] Jason Lowe commented on MAPREDUCE-5465: --- Sorry, I have been very busy as of late

[jira] [Assigned] (MAPREDUCE-6299) bzip2 codec read duplicate rows

[ https://issues.apache.org/jira/browse/MAPREDUCE-6299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6299: - Assignee: (was: Jason Lowe) Sorry for the delay, as I was out on vacation. I am

[jira] [Updated] (MAPREDUCE-6303) Read timeout when retrying a fetch error can be fatal to a reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6303: -- Status: Patch Available (was: Open) > Read timeout when retrying a fetch error can be fatal

[jira] [Updated] (MAPREDUCE-6303) Read timeout when retrying a fetch error can be fatal to a reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6303: -- Attachment: MAPREDUCE-6303.001.patch Patch that treats errors from setupConnectionsWithRetry

[jira] [Assigned] (MAPREDUCE-6303) Read timeout when retrying a fetch error can be fatal to a reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6303: - Assignee: Jason Lowe > Read timeout when retrying a fetch error can be fatal to a red

[jira] [Commented] (MAPREDUCE-6303) Read timeout when retrying a fetch error can be fatal to a reducer

[ https://issues.apache.org/jira/browse/MAPREDUCE-6303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14391516#comment-14391516 ] Jason Lowe commented on MAPREDUCE-6303: --- Sample reduce log snippet showing the i

[jira] [Created] (MAPREDUCE-6303) Read timeout when retrying a fetch error can be fatal to a reducer

Jason Lowe created MAPREDUCE-6303: - Summary: Read timeout when retrying a fetch error can be fatal to a reducer Key: MAPREDUCE-6303 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6303 Project: H

[jira] [Commented] (MAPREDUCE-5036) Default shuffle handler port should not be 8080

[ https://issues.apache.org/jira/browse/MAPREDUCE-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14389053#comment-14389053 ] Jason Lowe commented on MAPREDUCE-5036: --- bq. Either we don't allow ephemeral por

[jira] [Updated] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6275: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370163#comment-14370163 ] Jason Lowe commented on MAPREDUCE-6275: --- I'd like to get this in today since 2.7

[jira] [Commented] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14369652#comment-14369652 ] Jason Lowe commented on MAPREDUCE-6275: --- +1 lgtm. I'll commit this later today

[jira] [Updated] (MAPREDUCE-6277) Job can post multiple history files if attempt loses connection to the RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6277: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6277) Job can post multiple history files if attempt loses connection to the RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367720#comment-14367720 ] Jason Lowe commented on MAPREDUCE-6277: --- +1 lgtm. Committing this. > Job can p

[jira] [Created] (MAPREDUCE-6279) AM should explicity exit JVM after all services have stopped

Jason Lowe created MAPREDUCE-6279: - Summary: AM should explicity exit JVM after all services have stopped Key: MAPREDUCE-6279 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6279 Project: Hadoop

[jira] [Commented] (MAPREDUCE-6277) Job can post multiple history files if attempt loses connection to the RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367549#comment-14367549 ] Jason Lowe commented on MAPREDUCE-6277: --- Thanks for updating the patch, Chang.

[jira] [Updated] (MAPREDUCE-6277) Job can post multiple history files if attempt loses connection to the RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6277: -- Component/s: mr-am > Job can post multiple history files if attempt loses connection to the

[jira] [Updated] (MAPREDUCE-6277) Job can post multiple history files if attempt loses connection to the RM

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6277: -- Target Version/s: 2.7.0 Summary: Job can post multiple history files if attempt

[jira] [Moved] (MAPREDUCE-6277) Job In Error State Will Lost Jobhistory Of Second and Later Attempts

[ https://issues.apache.org/jira/browse/MAPREDUCE-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-3335 to MAPREDUCE-6277: - Affects Version/s: (was: 2.7.0) 2.7.0

[jira] [Commented] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14367128#comment-14367128 ] Jason Lowe commented on MAPREDUCE-6275: --- bq.I did not change the semantics of th

[jira] [Commented] (MAPREDUCE-6275) Race condition in FileOutputCommitter v2 for user-specified task output subdirs

[ https://issues.apache.org/jira/browse/MAPREDUCE-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366138#comment-14366138 ] Jason Lowe commented on MAPREDUCE-6275: --- Thanks for working on the patch, Gera a

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14353048#comment-14353048 ] Jason Lowe commented on MAPREDUCE-4815: --- +1 from me as well for v17. Thanks aga

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350855#comment-14350855 ] Jason Lowe commented on MAPREDUCE-4815: --- Yes, I see. Again I'm not against leav

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14350537#comment-14350537 ] Jason Lowe commented on MAPREDUCE-4815: --- Thanks for the clarification, Siqi. Th

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14347774#comment-14347774 ] Jason Lowe commented on MAPREDUCE-4815: --- Took a closer look at the patch, patch

[jira] [Commented] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14343756#comment-14343756 ] Jason Lowe commented on MAPREDUCE-5583: --- bq. So the return value for requestLimi

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14340405#comment-14340405 ] Jason Lowe commented on MAPREDUCE-4815: --- bq. Jason Lowe, would you mind taking a

[jira] [Commented] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14339096#comment-14339096 ] Jason Lowe commented on MAPREDUCE-5583: --- bq. If so, I think we should keep the l

[jira] [Updated] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5583: -- Attachment: MAPREDUCE-5583v4.patch Thanks for the review, Junping! bq. I see we checked thr

[jira] [Updated] (MAPREDUCE-5583) Ability to limit running map and reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-5583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5583: -- Attachment: MAPREDUCE-5583v3.patch bq. The configure mapreduce.job.running.reduces.limit in

[jira] [Created] (MAPREDUCE-6263) Large jobs can lose history when killed due to brief client timeout

Jason Lowe created MAPREDUCE-6263: - Summary: Large jobs can lose history when killed due to brief client timeout Key: MAPREDUCE-6263 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6263 Project:

[jira] [Updated] (MAPREDUCE-6261) NullPointerException if MapOutputBuffer.flush invoked twice

[ https://issues.apache.org/jira/browse/MAPREDUCE-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6261: -- Resolution: Fixed Fix Version/s: 2.7.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (MAPREDUCE-6261) NullPointerException if MapOutputBuffer.flush invoked twice

[ https://issues.apache.org/jira/browse/MAPREDUCE-6261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326424#comment-14326424 ] Jason Lowe commented on MAPREDUCE-6261: --- +1 lgtm. Committing this. > NullPoi

<    2   3   4   5   6   7   8   9   10   11   >