[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977916#comment-13977916 ] Hadoop QA commented on MAPREDUCE-5841: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977932#comment-13977932 ] Akira AJISAKA commented on MAPREDUCE-5809: -- Great job, [~cnauroth]! For the d

[jira] [Commented] (MAPREDUCE-5652) NM Recovery. ShuffleHandler should handle NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977938#comment-13977938 ] Ming Ma commented on MAPREDUCE-5652: Nice work. Jason, I would like to clarify how

[jira] [Commented] (MAPREDUCE-4718) MapReduce fails If I pass a parameter as a S3 folder

[ https://issues.apache.org/jira/browse/MAPREDUCE-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977962#comment-13977962 ] Steve Loughran commented on MAPREDUCE-4718: --- can we leave this open, but I'l

[jira] [Commented] (MAPREDUCE-5812) Make task context available to OutputCommitter.isRecoverySupported()

[ https://issues.apache.org/jira/browse/MAPREDUCE-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13977977#comment-13977977 ] Mohammad Kamrul Islam commented on MAPREDUCE-5812: -- Do I need to addr

[jira] [Commented] (MAPREDUCE-5827) TestSpeculativeExecutionWithMRApp fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978071#comment-13978071 ] Hudson commented on MAPREDUCE-5827: --- FAILURE: Integrated in Hadoop-Yarn-trunk #549 (

[jira] [Commented] (MAPREDUCE-5832) Few tests in TestJobClient fail on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978069#comment-13978069 ] Hudson commented on MAPREDUCE-5832: --- FAILURE: Integrated in Hadoop-Yarn-trunk #549 (

[jira] [Commented] (MAPREDUCE-5833) TestRMContainerAllocator fails ocassionally

[ https://issues.apache.org/jira/browse/MAPREDUCE-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978068#comment-13978068 ] Hudson commented on MAPREDUCE-5833: --- FAILURE: Integrated in Hadoop-Yarn-trunk #549 (

[jira] [Commented] (MAPREDUCE-5832) Few tests in TestJobClient fail on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978187#comment-13978187 ] Hudson commented on MAPREDUCE-5832: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-5833) TestRMContainerAllocator fails ocassionally

[ https://issues.apache.org/jira/browse/MAPREDUCE-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978186#comment-13978186 ] Hudson commented on MAPREDUCE-5833: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-5827) TestSpeculativeExecutionWithMRApp fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978189#comment-13978189 ] Hudson commented on MAPREDUCE-5827: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Commented] (MAPREDUCE-5832) Few tests in TestJobClient fail on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978208#comment-13978208 ] Hudson commented on MAPREDUCE-5832: --- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1741

[jira] [Commented] (MAPREDUCE-5827) TestSpeculativeExecutionWithMRApp fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-5827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978210#comment-13978210 ] Hudson commented on MAPREDUCE-5827: --- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1741

[jira] [Commented] (MAPREDUCE-5833) TestRMContainerAllocator fails ocassionally

[ https://issues.apache.org/jira/browse/MAPREDUCE-5833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978207#comment-13978207 ] Hudson commented on MAPREDUCE-5833: --- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1741

[jira] [Updated] (MAPREDUCE-5605) Memory-centric MapReduce aiming to solve the I/O bottleneck

[ https://issues.apache.org/jira/browse/MAPREDUCE-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Chen updated MAPREDUCE-5605: - Attachment: TR-mammoth-HUST.pdf The design, evaluation and discoveries are included in the pa

[jira] [Commented] (MAPREDUCE-5605) Memory-centric MapReduce aiming to solve the I/O bottleneck

[ https://issues.apache.org/jira/browse/MAPREDUCE-5605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978236#comment-13978236 ] Hadoop QA commented on MAPREDUCE-5605: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-3838) MapReduce job submission time has increased in 0.23 when compared to 0.20.206

[ https://issues.apache.org/jira/browse/MAPREDUCE-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978290#comment-13978290 ] Mit Desai commented on MAPREDUCE-3838: -- removing the target version of 0.23.3 and

[jira] [Updated] (MAPREDUCE-3838) MapReduce job submission time has increased in 0.23 when compared to 0.20.206

[ https://issues.apache.org/jira/browse/MAPREDUCE-3838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated MAPREDUCE-3838: - Target Version/s: 3.0.0, 2.5.0 (was: 0.23.3, 2.0.0-alpha, 3.0.0) > MapReduce job submission

[jira] [Commented] (MAPREDUCE-5812) Make task context available to OutputCommitter.isRecoverySupported()

[ https://issues.apache.org/jira/browse/MAPREDUCE-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978356#comment-13978356 ] Jason Lowe commented on MAPREDUCE-5812: --- Yes, the findbug warnings need to be ad

[jira] [Updated] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated MAPREDUCE-5846: -- Status: Patch Available (was: Open) > Rumen doesn't understand JobQueueChangedEven

[jira] [Commented] (MAPREDUCE-5809) Enhance distcp to support preserving HDFS ACLs.

[ https://issues.apache.org/jira/browse/MAPREDUCE-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978373#comment-13978373 ] Chris Nauroth commented on MAPREDUCE-5809: -- Thanks, [~ajisakaa]! I can code

[jira] [Commented] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978509#comment-13978509 ] Hadoop QA commented on MAPREDUCE-5846: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978517#comment-13978517 ] Hadoop QA commented on MAPREDUCE-5841: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5652) NM Recovery. ShuffleHandler should handle NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978561#comment-13978561 ] Jason Lowe commented on MAPREDUCE-5652: --- Thanks for the feedback, Ming! For the

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978574#comment-13978574 ] Jason Lowe commented on MAPREDUCE-5841: --- bq. Since the uber job executes task at

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978614#comment-13978614 ] Sangjin Lee commented on MAPREDUCE-5841: Thanks Jason. Yes, the test timeout

[jira] [Resolved] (MAPREDUCE-4852) Reducer should not signal fetch failures for disk errors on the reducer's side

[ https://issues.apache.org/jira/browse/MAPREDUCE-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4852. --- Resolution: Duplicate This was fixed by MAPREDUCE-5251. > Reducer should not signal fetc

[jira] [Commented] (MAPREDUCE-5845) TestShuffleHandler failing intermittently on windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978727#comment-13978727 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5845: The test fail

[jira] [Resolved] (MAPREDUCE-4816) JobImpl Invalid event: JOB_TASK_ATTEMPT_COMPLETED at FAILED

[ https://issues.apache.org/jira/browse/MAPREDUCE-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-4816. --- Resolution: Duplicate Fixed by MAPREDUCE-4774. > JobImpl Invalid event: JOB_TASK_ATTEMPT

[jira] [Commented] (MAPREDUCE-5652) NM Recovery. ShuffleHandler should handle NM restarts

[ https://issues.apache.org/jira/browse/MAPREDUCE-5652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978830#comment-13978830 ] Ming Ma commented on MAPREDUCE-5652: Thanks, Jason. It is good to know it will be

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978930#comment-13978930 ] Jason Lowe commented on MAPREDUCE-5841: --- +1 latest patch looks good to me. Comm

[jira] [Commented] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978946#comment-13978946 ] Nathan Roberts commented on MAPREDUCE-5846: --- verified by running org.apache.

[jira] [Created] (MAPREDUCE-5855) Oozie jobs able to affect container classpath

Michael Miklavcic created MAPREDUCE-5855: Summary: Oozie jobs able to affect container classpath Key: MAPREDUCE-5855 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5855 Project: Hadoop Ma

[jira] [Updated] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5841: -- Resolution: Fixed Fix Version/s: 2.4.1 Hadoop Flags: Reviewed Status:

[jira] [Updated] (MAPREDUCE-5855) Oozie jobs able to affect container classpath

[ https://issues.apache.org/jira/browse/MAPREDUCE-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Miklavcic updated MAPREDUCE-5855: - Attachment: oozie-error.tar.gz yarn-stacktrace.txt The key is

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13978979#comment-13978979 ] Hudson commented on MAPREDUCE-5841: --- SUCCESS: Integrated in Hadoop-trunk-Commit #555

[jira] [Created] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

Robert Kanter created MAPREDUCE-5856: Summary: Counter limits always use defaults even if JobClient is given a different Configuration Key: MAPREDUCE-5856 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5

[jira] [Commented] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979006#comment-13979006 ] Robert Kanter commented on MAPREDUCE-5856: -- The problem is that Limits is loo

[jira] [Updated] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-5856: - Attachment: MAPREDUCE-5856.patch The fix is very simple; we just need to call {{Limit

[jira] [Updated] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-5856: - Status: Patch Available (was: Open) > Counter limits always use defaults even if Job

[jira] [Commented] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979015#comment-13979015 ] Jason Lowe commented on MAPREDUCE-5856: --- One related issue with allowing jobs to

[jira] [Commented] (MAPREDUCE-5841) uber job doesn't terminate on getting mapred job kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-5841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979030#comment-13979030 ] Sangjin Lee commented on MAPREDUCE-5841: Thanks Jason for the review and great

[jira] [Commented] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979031#comment-13979031 ] Robert Kanter commented on MAPREDUCE-5856: -- This won't remove the limit check

[jira] [Commented] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979035#comment-13979035 ] Robert Kanter commented on MAPREDUCE-5856: -- Another way of looking at this: i

[jira] [Commented] (MAPREDUCE-5843) TestMRKeyValueTextInputFormat failing on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979045#comment-13979045 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5843: Okay, I had t

[jira] [Updated] (MAPREDUCE-5843) TestMRKeyValueTextInputFormat failing on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5843: --- Resolution: Fixed Fix Version/s: 2.4.1 Hadoop Flags: R

[jira] [Commented] (MAPREDUCE-5843) TestMRKeyValueTextInputFormat failing on Windows

[ https://issues.apache.org/jira/browse/MAPREDUCE-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979052#comment-13979052 ] Hudson commented on MAPREDUCE-5843: --- SUCCESS: Integrated in Hadoop-trunk-Commit #555

[jira] [Commented] (MAPREDUCE-5856) Counter limits always use defaults even if JobClient is given a different Configuration

[ https://issues.apache.org/jira/browse/MAPREDUCE-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979078#comment-13979078 ] Hadoop QA commented on MAPREDUCE-5856: -- {color:red}-1 overall{color}. Here are t

[jira] [Created] (MAPREDUCE-5857) Need task log URL API for external users

Jason Dere created MAPREDUCE-5857: - Summary: Need task log URL API for external users Key: MAPREDUCE-5857 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5857 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-5756) CombineFileInputFormat.getSplits() including directories in its results

[ https://issues.apache.org/jira/browse/MAPREDUCE-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979157#comment-13979157 ] Jason Dere commented on MAPREDUCE-5756: --- Just tried reverting MAPREDUCE-4470, an

[jira] [Updated] (MAPREDUCE-5812) Make task context available to OutputCommitter.isRecoverySupported()

[ https://issues.apache.org/jira/browse/MAPREDUCE-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohammad Kamrul Islam updated MAPREDUCE-5812: - Attachment: MAPREDUCE-5812.5.patch Thanks [~jlowe] for the comments.

[jira] [Updated] (MAPREDUCE-1720) 'Killed' jobs and 'Failed' jobs should be displayed seperately in JobTracker UI

[ https://issues.apache.org/jira/browse/MAPREDUCE-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nixuchi updated MAPREDUCE-1720: --- Description: The JobTracker UI shows both Failed/Killed Jobs as Failed. The Killed job status ha

[jira] [Commented] (MAPREDUCE-1720) 'Killed' jobs and 'Failed' jobs should be displayed seperately in JobTracker UI

[ https://issues.apache.org/jira/browse/MAPREDUCE-1720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979186#comment-13979186 ] nixuchi commented on MAPREDUCE-1720: good luck! > 'Killed' jobs and 'Failed' job

[jira] [Commented] (MAPREDUCE-5812) Make task context available to OutputCommitter.isRecoverySupported()

[ https://issues.apache.org/jira/browse/MAPREDUCE-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979210#comment-13979210 ] Hadoop QA commented on MAPREDUCE-5812: -- {color:red}-1 overall{color}. Here are t

[jira] [Commented] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979326#comment-13979326 ] Ravi Prakash commented on MAPREDUCE-5846: - Thanks Nathan! I tested this by ru

[jira] [Updated] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated MAPREDUCE-5846: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Status

[jira] [Commented] (MAPREDUCE-5846) Rumen doesn't understand JobQueueChangedEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-5846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13979340#comment-13979340 ] Hudson commented on MAPREDUCE-5846: --- SUCCESS: Integrated in Hadoop-trunk-Commit #555

[jira] [Created] (MAPREDUCE-5858) MR should make use of the timeline server

Zhijie Shen created MAPREDUCE-5858: -- Summary: MR should make use of the timeline server Key: MAPREDUCE-5858 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5858 Project: Hadoop Map/Reduce