[jira] [Commented] (MAPREDUCE-6039) mapreduce.v2.hs.webapp.dao.TestJobInfo is using old name of job history file

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105368#comment-14105368 ] Jason Lowe commented on MAPREDUCE-6039: --- Sure, we can update it I guess.

[jira] [Created] (MAPREDUCE-6042) jaxb classpath conflict

2014-08-21 Thread Shaun A Elliott (JIRA)
Shaun A Elliott created MAPREDUCE-6042: -- Summary: jaxb classpath conflict Key: MAPREDUCE-6042 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6042 Project: Hadoop Map/Reduce Issue

[jira] [Updated] (MAPREDUCE-5974) Allow specifying multiple MapOutputCollectors with fallback

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5974: Summary: Allow specifying multiple MapOutputCollectors with fallback (was:

[jira] [Updated] (MAPREDUCE-5974) Allow specifying multiple MapOutputCollectors with fallback

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5974: Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed

[jira] [Created] (MAPREDUCE-6043) Reducer-preemption does not kick in

2014-08-21 Thread Maysam Yabandeh (JIRA)
Maysam Yabandeh created MAPREDUCE-6043: -- Summary: Reducer-preemption does not kick in Key: MAPREDUCE-6043 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6043 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6043) Reducer-preemption does not kick in

2014-08-21 Thread Maysam Yabandeh (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105664#comment-14105664 ] Maysam Yabandeh commented on MAPREDUCE-6043: The value of this variables

[jira] [Updated] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5891: -- Attachment: MAPREDUCE-5891-demo.patch Thanks [~jlowe] for sharing the thoughts. I have a

[jira] [Commented] (MAPREDUCE-5974) Allow specifying multiple MapOutputCollectors with fallback

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105773#comment-14105773 ] Hudson commented on MAPREDUCE-5974: --- FAILURE: Integrated in Hadoop-trunk-Commit

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Attachment: MAPREDUCE-4815.v5.patch FileOutputCommitter.commitJob can be very slow for jobs

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Status: Open (was: Patch Available) FileOutputCommitter.commitJob can be very slow for jobs

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Status: Patch Available (was: Open) In this patch, the first task recovery will recover all

[jira] [Created] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Zhijie Shen (JIRA)
Zhijie Shen created MAPREDUCE-6044: -- Summary: Fully qualified intermediate done directory will break per-user dir creation on Windows Key: MAPREDUCE-6044 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6044

[jira] [Updated] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-6044: --- Attachment: MAPREDUCE-6044.1.patch Create a patch to fix the issue Fully qualified

[jira] [Updated] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated MAPREDUCE-6044: --- Status: Patch Available (was: Open) Fully qualified intermediate done directory will

[jira] [Updated] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-6044: - Description: After MAPREDUCE-6032, the string of the intermediate done dir will be a

[jira] [Updated] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated MAPREDUCE-6044: - Hadoop Flags: Reviewed +1 for the patch, pending Jenkins run. Thank you, Zhijie.

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-08-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106119#comment-14106119 ] Jason Lowe commented on MAPREDUCE-5891: --- Thanks for posting a prototype,

[jira] [Updated] (MAPREDUCE-5933) Enable MR AM to post history events to the timeline server

2014-08-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-5933: - Attachment: MAPREDUCE-5933.patch New patch fixes the unit tests and properly handles

[jira] [Commented] (MAPREDUCE-5130) Add missing job config options to mapred-default.xml

2014-08-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106194#comment-14106194 ] Hudson commented on MAPREDUCE-5130: --- FAILURE: Integrated in Hadoop-trunk-Commit

[jira] [Updated] (MAPREDUCE-5258) Memory Leak while using LocalJobRunner

2014-08-21 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated MAPREDUCE-5258: - Affects Version/s: (was: 1.2.1) Memory Leak while using LocalJobRunner

[jira] [Updated] (MAPREDUCE-5258) Memory Leak while using LocalJobRunner

2014-08-21 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated MAPREDUCE-5258: - Target Version/s: 1.1.3 (was: 1.2.1) Memory Leak while using LocalJobRunner

[jira] [Updated] (MAPREDUCE-5258) Memory Leak while using LocalJobRunner

2014-08-21 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated MAPREDUCE-5258: - Fix Version/s: (was: 1.2.2) 1.1.3 Memory Leak while using LocalJobRunner

[jira] [Updated] (MAPREDUCE-5258) Memory Leak while using LocalJobRunner

2014-08-21 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated MAPREDUCE-5258: - Attachment: mapreduce-5258 _001.txt Please review my code and give me chance to contribute source

[jira] [Commented] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106250#comment-14106250 ] Ming Ma commented on MAPREDUCE-4815: To have first task's recoverTask recover all

[jira] [Updated] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5956: Target Version/s: 2.5.1 (was: 2.5.0) MapReduce AM should not use maxAttempts

[jira] [Reopened] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened MAPREDUCE-5956: - Reopening this to include in 2.5.1. MapReduce AM should not use maxAttempts

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Attachment: MAPREDUCE-4815.v6.patch FileOutputCommitter.commitJob can be very slow for jobs

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Status: Patch Available (was: Open) FileOutputCommitter.commitJob can be very slow for jobs

[jira] [Updated] (MAPREDUCE-4815) FileOutputCommitter.commitJob can be very slow for jobs with many output files

2014-08-21 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated MAPREDUCE-4815: --- Status: Open (was: Patch Available) FileOutputCommitter.commitJob can be very slow for jobs

[jira] [Commented] (MAPREDUCE-5933) Enable MR AM to post history events to the timeline server

2014-08-21 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106289#comment-14106289 ] Jonathan Eagles commented on MAPREDUCE-5933: [~rkanter], Appoligies for

[jira] [Commented] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106326#comment-14106326 ] Zhijie Shen commented on MAPREDUCE-5956: @Jason, Vinod and I discussed which

[jira] [Commented] (MAPREDUCE-5933) Enable MR AM to post history events to the timeline server

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106329#comment-14106329 ] Hadoop QA commented on MAPREDUCE-5933: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106333#comment-14106333 ] Hadoop QA commented on MAPREDUCE-6044: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5891) Improved shuffle error handling across NM restarts

2014-08-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106341#comment-14106341 ] Junping Du commented on MAPREDUCE-5891: --- Thanks [~jlowe] for quickly feedback!

[jira] [Commented] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Ashwin Shankar (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106414#comment-14106414 ] Ashwin Shankar commented on MAPREDUCE-5956: --- [~zjshen], could you please

[jira] [Commented] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106425#comment-14106425 ] Wangda Tan commented on MAPREDUCE-5956: --- Hi [~ashwinshankar77], You can check my

[jira] [Commented] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106426#comment-14106426 ] Chris Nauroth commented on MAPREDUCE-6044: -- The release audit warnings are

[jira] [Commented] (MAPREDUCE-6044) Fully qualified intermediate done directory will break per-user dir creation on Windows

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106436#comment-14106436 ] Zhijie Shen commented on MAPREDUCE-6044: Right, I just filed a ticket:

[jira] [Created] (MAPREDUCE-6045) need close the DataInputStream after open it in TestMapReduce.java

2014-08-21 Thread zhihai xu (JIRA)
zhihai xu created MAPREDUCE-6045: Summary: need close the DataInputStream after open it in TestMapReduce.java Key: MAPREDUCE-6045 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6045 Project:

[jira] [Updated] (MAPREDUCE-6045) need close the DataInputStream after open it in TestMapReduce.java

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6045: - Priority: Trivial (was: Minor) need close the DataInputStream after open it in

[jira] [Updated] (MAPREDUCE-6045) need close the DataInputStream after open it in TestMapReduce.java

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6045: - Attachment: MAPREDUCE-6045.000.patch need close the DataInputStream after open it in

[jira] [Updated] (MAPREDUCE-6045) need close the DataInputStream after open it in TestMapReduce.java

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6045: - Status: Patch Available (was: Open) need close the DataInputStream after open it in

[jira] [Updated] (MAPREDUCE-6045) need close the DataInputStream after open it in TestMapReduce.java

2014-08-21 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated MAPREDUCE-6045: - Priority: Minor (was: Trivial) need close the DataInputStream after open it in

[jira] [Commented] (MAPREDUCE-5956) MapReduce AM should not use maxAttempts to determine if this is the last retry

2014-08-21 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106483#comment-14106483 ] Zhijie Shen commented on MAPREDUCE-5956: [~leftnoteasy], thanks for your