[jira] [Updated] (MAPREDUCE-6530) Jobtracker is slow when more JT UI requests

2015-10-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-6530: Affects Version/s: (was: 2.5.1) 1.2.1 Pri

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

2015-10-29 Thread Bikas Saha (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981829#comment-14981829 ] Bikas Saha commented on MAPREDUCE-5485: --- The repeatable commit API seems useful.

[jira] [Created] (MAPREDUCE-6530) Jobtracker is slow when more JT UI requests

2015-10-29 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created MAPREDUCE-6530: Summary: Jobtracker is slow when more JT UI requests Key: MAPREDUCE-6530 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6530 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981775#comment-14981775 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Hdfs-trunk #2490

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981711#comment-14981711 ] Sunil G commented on MAPREDUCE-6515: Thank you [~jlowe] for the review and commit!

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981706#comment-14981706 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8

[jira] [Commented] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

2015-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981547#comment-14981547 ] Hadoop QA commented on MAPREDUCE-5003: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981508#comment-14981508 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-6528: I'd like to g

[jira] [Commented] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

2015-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981424#comment-14981424 ] Hadoop QA commented on MAPREDUCE-5485: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Commented] (MAPREDUCE-6451) DistCp has incorrect chunkFilePath for multiple jobs when strategy is dynamic

2015-10-29 Thread Mithun Radhakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981416#comment-14981416 ] Mithun Radhakrishnan commented on MAPREDUCE-6451: - +1. Thanks for fixi

[jira] [Updated] (MAPREDUCE-6529) AppMaster will not retry to request resource if AppMaster happens to decide to not use the resource

2015-10-29 Thread Wei Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Chen updated MAPREDUCE-6529: Description: I am viewing code in RMContainerAllocator.java. I want to do some improvement s

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981412#comment-14981412 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8

[jira] [Created] (MAPREDUCE-6529) AppMaster will not retry to request resource if AppMaster happens to decide to not use the resource

2015-10-29 Thread Wei Chen (JIRA)
Wei Chen created MAPREDUCE-6529: --- Summary: AppMaster will not retry to request resource if AppMaster happens to decide to not use the resource Key: MAPREDUCE-6529 URL: https://issues.apache.org/jira/browse/MAPREDUCE

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981384#comment-14981384 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Yarn-trunk #1337

[jira] [Commented] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

2015-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981359#comment-14981359 ] Hadoop QA commented on MAPREDUCE-6514: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Updated] (MAPREDUCE-5003) AM recovery should recreate records for attempts that were incomplete

2015-10-29 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated MAPREDUCE-5003: Attachment: MAPREDUCE-5003.9.patch > AM recovery should recreate records for attempts that were

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981252#comment-14981252 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk #

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

2015-10-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated MAPREDUCE-6514: Summary: Job hangs as ask is not updated after ramping down of all reducers (was: Updat

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

2015-10-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated MAPREDUCE-6514: Description: In RMContainerAllocator#preemptReducesIfNeeded, we simply clear the schedul

[jira] [Updated] (MAPREDUCE-6514) Update ask to indicate to RM that it need not allocate for ramped down reducers

2015-10-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated MAPREDUCE-6514: Status: Patch Available (was: Open) > Update ask to indicate to RM that it need not all

[jira] [Updated] (MAPREDUCE-6514) Update ask to indicate to RM that it need not allocate for ramped down reducers

2015-10-29 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated MAPREDUCE-6514: Attachment: MAPREDUCE-6514.01.patch > Update ask to indicate to RM that it need not allo

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981158#comment-14981158 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-Mapreduce-trunk-J

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14981107#comment-14981107 ] Hudson commented on MAPREDUCE-6515: --- FAILURE: Integrated in Hadoop-trunk-Commit #872

[jira] [Updated] (MAPREDUCE-5485) Allow repeating job commit by extending OutputCommitter API

2015-10-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-5485: -- Attachment: MAPREDUCE-5485-demo-2.patch Update 2nd demo patch, with fixing: 1. Make sure Fil

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6528: -- Target Version/s: 2.7.2 (was: 2.8.0) > Memory leak for HistoryFileManager.getJobSummary() >

[jira] [Updated] (MAPREDUCE-6273) HistoryFileManager should check whether summaryFile exists to avoid FileNotFoundException causing HistoryFileInfo into MOVE_FAILED state

2015-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6273: -- Fix Version/s: (was: 2.8.0) 2.7.2 Thanks, [~zxu]! I committed this t

[jira] [Updated] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6515: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.2 Status:

[jira] [Updated] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6515: -- Fix Version/s: (was: 2.7.2) 2.8.0 > Update Application priority in AM

[jira] [Commented] (MAPREDUCE-6515) Update Application priority in AM side from AM-RM heartbeat

2015-10-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980924#comment-14980924 ] Jason Lowe commented on MAPREDUCE-6515: --- +1, latest patch lgtm. Committing this

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980892#comment-14980892 ] Junping Du commented on MAPREDUCE-6528: --- bq. Thanks for reporting this..can you

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980833#comment-14980833 ] Brahma Reddy Battula commented on MAPREDUCE-6528: - [~djp] Nice catch..

[jira] [Commented] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14980460#comment-14980460 ] Hadoop QA commented on MAPREDUCE-6528: -- | (x) *{color:red}-1 overall{color}* | \\

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6528: -- Status: Patch Available (was: Open) > Memory leak for HistoryFileManager.getJobSummary() >

[jira] [Updated] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated MAPREDUCE-6528: -- Attachment: MAPREDUCE-6528.patch Attach a simple patch to fix it. The fix is quite straightf

[jira] [Created] (MAPREDUCE-6528) Memory leak for HistoryFileManager.getJobSummary()

2015-10-29 Thread Junping Du (JIRA)
Junping Du created MAPREDUCE-6528: - Summary: Memory leak for HistoryFileManager.getJobSummary() Key: MAPREDUCE-6528 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6528 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6519) hadoop-mapreduce - Avoid unsafe split and append on fields that might be IPv6 literals

2015-10-29 Thread Nemanja Matkovic (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14979941#comment-14979941 ] Nemanja Matkovic commented on MAPREDUCE-6519: - TL; DR; I think we can comm