[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

2016-10-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610254#comment-15610254 ] Robert Kanter commented on MAPREDUCE-6765: -- +1 > MR should not schedule container requests

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603745#comment-15603745 ] Robert Kanter commented on MAPREDUCE-6728: -- It applies to branch-2, but not to branch-2.8; so

[jira] [Updated] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6728: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15603736#comment-15603736 ] Robert Kanter commented on MAPREDUCE-6728: -- +1 on the 2.8 patch > Give fetchers hint when

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596824#comment-15596824 ] Robert Kanter commented on MAPREDUCE-6728: -- Looks like it doesn't compile against branch-2.

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596800#comment-15596800 ] Robert Kanter commented on MAPREDUCE-6728: -- +1 > Give fetchers hint when ShuffleHandler

[jira] [Commented] (MAPREDUCE-6728) Give fetchers hint when ShuffleHandler rejects a shuffling connection

2016-10-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15596602#comment-15596602 ] Robert Kanter commented on MAPREDUCE-6728: -- Thanks for the patch [~haibochen] and the reviews

[jira] [Updated] (MAPREDUCE-6791) remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle

2016-10-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6791: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-6791) remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle

2016-10-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587238#comment-15587238 ] Robert Kanter commented on MAPREDUCE-6791: -- +1 > remove unnecessary dependency from

[jira] [Updated] (MAPREDUCE-6791) remove unnecessary dependency from hadoop-mapreduce-client-jobclient to hadoop-mapreduce-client-shuffle

2016-10-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6791: - Status: Patch Available (was: Open) > remove unnecessary dependency from

[jira] [Resolved] (MAPREDUCE-6375) Modify the JHS to be able to read the ConcatenatableAggregatedLogFormat

2016-10-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved MAPREDUCE-6375. -- Resolution: Won't Fix Closing this as "Won't Fix" given we have MAPREDUCE-6415. >

[jira] [Updated] (MAPREDUCE-6776) yarn.app.mapreduce.client.job.max-retries should have a more useful default

2016-10-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6776: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix

[jira] [Commented] (MAPREDUCE-6776) yarn.app.mapreduce.client.job.max-retries should have a more useful default

2016-09-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537477#comment-15537477 ] Robert Kanter commented on MAPREDUCE-6776: -- [~vinodkv], do you think we should change this in

[jira] [Comment Edited] (MAPREDUCE-6776) yarn.app.mapreduce.client.job.max-retries should have a more useful default

2016-09-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537035#comment-15537035 ] Robert Kanter edited comment on MAPREDUCE-6776 at 9/30/16 8:51 PM: ---

[jira] [Commented] (MAPREDUCE-6776) yarn.app.mapreduce.client.job.max-retries should have a more useful default

2016-09-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15537035#comment-15537035 ] Robert Kanter commented on MAPREDUCE-6776: -- Ya, looks like YARN-5377 is for

[jira] [Updated] (MAPREDUCE-6718) add progress log to JHS during startup

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6718: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (MAPREDUCE-6718) add progress log to JHS during startup

2016-09-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531089#comment-15531089 ] Robert Kanter commented on MAPREDUCE-6718: -- +1 > add progress log to JHS during startup >

[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

2016-09-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524609#comment-15524609 ] Robert Kanter commented on MAPREDUCE-6765: -- It overall looks good to me. But is there anyway

[jira] [Commented] (MAPREDUCE-6718) add progress log to JHS during startup

2016-09-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524608#comment-15524608 ] Robert Kanter commented on MAPREDUCE-6718: -- You're right. That should have gone on

[jira] [Commented] (MAPREDUCE-6718) add progress log to JHS during startup

2016-09-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15524202#comment-15524202 ] Robert Kanter commented on MAPREDUCE-6718: -- It overall looks good to me. But is there anyway

[jira] [Updated] (MAPREDUCE-6632) Master.getMasterAddress() should be updated to use YARN-4629

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6632: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha2

[jira] [Commented] (MAPREDUCE-6632) Master.getMasterAddress() should be updated to use YARN-4629

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514716#comment-15514716 ] Robert Kanter commented on MAPREDUCE-6632: -- +1 > Master.getMasterAddress() should be updated

[jira] [Commented] (MAPREDUCE-6765) MR should not schedule container requests in cases where reducer or mapper containers demand resource larger than the maximum supported

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514655#comment-15514655 ] Robert Kanter commented on MAPREDUCE-6765: -- [~haibochen], the test failures look related

[jira] [Commented] (MAPREDUCE-6718) add progress log to JHS during startup

2016-09-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15514598#comment-15514598 ] Robert Kanter commented on MAPREDUCE-6718: -- Two more things I found while actually trying

[jira] [Commented] (MAPREDUCE-6704) Container fail to launch for mapred application

2016-09-21 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510781#comment-15510781 ] Robert Kanter commented on MAPREDUCE-6704: -- {quote}Quite shocked that commit "9d4d30243b0fc"

[jira] [Resolved] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-07-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter resolved MAPREDUCE-6652. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0 Thanks

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-07-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378729#comment-15378729 ] Robert Kanter commented on MAPREDUCE-6652: -- +1 on the 009 patch. Will commit tomorrow

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-07-13 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376068#comment-15376068 ] Robert Kanter commented on MAPREDUCE-6652: -- [~haibochen], can you take a look at

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-07-13 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15376021#comment-15376021 ] Robert Kanter commented on MAPREDUCE-6652: -- +1 > Add configuration property to prevent JHS

[jira] [Updated] (MAPREDUCE-6625) TestCLI#testGetJob fails occasionally

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6625: - Fix Version/s: (was: 2.9.0) 2.8.0 > TestCLI#testGetJob fails

[jira] [Commented] (MAPREDUCE-6625) TestCLI#testGetJob fails occasionally

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373955#comment-15373955 ] Robert Kanter commented on MAPREDUCE-6625: -- {quote}Is there a reason this wasn't committed to

[jira] [Updated] (MAPREDUCE-6625) TestCLI#testGetJob fails occasionally

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6625: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6625) TestCLI#testGetJob fails occasionally

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373723#comment-15373723 ] Robert Kanter commented on MAPREDUCE-6625: -- +1 > TestCLI#testGetJob fails occasionally >

[jira] [Commented] (MAPREDUCE-6718) add progress log to JHS during startup

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373701#comment-15373701 ] Robert Kanter commented on MAPREDUCE-6718: -- One thing: - If {{jobListCache.maxSize}}, which

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-07-12 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373673#comment-15373673 ] Robert Kanter commented on MAPREDUCE-6652: -- +1 > Add configuration property to prevent JHS

[jira] [Updated] (MAPREDUCE-6702) TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing

2016-06-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6702: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible

[jira] [Commented] (MAPREDUCE-6702) TestMiniMRChildTask.testTaskEnv and TestMiniMRChildTask.testTaskOldEnv are failing

2016-06-07 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15319052#comment-15319052 ] Robert Kanter commented on MAPREDUCE-6702: -- +1 LGTM. Will commit later today. Test failures

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-06-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317420#comment-15317420 ] Robert Kanter commented on MAPREDUCE-6652: -- Two last things - {{UnparsedJob#getReport()}}

[jira] [Commented] (MAPREDUCE-6652) Add configuration property to prevent JHS from loading jobs with a task count greater than X

2016-06-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15314797#comment-15314797 ] Robert Kanter commented on MAPREDUCE-6652: -- Looks good overall. A few things: - In

[jira] [Updated] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-05-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6686: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-05-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15284834#comment-15284834 ] Robert Kanter commented on MAPREDUCE-6686: -- [~qwertymaniac], can you take another look? >

[jira] [Commented] (MAPREDUCE-6657) job history server can fail on startup when NameNode is in start phase

2016-05-13 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283020#comment-15283020 ] Robert Kanter commented on MAPREDUCE-6657: -- I chatted with [~haibochen]. I think the HDFS

[jira] [Updated] (MAPREDUCE-6675) TestJobImpl.testUnusableNode failed

2016-05-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6675: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Updated] (MAPREDUCE-6677) LocalContainerAllocator doesn't specify resource of the containers allocated.

2016-05-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6677: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (MAPREDUCE-6677) LocalContainerAllocator doesn't specify resource of the containers allocated.

2016-05-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6677: - Fix Version/s: 2.9.0 > LocalContainerAllocator doesn't specify resource of the

[jira] [Commented] (MAPREDUCE-6675) TestJobImpl.testUnusableNode failed

2016-05-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271900#comment-15271900 ] Robert Kanter commented on MAPREDUCE-6675: -- +1 > TestJobImpl.testUnusableNode failed >

[jira] [Commented] (MAPREDUCE-6677) LocalContainerAllocator doesn't specify resource of the containers allocated.

2016-05-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271888#comment-15271888 ] Robert Kanter commented on MAPREDUCE-6677: -- +1 > LocalContainerAllocator doesn't specify

[jira] [Commented] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-05-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15269486#comment-15269486 ] Robert Kanter commented on MAPREDUCE-6686: -- The test failures are unrelated. The checkstyle

[jira] [Updated] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-05-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6686: - Attachment: MAPREDUCE-6686.002.patch The 002 patch changes the message as per what

[jira] [Updated] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-04-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6686: - Status: Patch Available (was: Open) > Add a way to download the job config from the

[jira] [Updated] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-04-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6686: - Attachment: MAPREDUCE-6686.001.patch Pretty straightforward patch (the file location

[jira] [Created] (MAPREDUCE-6686) Add a way to download the job config from the mapred CLI

2016-04-26 Thread Robert Kanter (JIRA)
Robert Kanter created MAPREDUCE-6686: Summary: Add a way to download the job config from the mapred CLI Key: MAPREDUCE-6686 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6686 Project:

[jira] [Updated] (MAPREDUCE-6647) MR usage counters use the resources requested instead of the resources allocated

2016-04-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6647: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6647) MR usage counters use the resources requested instead of the resources allocated

2016-04-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229412#comment-15229412 ] Robert Kanter commented on MAPREDUCE-6647: -- And branch-2! > MR usage counters use the

[jira] [Commented] (MAPREDUCE-6647) MR usage counters use the resources requested instead of the resources allocated

2016-04-06 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229357#comment-15229357 ] Robert Kanter commented on MAPREDUCE-6647: -- +1 Will commit shortly > MR usage counters use

[jira] [Commented] (MAPREDUCE-6647) MR usage counters use the resources requested instead of the resources allocated

2016-03-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15212459#comment-15212459 ] Robert Kanter commented on MAPREDUCE-6647: -- Overall looks good. Two minor things: - There's

[jira] [Updated] (MAPREDUCE-4785) TestMRApp occasionally fails

2016-03-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4785: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-4785) TestMRApp occasionally fails

2016-03-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176987#comment-15176987 ] Robert Kanter commented on MAPREDUCE-4785: -- +1 LGTM. Will commit tomorrow if nobody has any

[jira] [Commented] (MAPREDUCE-4785) TestMRApp occasionally fails

2016-03-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15176851#comment-15176851 ] Robert Kanter commented on MAPREDUCE-4785: -- The approach seems fine to me. A minor thing

[jira] [Updated] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-02-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6622: - Attachment: MAPREDUCE-6622.014.patch For completeness, patch 14 is the final commit

[jira] [Updated] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-02-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6622: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-02-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170271#comment-15170271 ] Robert Kanter commented on MAPREDUCE-6622: -- +1 Will commit this shortly. The findbugs and

[jira] [Commented] (MAPREDUCE-6640) mapred job -history command should be able to take Job ID

2016-02-23 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159158#comment-15159158 ] Robert Kanter commented on MAPREDUCE-6640: -- Failed tests unrelated. Remaining checkstyle

[jira] [Updated] (MAPREDUCE-6640) mapred job -history command should be able to take Job ID

2016-02-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6640: - Attachment: MAPREDUCE-6640.002.patch The 002 patch: - Fixed the extra import Karthik

[jira] [Commented] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-02-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158029#comment-15158029 ] Robert Kanter commented on MAPREDUCE-6622: -- LGTM +1 [~kasha], [~jlowe], any other comments?

[jira] [Commented] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-02-22 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157804#comment-15157804 ] Robert Kanter commented on MAPREDUCE-6622: -- Looks good overall, some minor things: - The

[jira] [Updated] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary

2016-02-19 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6613: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was:

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary

2016-02-18 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15153476#comment-15153476 ] Robert Kanter commented on MAPREDUCE-6613: -- +1 for 3.0. Will commit tomorrow if nobody

[jira] [Updated] (MAPREDUCE-6636) Clean up argument parsing in mapred CLI

2016-02-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6636: - Assignee: Haibo Chen > Clean up argument parsing in mapred CLI >

[jira] [Commented] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15151517#comment-15151517 ] Robert Kanter commented on MAPREDUCE-6627: -- I created MAPREDUCE-6636 to cleanup the CLI

[jira] [Created] (MAPREDUCE-6636) Clean up argument parsing in mapred CLI

2016-02-17 Thread Robert Kanter (JIRA)
Robert Kanter created MAPREDUCE-6636: Summary: Clean up argument parsing in mapred CLI Key: MAPREDUCE-6636 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6636 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.006.patch The 006 patch renames the new files. I spoke

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-17 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.005.patch Test failures unrelated other than

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.004.patch The 004 patch fixes the related unit test

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-15 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.003.patch The 003 patch addresses [~templedf]'s feedback,

[jira] [Commented] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143832#comment-15143832 ] Robert Kanter commented on MAPREDUCE-6627: -- I think I figured out the "if x then return

[jira] [Commented] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15143609#comment-15143609 ] Robert Kanter commented on MAPREDUCE-6627: -- Thanks for the review. I'll start working on the

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-04 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.002.patch Test failures are unrelated (See MAPREDUCE-6579

[jira] [Created] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-03 Thread Robert Kanter (JIRA)
Robert Kanter created MAPREDUCE-6627: Summary: Add machine-readable output to mapred job -history command Key: MAPREDUCE-6627 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6627 Project:

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: json_all.txt json.txt json.txt and json_all.txt show what

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Attachment: MAPREDUCE-6627.001.patch I moved most of the printing code from

[jira] [Updated] (MAPREDUCE-6627) Add machine-readable output to mapred job -history command

2016-02-03 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6627: - Status: Patch Available (was: Open) > Add machine-readable output to mapred job

[jira] [Commented] (MAPREDUCE-6620) Jobs that did not start are shown as starting in 1969 in the JHS web UI

2016-02-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129312#comment-15129312 ] Robert Kanter commented on MAPREDUCE-6620: -- +1 on the latest patch. > Jobs that did not

[jira] [Updated] (MAPREDUCE-6620) Jobs that did not start are shown as starting in 1969 in the JHS web UI

2016-02-02 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6620: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6622) Add capability to set JHS job cache to a task-based limit

2016-01-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15123989#comment-15123989 ] Robert Kanter commented on MAPREDUCE-6622: -- If we add the -1, 0, and >0 for the cleanUp(),

[jira] [Commented] (MAPREDUCE-6620) Jobs that did not start are shown as starting in 1969 in the JHS web UI

2016-01-28 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15122384#comment-15122384 ] Robert Kanter commented on MAPREDUCE-6620: -- That looks right to me, though could you add a

[jira] [Updated] (MAPREDUCE-6431) JobClient should be an AutoClosable

2016-01-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6431: - Issue Type: Improvement (was: Bug) > JobClient should be an AutoClosable >

[jira] [Commented] (MAPREDUCE-6431) JobClient should be an AutoClosable

2016-01-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120546#comment-15120546 ] Robert Kanter commented on MAPREDUCE-6431: -- Yup. Looks like MAPREDUCE-6566 was reopened for

[jira] [Commented] (MAPREDUCE-6431) JobClient should be an AutoClosable

2016-01-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120538#comment-15120538 ] Robert Kanter commented on MAPREDUCE-6431: -- +1 > JobClient should be an AutoClosable >

[jira] [Updated] (MAPREDUCE-6431) JobClient should be an AutoClosable

2016-01-27 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6431: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.0

[jira] [Commented] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary

2016-01-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15117968#comment-15117968 ] Robert Kanter commented on MAPREDUCE-6613: -- This seems like a good default to change: - It

[jira] [Commented] (MAPREDUCE-6613) Change mapreduce.jobhistory.jhist.format default from json to binary

2016-01-26 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15118119#comment-15118119 ] Robert Kanter commented on MAPREDUCE-6613: -- That seems reasonable. [~rchiang], can you write

[jira] [Updated] (MAPREDUCE-6549) multibyte delimiters with LineRecordReader cause duplicate records

2015-11-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6549: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Updated] (MAPREDUCE-6550) archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor

2015-11-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6550: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0

[jira] [Commented] (MAPREDUCE-6550) archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor

2015-11-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027401#comment-15027401 ] Robert Kanter commented on MAPREDUCE-6550: -- Thanks for the reviews Jason. I'll commit this

[jira] [Commented] (MAPREDUCE-6549) multibyte delimiters with LineRecordReader cause duplicate records

2015-11-25 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027383#comment-15027383 ] Robert Kanter commented on MAPREDUCE-6549: -- +1 LGTM Will commit later today if nobody has

[jira] [Updated] (MAPREDUCE-6550) archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor

2015-11-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6550: - Attachment: MAPREDUCE-6550.005.patch The 005 patch increases some of the test

[jira] [Updated] (MAPREDUCE-6550) archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor

2015-11-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6550: - Attachment: MAPREDUCE-6550.004.patch The 004 patch fixes the conf checkstyle thing.

[jira] [Updated] (MAPREDUCE-6550) archive-logs tool changes log ownership to the Yarn user when using DefaultContainerExecutor

2015-11-20 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-6550: - Attachment: MAPREDUCE-6550.003.patch That's also a good idea, and should be more

<    1   2   3   4   5   >