[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462408#comment-13462408 ] Hadoop QA commented on MAPREDUCE-4643: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462346#comment-13462346 ] Karthik Kambatla commented on MAPREDUCE-4643: - Thanks for the patch, Sandy

[jira] [Updated] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4643: -- Attachment: MAPREDUCE-4643-branch1.patch > Make job-history cleanup-period configurable

[jira] [Updated] (MAPREDUCE-1906) Lower default minimum heartbeat interval for tasktracker > Jobtracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-1906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-1906: -- Release Note: The default minimum heartbeat interval has been dropped from 3 seconds to 300

[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462285#comment-13462285 ] Sandy Ryza commented on MAPREDUCE-4643: --- I spoke with Karthik and we resolved th

[jira] [Commented] (MAPREDUCE-4229) Intern counter names in the JT

[ https://issues.apache.org/jira/browse/MAPREDUCE-4229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462259#comment-13462259 ] Miomir Boljanovic commented on MAPREDUCE-4229: -- Patch involves memory sav

[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462241#comment-13462241 ] Sandy Ryza commented on MAPREDUCE-4643: --- It should work for significantly smalle

[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462220#comment-13462220 ] Karthik Kambatla commented on MAPREDUCE-4643: - Thanks for your patch, Sand

[jira] [Commented] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462214#comment-13462214 ] Hadoop QA commented on MAPREDUCE-4676: -- -1 overall. Here are the results of test

[jira] [Resolved] (MAPREDUCE-4675) TestKillSubProcesses fails as the process is still alive after the job is done

[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-4675. Resolution: Fixed Fix Version/s: 1.1.0 Release Note:

[jira] [Commented] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462215#comment-13462215 ] Hadoop QA commented on MAPREDUCE-4643: -- -1 overall. Here are the results of test

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Status: Patch Available (was: Open) > Add test for job history cleaner > -

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Attachment: MAPREDUCE-4676.patch > Add test for job history cleaner > -

[jira] [Updated] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4643: -- Attachment: MAPREDUCE-4643.patch > Make job-history cleanup-period configurable > -

[jira] [Updated] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4643: -- Affects Version/s: (was: 2.0.0-alpha) Status: Patch Available (was: Open

[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as the process is still alive after the job is done

[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462207#comment-13462207 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-4675: Tx for the up

[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as the process is still alive after the job is done

[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462205#comment-13462205 ] Arpit Gupta commented on MAPREDUCE-4675: Ran the test a few times with the pat

[jira] [Commented] (MAPREDUCE-461) Enable ServicePlugins for the JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462200#comment-13462200 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-461: --- Just committed t

[jira] [Created] (MAPREDUCE-4680) Job history cleaner should only check timestamps of files in old enough directories

Sandy Ryza created MAPREDUCE-4680: - Summary: Job history cleaner should only check timestamps of files in old enough directories Key: MAPREDUCE-4680 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4680

[jira] [Commented] (MAPREDUCE-4672) RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462185#comment-13462185 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-4672: Chris, yes I

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462178#comment-13462178 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Mapreduce-trunk-Commit #27

[jira] [Updated] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated MAPREDUCE-4645: --- Resolution: Fixed Fix Version/s: 0.23.4 Hadoop Flags: Reviewed

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462145#comment-13462145 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Hdfs-trunk-Commit #2826 (S

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462147#comment-13462147 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Common-trunk-Commit #2763

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462142#comment-13462142 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Mapreduce-trunk-Commit #27

[jira] [Updated] (MAPREDUCE-4643) Make job-history cleanup-period configurable

[ https://issues.apache.org/jira/browse/MAPREDUCE-4643?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4643: -- Assignee: Sandy Ryza > Make job-history cleanup-period configurable > -

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462130#comment-13462130 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Common-trunk-Commit #2762

[jira] [Commented] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462131#comment-13462131 ] Sandy Ryza commented on MAPREDUCE-4676: --- Retracted the patch - splitting it into

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462126#comment-13462126 ] Hudson commented on MAPREDUCE-4645: --- Integrated in Hadoop-Hdfs-trunk-Commit #2825 (S

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Status: Open (was: Patch Available) > Add test for job history cleaner > -

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Attachment: (was: MAPREDUCE-4676.patch) > Add test for job history cleaner > --

[jira] [Commented] (MAPREDUCE-461) Enable ServicePlugins for the JobTracker

[ https://issues.apache.org/jira/browse/MAPREDUCE-461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462108#comment-13462108 ] Brandon Li commented on MAPREDUCE-461: -- Test-patch result of the branch-1 patch: {

[jira] [Commented] (MAPREDUCE-4675) TestKillSubProcesses fails as the process is still alive after the job is done

[ https://issues.apache.org/jira/browse/MAPREDUCE-4675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462104#comment-13462104 ] Arun C Murthy commented on MAPREDUCE-4675: -- +1, thanks for the fix Bikas!

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462103#comment-13462103 ] Konstantin Shvachko commented on MAPREDUCE-4645: +1 Looks good.

[jira] [Commented] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462099#comment-13462099 ] Hadoop QA commented on MAPREDUCE-4676: -- -1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462093#comment-13462093 ] Sandy Ryza commented on MAPREDUCE-4676: --- Should I put my patch on reviewboard?

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Attachment: MAPREDUCE-4676.patch > Add test for job history cleaner > -

[jira] [Updated] (MAPREDUCE-4676) Add test for job history cleaner

[ https://issues.apache.org/jira/browse/MAPREDUCE-4676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4676: -- Status: Patch Available (was: Open) > Add test for job history cleaner > -

[jira] [Commented] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462090#comment-13462090 ] Hadoop QA commented on MAPREDUCE-4645: -- +1 overall. Here are the results of test

[jira] [Commented] (MAPREDUCE-4672) RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462062#comment-13462062 ] Chris Riccomini commented on MAPREDUCE-4672: Hey Vinod, There is no AM ru

[jira] [Commented] (MAPREDUCE-4672) RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462057#comment-13462057 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-4672: Okie, then ca

[jira] [Resolved] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

[ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-4673. Resolution: Fixed Fix Version/s: 1.1.0 Release Note:

[jira] [Commented] (MAPREDUCE-4672) RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462036#comment-13462036 ] Chris Riccomini commented on MAPREDUCE-4672: Hey Vinod, In this case, I'v

[jira] [Updated] (MAPREDUCE-4645) Providing a random seed to Slive should make the sequence of filenames completely deterministic

[ https://issues.apache.org/jira/browse/MAPREDUCE-4645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated MAPREDUCE-4645: Attachment: MAPREDUCE-4645.branch-0.23.patch Upgrading patch to allow branch-1 / 0.20 t

[jira] [Assigned] (MAPREDUCE-4672) RM with lost NMs results in massive log of AppAttemptId doesnt exist in cache

[ https://issues.apache.org/jira/browse/MAPREDUCE-4672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reassigned MAPREDUCE-4672: -- Assignee: Vinod Kumar Vavilapalli In this case, you just ki

[jira] [Commented] (MAPREDUCE-4451) fairscheduler fail to init job with kerberos authentication configured

[ https://issues.apache.org/jira/browse/MAPREDUCE-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13462005#comment-13462005 ] Karthik Kambatla commented on MAPREDUCE-4451: - Hi Eric, Thanks for re-vis

[jira] [Created] (MAPREDUCE-4679) Backport MAPREDUCE-1881 (Improve TaskTrackerInstrumentation) to branch-1

Karthik Kambatla created MAPREDUCE-4679: --- Summary: Backport MAPREDUCE-1881 (Improve TaskTrackerInstrumentation) to branch-1 Key: MAPREDUCE-4679 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4679

[jira] [Commented] (MAPREDUCE-4662) JobHistoryFilesManager thread pool never expands

[ https://issues.apache.org/jira/browse/MAPREDUCE-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461978#comment-13461978 ] Kihwal Lee commented on MAPREDUCE-4662: --- I've also verified that the all worker

[jira] [Commented] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461977#comment-13461977 ] Mayank Bansal commented on MAPREDUCE-4305: -- Hi, Thanks Konst for your commen

[jira] [Commented] (MAPREDUCE-2454) Allow external sorter plugin for MR

[ https://issues.apache.org/jira/browse/MAPREDUCE-2454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461971#comment-13461971 ] Mariappan Asokan commented on MAPREDUCE-2454: - I would like to receive fee

[jira] [Commented] (MAPREDUCE-4662) JobHistoryFilesManager thread pool never expands

[ https://issues.apache.org/jira/browse/MAPREDUCE-4662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461918#comment-13461918 ] Kihwal Lee commented on MAPREDUCE-4662: --- Hemanth, As you pointed out, the core t

[jira] [Commented] (MAPREDUCE-4673) make TestRawHistoryFile and TestJobHistoryServer more robust

[ https://issues.apache.org/jira/browse/MAPREDUCE-4673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461909#comment-13461909 ] Arpit Gupta commented on MAPREDUCE-4673: Here is the test-patch output {code}

[jira] [Created] (MAPREDUCE-4678) Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException

Chris McConnell created MAPREDUCE-4678: -- Summary: Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException Key: MAPREDUCE-4678 URL: https://issues.apache.org/jira/browse/MAPREDU

[jira] [Updated] (MAPREDUCE-1806) CombineFileInputFormat does not work with paths not on default FS

[ https://issues.apache.org/jira/browse/MAPREDUCE-1806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated MAPREDUCE-1806: - Attachment: MAPREDUCE-1806.rev2.patch Thanks for suggestions, Tom! Revised patch with

[jira] [Commented] (MAPREDUCE-4652) ValueAggregatorJob sets the wrong job jar

[ https://issues.apache.org/jira/browse/MAPREDUCE-4652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461639#comment-13461639 ] Ahmed Radwan commented on MAPREDUCE-4652: - I have locally ran test-patch and h

[jira] [Updated] (MAPREDUCE-3902) MR AM should reuse containers for map tasks, there-by allowing fine-grained control on num-maps for users without need for CombineFileInputFormat etc.

[ https://issues.apache.org/jira/browse/MAPREDUCE-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-3902: -- Attachment: AMContainerRefactorNotes.pdf AM_ContainerRefactor.pdf M