[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2696: - Priority: Blocker (was: Major) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Reporter: Arun C Murthy >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Issue Type: Sub-task (was: Bug) Parent: MAPREDUCE-3143 > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Reporter: Arun C Murthy >Assignee: Vinod Kumar Vavilapalli >Priority: Blocker > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Affects Version/s: 0.23.0 Fix Version/s: 0.23.0 > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth >Priority: Blocker > Fix For: 0.23.0 > > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-2696: -- Assignee: (was: Siddharth Seth) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Priority: Blocker > Fix For: 0.23.0 > > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-2696: - Priority: Critical (was: Blocker) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth >Priority: Critical > Fix For: 0.23.0 > > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-2696: -- Attachment: MR2696_v1.txt Patch adds another LogHandler which takes care of deleting container logs after the Application completes. The logs are scheduled for deletion after a configured log.retain.seconds value. - Renamed some classes (LogAggregationEvents to LogHandlingEvents etc) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth >Priority: Critical > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt > > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated MAPREDUCE-2696: -- Status: Patch Available (was: Open) Needs 3146 to be applied first. > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2 >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth >Priority: Critical > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt > > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Component/s: nodemanager Description: Container logs aren't getting cleaned up when log-aggregation is disabled. (was: Container logs aren't getting cleaned up causing NMs to fill up.) Priority: Major (was: Critical) If log-aggregation is enabled, the container logs are getting deleted. Changing the title to reflect this new reality. > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Open (was: Patch Available) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Attachment: MR2696_v1.txt MAPREDUCE-3146 is in. Submitting the same patch to Jenkins while I review it. > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Patch Available (was: Open) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Open (was: Patch Available) > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Attachment: MAPREDUCE-2696-20111031.txt Modifying the patch and uploading it myself with minor edits. Avoids another review cycle, so: - Renamed -- log-aggregation.enable configuration key to log-aggregation-enable -- log.delete.thread-count configuration key to log.deletion-threads-count -- log.retain.seconds configuration to log.retain-seconds -- APPLICATION_LOG_AGGREAGATION_FINISHED event to APPLICATION_LOG_HANDLING_FINISHED -- LogHnadlerEvent to LogHandlerEvent ( a typo) - Fixed FindBugs warnings. - Uncommented the commented out test in TestNonAggregatingLogHandler, and fixed a bug in that. > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Component/s: mrv2 > Container logs aren't getting cleaned up > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Bug > Components: mrv2 >Reporter: Arun C Murthy >Assignee: Vinod Kumar Vavilapalli > > Container logs aren't getting cleaned up causing NMs to fill up. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Hadoop Flags: Reviewed Summary: Container logs aren't getting cleaned up when LogAggregation is disabled (was: Container logs aren't getting cleaned up) > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Patch Available (was: Open) > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Patch Available (was: Open) > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.1.txt, > MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Status: Open (was: Patch Available) > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.1.txt, > MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Attachment: MAPREDUCE-2696-20111031.1.txt > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.1.txt, > MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2696) Container logs aren't getting cleaned up when LogAggregation is disabled
[ https://issues.apache.org/jira/browse/MAPREDUCE-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-2696: --- Resolution: Fixed Status: Resolved (was: Patch Available) I committed this to trunk and branch-0.23. Thanks Sid! > Container logs aren't getting cleaned up when LogAggregation is disabled > > > Key: MAPREDUCE-2696 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-2696 > Project: Hadoop Map/Reduce > Issue Type: Sub-task > Components: mrv2, nodemanager >Affects Versions: 0.23.0 >Reporter: Arun C Murthy >Assignee: Siddharth Seth > Fix For: 0.23.0 > > Attachments: MAPREDUCE-2696-20111031.1.txt, > MAPREDUCE-2696-20111031.txt, MR2696_v1.txt, MR2696_v1.txt > > > Container logs aren't getting cleaned up when log-aggregation is disabled. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
