[HOD] logcondense should delete all hod logs for a user, including jobtracker
logs
----------------------------------------------------------------------------------
Key: HADOOP-5022
URL: https://issues.apache.org/jira/browse/HADOOP-5022
Project: Hadoop Core
Issue Type: Bug
Components: contrib/hod
Reporter: Hemanth Yamijala
Assignee: Peeyush Bishnoi
Currently, logcondense.py does not delete jobtracker logs that it uploads to
the DFS when the HOD cluster is deallocated. This will result in the hod-logs
directory to slowly accumulate a whole bunch of jobtracker logs. Particularly
for users who run a lot of user jobs, this could fill up the namespace.
Further these directories will cause the logcondense program to keep repeatedly
looking at these directories stressing out the namenode. So, logcondense.py
should optionally also delete the jobtracker logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
