[
https://issues.apache.org/jira/browse/MAPREDUCE-4167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13258278#comment-13258278
]
Robert Joseph Evans commented on MAPREDUCE-4167:
------------------------------------------------
I saw this too, The difficult part with this is debug mode in the history
server. It switches the YYYY/MM/DD to YYYY/HH/mm (or something like that).
This makes it very difficult for the cleanup code to be able to know when it is
allowed to delete a particular directory. It is possible, however unlikely,
that the cleanup thread would try to delete a directory at the same time that
someone else is trying to add something to them. This could potentially result
in files being deleted that should not be. It should not be too hard to work
around it, but it is something to be aware of.
> Delete empty timestamped directories
> ------------------------------------
>
> Key: MAPREDUCE-4167
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4167
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: jobhistoryserver, mrv2
> Affects Versions: 2.0.0, trunk
> Reporter: Bhallamudi Venkata Siva Kamesh
>
> Currently in the clean() method, we are deleting only the files/directories
> inside *YYYY/MM/DD* directory and leaving those time stamped directories
> (*YYYY/MM/DD*) as it is. As these are empty directories, I *think*, we should
> delete these time stamped directories from FileSystem in the clean method.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
