When "mapred.job.tracker.persist.jobstatus.hours" is set to x hours, the files are not getting deleted after that x hours.It gets deleted after some random hours which is greater than x hours. ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Key: MAPREDUCE-721 URL: https://issues.apache.org/jira/browse/MAPREDUCE-721 Project: Hadoop Map/Reduce Issue Type: Bug Reporter: Iyappan Srinivasan When "mapred.job.tracker.persist.jobstatus.hours" is set to 1 hour, the jobid files, present in configured directory, are not getting deleted after that 1 hour. It gets deleted after some random hours. This is irrespective of whether "mapred.job.tracker.persist.jobstatus.dir" is set to local file system or DFS. Steps to reproduce the issue: 1) Im mapred-site.xml, Set "mapred.job.tracker.persist.jobstatus.active" to "true" Set "mapred.job.tracker.persist.jobstatus.hours" to "1" Set "mapred.job.tracker.persist.jobstatus.dir" to either a local file syste by preixing it with file:/// or dfs by giving a dfs directory without the "file:///" 2) After that run any job. 3) After it is complete the job id file comes in the configured directory. 4) Wait for one hour 5) Observe After 1 hour the files are not deleted. 6) After some random hours, files gets deleted. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.