ChecksumFileSystem needs to support the new delete method
---------------------------------------------------------
Key: HADOOP-3025
URL: https://issues.apache.org/jira/browse/HADOOP-3025
Project: Hadoop Core
Issue Type: Bug
Components: fs
Affects Versions: 0.17.0
Reporter: Devaraj Das
Assignee: dhruba borthakur
Priority: Blocker
Fix For: 0.17.0
The method FileSystem.delete(path) has been deprecated in favor of the new
method delete(path, recursive). Temporary files gets created in the MapReduce
framework and when the time for deletion comes, they are deleted via
delete(path, recursive). This doesn't delete the associated checksum files.
This has a big impact when the FileSystem is the InMemoryFileSystem, where
space is at a premium and wasting space here might hurt the performance of
MapReduce jobs overall. One solution to this problem is to implement the method
delete(path, recursive) in the ChecksumFileSystem but is there is a reason why
it was left out as part of HADOOP-771?
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
