BELUGA BEHR created HDFS-13988: ---------------------------------- Summary: Allow for Creating Temporary Files Key: HDFS-13988 URL: https://issues.apache.org/jira/browse/HDFS-13988 Project: Hadoop HDFS Issue Type: New Feature Components: hdfs, hdfs-client Affects Versions: 3.2.0 Reporter: BELUGA BEHR
Allow clients to create temporary files in HDFS. {code:java|title=FileSystem.java} public FSDataOutputStreamBuilder createFile(Path path); public FSDataOutputStreamBuilder appendFile(Path path); // New feature public FSDataOutputStreamBuilder createTempFile(Path path, TimeUnit unit, long ttl); {code} This would register the file with the NameNode to have a TTL. The NameNode would be responsible for deleting the files after some custom TTL. This would be helpful in the case that a MapReduce (or Spark) job fails during execution and does not properly clean up after itself. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org