Chenzhao Guo created HDFS-14592:
-----------------------------------

             Summary: Support NIO transferTo semantics in HDFS
                 Key: HDFS-14592
                 URL: https://issues.apache.org/jira/browse/HDFS-14592
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Chenzhao Guo


I'm currently developing a Spark shuffle manager based on HDFS. I need to merge 
some spill files on HDFS to one, or rearrange some HDFS files.

An API similar to NIO transferTo, which bypasses memory will be more efficient 
than manually reading and writing bytes(the method I'm using at present).

So can HDFS implements something like NIO transferTo? Making 
path.transferTo(pathDestination) possible? 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to