[ https://issues.apache.org/jira/browse/BEAM-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Luke Cwik resolved BEAM-2030. ----------------------------- Resolution: Fixed > Implement beam FileSystem's copy() > ---------------------------------- > > Key: BEAM-2030 > URL: https://issues.apache.org/jira/browse/BEAM-2030 > Project: Beam > Issue Type: Sub-task > Components: sdk-java-extensions > Reporter: Stephen Sisk > Assignee: Luke Cwik > Fix For: First stable release > > > Beam's FileSystem has a copy() command, however I can't find a good analog in > Hadoop's FileSystem. > https://hadoop.apache.org/docs/r2.8.0/api/org/apache/hadoop/fs/FileSystem.html > shows lots of copy to/from local files, but no "copy between these two > arbitrary paths". > cc [~davor] [~dhalp...@google.com] did either of you have thoughts about > this? I don't think that it makes sense to have beam stream data from one > node just so it can write it back to another node. (it could be an extension > method, but I'd want to make it obvious that it's the inefficient version of > things) > My default answer here is to throw an unimplemented exception on copy or to > remove it from the BFS interface altogether. -- This message was sent by Atlassian JIRA (v6.3.15#6346)