+dev On Thu, Jul 26, 2018 at 2:40 AM Jozef Vilcek <jozo.vil...@gmail.com> wrote:
> Hello, > > just came across FileBasedSink.WriteOperation class which does have > moveToOutput() method. Implementation does a Filesystem.copy() instead of > "move". With large files I find it quote no efficient if underlying FS > supports more efficient ways, so I wonder what is the story behind it? Must > it be a copy? > > > https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/FileBasedSink.java#L761 >
