[ 
https://issues.apache.org/jira/browse/FLINK-2706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14875948#comment-14875948
 ] 

Aljoscha Krettek commented on FLINK-2706:
-----------------------------------------

This should not be too hard. The Java Filesystem API can truncate.

> Add support for streaming RollingFileSink to truncate / append on UNIX file 
> systems
> -----------------------------------------------------------------------------------
>
>                 Key: FLINK-2706
>                 URL: https://issues.apache.org/jira/browse/FLINK-2706
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming Connectors
>    Affects Versions: 0.10
>            Reporter: Stephan Ewen
>
> Efficient exactly-once behavior needs the filesystem to support appending and 
> truncating files.
> Since the UNIX file system API allows to append files and truncate files, we 
> can support perfect exactly-once behavior efficiently on all file systems 
> that expose a UNIX / POSIX-style interface (local FS, NFS, MapR FS).
> Without this support, only Hadoop 2.7+ versions support proper exactly once 
> behavior.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to