[
https://issues.apache.org/jira/browse/FLINK-2583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14731024#comment-14731024
]
ASF GitHub Bot commented on FLINK-2583:
---------------------------------------
Github user StephanEwen commented on the pull request:
https://github.com/apache/flink/pull/1084#issuecomment-137782086
How hard is it to support the truncate file code path also for regular Unix
file systems (rather than only HDFS 2.7+)?
The reason is that this way we would support mounted file systems (NAS,
EBS) and MapR file system (exposes also a regular Unix file system interface)
in a seamless exactly once way (no need to have readers that are aware of the
metadata files).
> Add Stream Sink For Rolling HDFS Files
> --------------------------------------
>
> Key: FLINK-2583
> URL: https://issues.apache.org/jira/browse/FLINK-2583
> Project: Flink
> Issue Type: New Feature
> Components: Streaming
> Reporter: Aljoscha Krettek
> Assignee: Aljoscha Krettek
> Fix For: 0.10
>
>
> In addition to having configurable file-rolling behavior the Sink should also
> integrate with checkpointing to make it possible to have exactly-once
> semantics throughout the topology.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
