Github user tillrohrmann commented on the pull request:
https://github.com/apache/flink/pull/1084#issuecomment-137143368
Concerning the second short term option: Is the problem there that the
checkpointing is not aligned with the rolling? Thus, you can take a checkpoint
but you still have a temporary file which contains all the records up to the
checkpoint. If the sink now fails before renaming the temporary file, then the
records which have been written before the checkpoint was taken are lost. Did I
understand it correctly? If this is the case, then the records in the temporary
file should actually be part of the state of the sink, right?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
