Github user kl0u commented on the issue:
https://github.com/apache/flink/pull/2797
Hi @zentol . I integrated your last comments.
Now for the your last question, the answer is that the only way to
distinguish between the two types of files is by their filename (prefix and
suffix). This holds for infinite streams.
Unfortunately in the case of finite streams, we cannot even do that because
the current `RichFunction` interface does not allow to distinguish between a
failure and normal termination, so the `close()` just leaves the files in
`pending` state.
I have opened a discussion in the dev mailing list for that. The thread is
this one:
[(http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Adding-a-dispose-method-in-the-RichFunction-td14466.html#a14468)]
Feel free to jump in.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
