[
https://issues.apache.org/jira/browse/BEAM-894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pei He closed BEAM-894.
-----------------------
Resolution: Won't Fix
Fix Version/s: Not applicable
> Using @Teardown to remove temp files from failed bundles in Write.WriteBundles
> ------------------------------------------------------------------------------
>
> Key: BEAM-894
> URL: https://issues.apache.org/jira/browse/BEAM-894
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core
> Reporter: Pei He
> Assignee: Pei He
> Fix For: Not applicable
>
>
> FileBasedSink lefts temp files behind for failed bundles, and it forces
> finalize() to depend on pattern match.
> However, pattern matching is not always reliable for eventual consistency
> file system, such as GCS.
> Given we now have DoFn.TearDown, we can improve FileBasedSink (and in general
> Write transform) to remove temp files/resources early when DoFn bundles fail.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
