[
https://issues.apache.org/jira/browse/FLINK-29800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17626926#comment-17626926
]
luoyuxia commented on FLINK-29800:
----------------------------------
> The current inprogress files can be record in the {{Bucket}} as a new field
Seems the existing `inProgressPart` in Bucket can meet such need?
If so, the ` inProgressPart` will be disposed in close method in the current
code base.
> Continuous failover will leak the inprogress output file
> --------------------------------------------------------
>
> Key: FLINK-29800
> URL: https://issues.apache.org/jira/browse/FLINK-29800
> Project: Flink
> Issue Type: Bug
> Components: Connectors / FileSystem
> Reporter: Aitozi
> Priority: Major
>
> When running job which sink to the file system, the inprogress files will
> keep growing when job keeps failover, it will do harm to the filesystem. I
> think the clean up to the file which is currently written to should be
> performed when job failing
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
