Caizhi Weng created FLINK-26442:
-----------------------------------

             Summary: Allow ManifestFile to write a list of ManifestFileMeta 
into multiple files if too many.
                 Key: FLINK-26442
                 URL: https://issues.apache.org/jira/browse/FLINK-26442
             Project: Flink
          Issue Type: Sub-task
          Components: Table Store
    Affects Versions: 0.1.0
            Reporter: Caizhi Weng


Currently {{ManifestFile#write}} will only produce a single file no matter how 
large the given {{ManifestFileMeta}} list is. However batch jobs are likely to 
produce a lot of changes hence the list might be very long. We need to allow 
{{ManifestFile#write}} to produce multiple files for effective merging and 
filtering.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to