Gary Li created HUDI-2128:
-----------------------------
Summary: Refactor Flink MOR write in a streaming way
Key: HUDI-2128
URL: https://issues.apache.org/jira/browse/HUDI-2128
Project: Apache Hudi
Issue Type: Improvement
Reporter: Gary Li
Assignee: Gary Li
Currently, we do the actual write during the snapshot and pass a
List<HoodieRecord> to the WriteHandle. This will make the snapshot operation
and causing checkpoint timeout sometimes. We need to refactor the handle in a
streaming fashion.
To append records to the WriteHandle during the processElement stage and only
flush to the disk during the checkpoint.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
