ZiyueGuan created HUDI-4965: ------------------------------- Summary: automatically adapt COMMITS_ARCHIVAL_BATCH_SIZE Key: HUDI-4965 URL: https://issues.apache.org/jira/browse/HUDI-4965 Project: Apache Hudi Issue Type: Improvement Reporter: ZiyueGuan
COMMITS_ARCHIVAL_BATCH_SIZE is used to determine how many records will write to archived timeline. However, if there are several huge instants which leads to a huge batch, it cannot be written as log block is overflow. So determine batch size by instants binary size. -- This message was sent by Atlassian Jira (v8.20.10#820010)