hudi-bot opened a new issue, #15061: URL: https://github.com/apache/hudi/issues/15061
flink CompactionPlanOperator schedule compaction at notifyCheckpointComplete that can only schedule one compaction every checkpoint. when compaction rollback, compaction will later then compaction plan ,and cannot catch up with compaction plan create rate。eg: if compaction rollback 3 times, there will be 3 compaction plan pending schedule. hudi table (RO) look like delay , and more compactions rollback , much longer hudi table dely, never catch up. maybe we can make CompactionPlanOperator schedule more compactions at once ## JIRA info - Link: https://issues.apache.org/jira/browse/HUDI-3618 - Type: Improvement -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
