RocMarshal created FLINK-36039: ---------------------------------- Summary: Support clean historical event handler records in autoscaler jdbc plugin Key: FLINK-36039 URL: https://issues.apache.org/jira/browse/FLINK-36039 Project: Flink Issue Type: Improvement Components: Autoscaler Reporter: RocMarshal
Currently, the autoscaler generates a large amount of historical data for event handlers. As the system runs for a long time, the volume of historical data will continue to grow. It is necessary to support automatic cleanup of data within a fixed period. Based on the creation time timestamp, the following approach for cleaning up historical data might be a way: * Introduce the parameter {{job.autoscaler.event-handler.historical-ttl-duration}} (of type duration), which represents the storage time for historical data. * Introduce the parameter {{job.autoscaler.event-handler.historical-clean-interval}} (of type duration), which represents the interval between each data cleanup. In the constructor of {{{}JdbcAutoScalerEventHandler{}}}, introduce a scheduled task. Also, add an internal interface method, {{{}close{}}}, to {{AutoScalerEventHandler}} and {{JobAutoScaler}} for stopping and cleaning up the relevant logic. -- This message was sent by Atlassian Jira (v8.20.10#820010)