[
https://issues.apache.org/jira/browse/FLINK-33187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Clara Xiong updated FLINK-33187:
--------------------------------
Description:
Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling
is not enable, which consists 99% of all Kafka events in our prod env. This
wastes Kafka resources and cause performance downstream.
Proposal:
Suppress duplicate event within an interval defined by a new operator config
"scaling.report.interval" in second, defaulted to 1800.
was:
Problem:
Some events are sent to Kafka repeatedly such as ScalingReport when autoscaling
is not enable, which consists 99% of all Kafka events in our prod env. This
wastes Kafka resources and cause performance downstream.
Proposal:
Suppress duplicate event within an interval defined by a new operator dynamic
config "scaling.report.interval" in second, defaulted to 1800.
> Don't send duplicate event to Kafka if no change
> ------------------------------------------------
>
> Key: FLINK-33187
> URL: https://issues.apache.org/jira/browse/FLINK-33187
> Project: Flink
> Issue Type: Improvement
> Components: Autoscaler
> Affects Versions: 1.17.1
> Reporter: Clara Xiong
> Priority: Major
>
> Problem:
> Some events are sent to Kafka repeatedly such as ScalingReport when
> autoscaling is not enable, which consists 99% of all Kafka events in our
> prod env. This wastes Kafka resources and cause performance downstream.
> Proposal:
> Suppress duplicate event within an interval defined by a new operator config
> "scaling.report.interval" in second, defaulted to 1800.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
