Akhil Sabu created KAFKA-20599:
----------------------------------
Summary: Improve retry logic in KafkaStatusBackingStore with
exponential backoff and retry limits
Key: KAFKA-20599
URL: https://issues.apache.org/jira/browse/KAFKA-20599
Project: Kafka
Issue Type: Improvement
Components: connect
Reporter: Akhil Sabu
The `KafkaStatusBackingStore` class contains a TODO comment at line 283
indicating that the retry logic needs improvement:
// TODO: retry more gracefully and not forever
if (exception instanceof RetriableException) {
sendRetryExecutor.submit(() -> kafkaLog.send(key, value, this));
}
Currently, when a {{RetriableException}} occurs while writing status updates to
Kafka, the code:
# Retries indefinitely without any maximum attempt limit
# Has no backoff delay between retry attempts
# Does not implement exponential backoff to reduce load during failures
# Can be resource-intensive and overwhelm the system during prolonged outages
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
