Justine Olshan created KAFKA-14359:
--------------------------------------
Summary: Idempotent Producer continues to retry on
OutOfOrderSequence error when first batch fails
Key: KAFKA-14359
URL: https://issues.apache.org/jira/browse/KAFKA-14359
Project: Kafka
Issue Type: Task
Reporter: Justine Olshan
When the idempotent producer does not have any state it can fall into a state
where the producer keeps retrying an out of order sequence. Consider the
following scenario where an idempotent producer has retries and delivery
timeout are int max (a configuration used in streams).
1. A producer send out several batches (up to 5) with the first one starting at
sequence 0.
2. The first batch with sequence 0 fails due to a transient error (ie,
NOT_LEADER_OR_FOLLOWER or a timeout error)
3. The second batch, say with sequence 200 comes in. Since there is no previous
state to invalidate it, it gets written to the log
4. The original batch is retried and will get an out of order sequence number
5. Current java client will continue to retry this batch, but it will never
resolve.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
