[
https://issues.apache.org/jira/browse/KAFKA-8325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16899717#comment-16899717
]
Luke Stephenson commented on KAFKA-8325:
----------------------------------------
I'm also seeing this issue with version 2.2.1 of the client (brokers are
running kafka 2.1.1).
In my application, when the KafkaProducer callback is invoked, I'm completing a
Scala Future. This is also triggering a `java.lang.IllegalStateException:
Promise already completed.` to be logged. So that's in alignment with the
`IncompleteBatches` reporting.
As [~bob-barrett] reported, the initial cause of this seems to be triggered by
```
Got error produce response in correlation id 1386 on topic-partition
my.topic-0, splitting and retrying (30 attempts left). Error: MESSAGE_TOO_LARGE
```
> Remove from the incomplete set failed. This should be impossible
> ----------------------------------------------------------------
>
> Key: KAFKA-8325
> URL: https://issues.apache.org/jira/browse/KAFKA-8325
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 2.1.0, 2.3.0
> Reporter: Mattia Barbon
> Assignee: Bob Barrett
> Priority: Major
>
> I got this error when using the Kafka producer. So far it happened twice,
> with an interval of about 1 week.
> {{ERROR [2019-05-05 08:43:07,505]
> org.apache.kafka.clients.producer.internals.Sender: [Producer
> clientId=<redacted>, transactionalId=<redacted>] Uncaught error in kafka
> producer I/O thread:}}
> {{ ! java.lang.IllegalStateException: Remove from the incomplete set failed.
> This should be impossible.}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.IncompleteBatches.remove(IncompleteBatches.java:44)}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.RecordAccumulator.deallocate(RecordAccumulator.java:645)}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.Sender.failBatch(Sender.java:717)}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.Sender.sendProducerData(Sender.java:365)}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:308)}}
> {{ ! at
> org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:233)}}
> {{ ! at java.lang.Thread.run(Thread.java:748)}}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
