Re: Kafka producer throw "TimeoutException: Batch Expired" when consumer begin to read data

[Ismael Juma]

This is likely the issue fixed by KIP-91. You'll get the right behaviour if
you upgrade to 2.1 or you can increase the request timeout.

Ismael

On Tue, Dec 4, 2018, 10:12 PM JF Chen  I have a system keep sending data to kafka continuously, and a spark
> streaming application reading these data from kafka every 5 minutes
> However, I found the kafka producer throws "TimeoutException: Batch
> Expired" error when sparking streaming begin to read the kafka every 5
> minutes.
> What's the reason for this? And how to solve this problem?
>
> Regard,
> Junfeng Chen
>

Kafka producer throw "TimeoutException: Batch Expired" when consumer begin to read data

[JF Chen]

I have a system keep sending data to kafka continuously, and a spark
streaming application reading these data from kafka every 5 minutes
However, I found the kafka producer throws "TimeoutException: Batch
Expired" error when sparking streaming begin to read the kafka every 5
minutes.
What's the reason for this? And how to solve this problem?

Regard,
Junfeng Chen