Re: AW: Exception stopps data processing (Kafka Streams)

2018-05-16 Thread Matthias J. Sax
gt; > -Ursprüngliche Nachricht- > Von: Matthias J. Sax <matth...@confluent.io> > Gesendet: Dienstag, 15. Mai 2018 22:58 > An: users@kafka.apache.org > Betreff: Re: Exception stopps data processing (Kafka Streams) > > Claudia, > > I leader change is a

AW: Exception stopps data processing (Kafka Streams)

2018-05-16 Thread Claudia Wegmann
'max.in.flight.requests.per.connection' to 1 to still guarantee ordering, right? Best, Claudia -Ursprüngliche Nachricht- Von: Matthias J. Sax <matth...@confluent.io> Gesendet: Dienstag, 15. Mai 2018 22:58 An: users@kafka.apache.org Betreff: Re: Exception stopps data processing (Kafka Streams) Claudia, I

Re: Exception stopps data processing (Kafka Streams)

2018-05-15 Thread Matthias J. Sax
Claudia, I leader change is a retryable error. What is your producer config for `retries`? You might want to increase it such that the producer does not throw the exception immediately but retries couple of times -- you might also want to adjust `retry.backoff.ms` that sets the time to wait until

Exception stopps data processing (Kafka Streams)

2018-05-15 Thread Claudia Wegmann
Hey there, I've got a few Kafka Streams services which run smoothly most of the time. Sometimes, however, some of them get an exception "Abort sending since an error caught with a previous record" (see below for a full example). The Stream Service having this exception just stops its work