Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Dmitriy Vsekhvalnov
Ok, we can try that. Some other settings to try? On Thu, Oct 5, 2017 at 20:42 Stas Chizhov wrote: > I would set it to Integer.MAX_VALUE > > 2017-10-05 19:29 GMT+02:00 Dmitriy Vsekhvalnov : > > > I see, but producer.retries set to 10 by default. > > >

Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Stas Chizhov
I would set it to Integer.MAX_VALUE 2017-10-05 19:29 GMT+02:00 Dmitriy Vsekhvalnov : > I see, but producer.retries set to 10 by default. > > What value would you recommend to survive random broker crashes? > > On Thu, Oct 5, 2017 at 8:24 PM, Stas Chizhov

Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Dmitriy Vsekhvalnov
I see, but producer.retries set to 10 by default. What value would you recommend to survive random broker crashes? On Thu, Oct 5, 2017 at 8:24 PM, Stas Chizhov wrote: > It is a producer config: > https://docs.confluent.io/current/streams/developer- >

Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Stas Chizhov
It is a producer config: https://docs.confluent.io/current/streams/developer-guide.html#non-streams-configuration-parameters 2017-10-05 19:12 GMT+02:00 Dmitriy Vsekhvalnov : > replication.factor set to match source topics. (3 in our case). > > what do you mean by retires?

Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Dmitriy Vsekhvalnov
replication.factor set to match source topics. (3 in our case). what do you mean by retires? I don't see retries property in StreamConfig class. On Thu, Oct 5, 2017 at 7:55 PM, Stas Chizhov wrote: > Hi > > Have you set replication.factor and retries properties? > > BR > >

Re: kafka-streams configuration for high resilience (crashing when broker crashing) ?

2017-10-05 Thread Stas Chizhov
Hi Have you set replication.factor and retries properties? BR tors 5 okt. 2017 kl. 18:45 skrev Dmitriy Vsekhvalnov : > Hi all, > > we were testing Kafka cluster outages by randomly crashing broker nodes (1 > of 3 for instance) while still keeping majority of replicas