Re: Kafka streams parallelism - why not separate stream task per partition per input topic

2020-10-14 Thread Pushkar Deole
Matthias, Any recommendations? Also, while doing performance test, I observed that the partitions assigned to stream threads are changing. Why would this happen when the instances are not going down? e.g. i see partitions being changed between stream thread consumers. The highlighted in bold are

Re: Number of topics to which provider sends

2020-10-14 Thread Liam Clarke-Hutchinson
Hi Victoria, The obvious advantage is that you could configure producers differently. For example, one may be sending small messages as fast as possible, while another producer may be utilising batching with large batch sizes and a long linger to send larger amounts of data more efficiently, but

Number of topics to which provider sends

2020-10-14 Thread Victoria Zuberman
Hi, Background: Java, Kafka 2.1.0 I have application that sends to two different topics. In theory I can use the same provider. Are there any advantages to having provider per topic? I looked for best practices for this matter but didn’t find any... Thanks, Victoria -