Hi Kaustubh, We added some fixes after version 0.11.x to improve task assignment balance. Can you try with Kafka streams version 2.0 and see if things improve at all?
Kafka Streams version 2.0 is compatible with 0.10.2 broker as long as you don't enable exactly-once processing, which is turned off by default so you should be ok there. As for logs I'm just looking for the Kafka Streams task assignment/revocation related information including rebalances. Thanks, Bill On Fri, Aug 31, 2018 at 10:06 AM kaustubh khasnis < kaustubh.khas...@gmail.com> wrote: > Hi Bill, > Thanks for the reply. > Kafka streams we are using 0.11.0.2, but we were able to see the issue in > 0.10.2 also. Broker is 0.10.2. Regarding logs, can you please be specific > what you are looking for? Cause log sizes are pretty big, so I can copy and > send relevant portions here. > > Thanks > Kaustubh > > On Fri, Aug 31, 2018 at 7:12 PM Bill Bejeck <b...@confluent.io> wrote: > > > Hi, > > > > What version of Kafka Streams are you using? Can you share some log > files > > preferably at the DEBUG level? > > > > Thanks, > > Bill > > > > On Thu, Aug 30, 2018 at 9:58 PM kaustubh khasnis < > > kaustubh.khas...@gmail.com> > > wrote: > > > > > Hi, > > > I have written a streams application to talk to topic on cluster > of 5 > > > brokers with 10 partitions. I have tried multiple combinations here > like > > 10 > > > application instances (on 10 different machines) with 1 stream thread > > each, > > > 5 instances with 2 threads each. But for some reason, when I check in > > kafka > > > manager, the 1:1 mapping between partition and stream thread is not > > > happening. Some of the threads are picking up 2 partitions while some > > > picking up none. Can you please help me with same?? All threads are > part > > of > > > same group and subscribed to only one topic. > > > > > > Thanks a lot for your help > > > Kaustubh > > > > > >
