Re: Kafka Streams app can not be reset.

2018-02-16 Thread Russell Teabeault
> partitions of __consumer_offsets topic? > > Thanks a lot. > > -Matthias > > > On 2/16/18 12:35 PM, Russell Teabeault wrote: > > Matthias, > > > > The session.timeout.ms is set to 1. It has been in this "weird" > state > > now fo

Re: Kafka Streams app can not be reset.

2018-02-16 Thread Russell Teabeault
r should eventually time out consumers and thus clean-up the > consumer group. > > How long did you wait? > > Did you modify the `session.timeout.ms` config? > > As a last resort, bouncing the broker that hosts the consumer group > coordinator should resolve the issue. >

Kafka Streams app can not be reset.

2018-02-15 Thread Russell Teabeault
x27; is rebalancing. How do I get it out of this state and how did I get it into this state? Thanks! -- Russell Teabeault | Senior Software Engineer | Twitter | @rusticules

Re: Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
I can send you my email address directly. > > > > Thanks, > > Bill > > > > On Wed, Feb 7, 2018 at 6:16 PM, Russell Teabeault < > > rteabea...@twitter.com.invalid> wrote: > > > >> Bill, > >> > >> I may be able to. > >

Re: Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
> brokers. > > > -Matthias > > On 2/7/18 3:16 PM, Russell Teabeault wrote: > > Bill, > > > > I may be able to. > > > > - What logging level? > > - Do you need logs from all the instances? > > - Where should I send them? > > > > -r

Re: Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
Matthias, Disregard the exception I mentioned. I think that was a transient error caused by our broker cluster re-spinning. -russ On Wed, Feb 7, 2018 at 3:45 PM, Russell Teabeault wrote: > Hi Matthias, > > Thanks for the prompt reply. We have built the kafka-streams jar from the >

Re: Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
ing from trunk or 1.0 branch. (If you do, feedback > would > > > be very welcome :)) > > > > > > Your proposed workarounds should work. I cannot come up with anything > > > else you could do, because the task assignment cannot be influenced. > > >

Re: Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
up with anything > else you could do, because the task assignment cannot be influenced. > > > -Matthias > > On 2/7/18 10:37 AM, Russell Teabeault wrote: > > We are using Kafka Streams for a project and had some questions about how > > stream tasks are assigned. >

Kafka Streams balancing of tasks across nodes

2018-02-07 Thread Russell Teabeault
nto separate applications across the boundary of an intermediate topic. Neither of these seem like great solutions. So I would like to know: 1. Is this expected behavior? 2. Is there some technique to get equal distribution of task/partition assignments across instances? Thanks for the help. -- Russell Teabeault | Senior Software Engineer | Twitter | @rusticules