Re: Kafka Stream tuning.

2018-02-14 Thread Guozhang Wang
gt; -Original Message- > From: TSANG, Brilly [mailto:brilly.ts...@hk.daiwacm.com] > Sent: Wednesday, February 14, 2018 11:01 AM > To: users@kafka.apache.org > Subject: RE: Kafka Stream tuning. > > Hey Damian and folks, > > I've also tried 1000 and 500 and the perform

RE: Kafka Stream tuning.

2018-02-13 Thread TSANG, Brilly
implementation? Regards, Brilly -Original Message- From: TSANG, Brilly [mailto:brilly.ts...@hk.daiwacm.com] Sent: Wednesday, February 14, 2018 11:01 AM To: users@kafka.apache.org Subject: RE: Kafka Stream tuning. Hey Damian and folks, I've also tried 1000 and 500 and the performance state

RE: Kafka Stream tuning.

2018-02-13 Thread TSANG, Brilly
Hey Damian and folks, I've also tried 1000 and 500 and the performance state is exactly the same. Any other ideas? Regards, Brilly -Original Message- From: Damian Guy [mailto:damian@gmail.com] Sent: Tuesday, February 13, 2018 4:48 PM To: users@kafka.apache.org Subject: Re:

Re: Kafka Stream tuning.

2018-02-13 Thread Damian Guy
Hi Brilly, My initial guess is that it is the overhead of committing. Commit is synchronous and you have the commit interval set to 50ms. Perhaps try increasing it. Thanks, Damian On Tue, 13 Feb 2018 at 07:49 TSANG, Brilly wrote: > Hi kafka users, > > I created a filtering stream with the Proc