Re: Commit in Kafka streams reduces throughput

2018-04-20 Thread Shivam Sharma
*Correction *- After removing commit my RPM increased to *40k/min* from *2k/min*. Thanks On Wed, Apr 18, 2018 at 11:22 PM, Guozhang Wang wrote: > Hello Shivam, > > I think your two questions can be answer as one :) > > Have just created this FAQ entry for you: > https://cwiki.apache.org/conflue

Re: Commit in Kafka streams reduces throughput

2018-04-18 Thread Guozhang Wang
Hello Shivam, I think your two questions can be answer as one :) Have just created this FAQ entry for you: https://cwiki.apache.org/confluence/display/KAFKA/FAQ#FAQ-WhenIcommitmyprocessstate,whatdoestheStreamslibrarydoandhowitaffectsmyapplication'sperformance ? Guozhang On Tue, Apr 17, 2018 a

Commit in Kafka streams reduces throughput

2018-04-17 Thread Shivam Sharma
Hi All, I am using processor API in Kafka Streams and I am using context.commit in process method of Processor Interface. When I am using commit then my application throughput is about 2k/min and when I removes commit then it increases to 4k/min. Two questions I have: 1. I need to know how commit