Kafka Performance Tuning

2014-04-24 Thread Yashika Gupta
Hi, I am working on a POC where I have 1 Zookeeper and 2 Kafka Brokers on my local machine. I am running 8 sets of Kafka consumers and producers running in parallel. Below are my configurations: Consumer Configs: zookeeper.session.timeout.ms=12 zookeeper.sync.time.ms=2000 zookeeper.connecti

RE: Kafka Performance Tuning

2014-04-24 Thread Yashika Gupta
Thu, Apr 24, 2014 at 10:12 AM, Yashika Gupta wrote: > Hi, > > I am working on a POC where I have 1 Zookeeper and 2 Kafka Brokers on my > local machine. I am running 8 sets of Kafka consumers and producers running > in parallel. > > Below are my conf

Re: Kafka Performance Tuning

2014-04-24 Thread Yashika Gupta
the servers? Guozhang On Thu, Apr 24, 2014 at 10:46 AM, Yashika Gupta wrote: > Jun, > > The detailed logs are as follows: > > 24.04.2014 13:37:31812 INFO main kafka.producer.SyncProducer - > Disconnecting from localhost:9092 > 24.04.2014 13:37:38612 WARN main kafka.produce

Re: Kafka Performance Tuning

2014-04-24 Thread Yashika Gupta
: > Could you double check if the topic LOGFILE04 is already created on the > servers? > > Guozhang > > > On Thu, Apr 24, 2014 at 10:46 AM, Yashika Gupta < > yashika.gu...@impetus.co.in > > wrote: > > > Jun, > > > > The detailed logs ar

RE: Kafka Performance Tuning

2014-04-24 Thread Yashika Gupta
, 2014 9:03 AM To: users@kafka.apache.org Subject: Re: Kafka Performance Tuning Which version of Kafka are you using? Any error in the controller and state-change log? Thanks, Jun On Thu, Apr 24, 2014 at 7:37 PM, Yashika Gupta wrote: > I am running a single broker and the leader column ha

RE: Kafka Performance Tuning

2014-04-25 Thread Yashika Gupta
ker log is not normal, can you verify if you turned off logging in your log4j properties file? If it is please enable it and try again, and see what is in the logs. Tim On Thu, Apr 24, 2014 at 10:53 PM, Yashika Gupta wrote: > Jun, > > I am using Kafka 2.8.0- 0.8.0 version. > There are