Re: Kafka 0.8.2.2 is using high CPU

2016-03-24 Thread li jinyu
add more information. we found that the linux(centos) running kafka has a very high context switch. and at first we thought it's caused by corrupted message data, but I tried to delete all data in one node and restarted kafka, but cpu usage is still high. following are outputs from sar and vmstat:

Re: Kafka 0.8.2.2 is using high CPU

2016-03-19 Thread li jinyu
thanks, the new kafka cluster is stable now, I want to know the root cause. On Sat, Mar 19, 2016 at 3:34 PM, Stevo Slavić wrote: > Consider upgrading to 0.9.0.1 - our cluster is much more stable since > upgrade. Clients can be upgraded later. > > On Fri, Mar 18, 2016, 23:22 li jinyu wrote: > >

Re: Kafka 0.8.2.2 is using high CPU

2016-03-19 Thread Stevo Slavić
Consider upgrading to 0.9.0.1 - our cluster is much more stable since upgrade. Clients can be upgraded later. On Fri, Mar 18, 2016, 23:22 li jinyu wrote: > I want to add more information. > > we've already setup a completely new Kafka cluster with 0.8.2.2, and the > old cluster is still there, b

Kafka 0.8.2.2 is using high CPU

2016-03-18 Thread li jinyu
hi all, we encountered problem with 0.8.1.1, as a lot of BadVersion error in log, we believe it's caused by issue https://issues.apache.org/jira/browse/KAFKA-1382, so we upgraded kafka to 0.8.2.2. but we found that kafka is using high CPU. following is the result of 'top' command: PID USER

Re: Kafka 0.8.2.2 is using high CPU

2016-03-18 Thread li jinyu
I want to add more information. we've already setup a completely new Kafka cluster with 0.8.2.2, and the old cluster is still there, but no consumer or producer, it's really wired that the CPU usage is still high. also changed fetch.purgatory.purge.interval.requests and producer.purgatory.purge.i