Laurie Turner created KAFKA-1636: ------------------------------------ Summary: High CPU in very active environment Key: KAFKA-1636 URL: https://issues.apache.org/jira/browse/KAFKA-1636 Project: Kafka Issue Type: Bug Components: consumer Affects Versions: 0.8.0 Environment: Redhat 64 bit 2.6.32-431.23.3.el6.x86_64 #1 SMP Wed Jul 16 06:12:23 EDT 2014 x86_64 x86_64 x86_64 GNU/Linux
Reporter: Laurie Turner Assignee: Neha Narkhede Found the same issue on StackOverFlow below: http://stackoverflow.com/questions/22983435/kafka-consumer-threads-are-in-waiting-state-and-lag-is-getting-increased This is a very busy environment and the majority of the CPU seems to be busy in the in the await method. 3XMTHREADINFO3 Java callstack: 4XESTACKTRACE at sun/misc/Unsafe.park(Native Method) 4XESTACKTRACE at java/util/concurrent/locks/LockSupport.parkNanos(LockSupport.java:237(Compiled Code)) 4XESTACKTRACE at java/util/concurrent/locks/AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2093(Compiled Code)) 4XESTACKTRACE at java/util/concurrent/LinkedBlockingQueue.poll(LinkedBlockingQueue.java:478(Compiled Code)) 4XESTACKTRACE at kafka/consumer/ConsumerIterator.makeNext(ConsumerIterator.scala:65(Compiled Code)) 4XESTACKTRACE at kafka/consumer/ConsumerIterator.makeNext(ConsumerIterator.scala:33(Compiled Code)) 4XESTACKTRACE at kafka/utils/IteratorTemplate.maybeComputeNext(IteratorTemplate.scala:61(Compiled Code)) 4XESTACKTRACE at kafka/utils/IteratorTemplate.hasNext(IteratorTemplate.scala:53(Compiled Code)) -- This message was sent by Atlassian JIRA (v6.3.4#6332)