Deepak Goyal created KAFKA-6976:
-----------------------------------
Summary: Kafka Streams instances going in to DEAD state
Key: KAFKA-6976
URL: https://issues.apache.org/jira/browse/KAFKA-6976
Project: Kafka
Issue Type: New Feature
Components: streams
Reporter: Deepak Goyal
We are using Kafka 0.10.2.0, kafka streams 1.1.0. We have Kafka Cluster of 16
machines, and topic that is being consumed by Kafka Streams has 256 partitions.
We spawned 400 instances of Kakfa Streams application. We see that all of the
StreamThreads go in to DEAD state.
{quote}{{[2018-05-25 05:59:29,282] INFO stream-thread
[ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7-StreamThread-1] State transition
from PENDING_SHUTDOWN to DEAD
(org.apache.kafka.streams.processor.internals.StreamThread) [2018-05-25
05:59:29,282] INFO stream-client [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7]
State transition from REBALANCING to ERROR
(org.apache.kafka.streams.KafkaStreams) [2018-05-25 05:59:29,282] WARN
stream-client [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7] All stream threads
have died. The instance will be in error state and should be closed.
(org.apache.kafka.streams.KafkaStreams) [2018-05-25 05:59:29,282] INFO
stream-thread [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7-StreamThread-1]
Shutdown complete (org.apache.kafka.streams.processor.internals.StreamThread)}}
{quote}
Please note that when we have only 100 kafka instances, things are working as
expected. We see that instances are consuming messages from topic.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)