I have a 3 node kafka cluster which is being managed via kubernetes, in
docker containers.
Recently, one of the 3 nodes went down, and was automatically re-created by
kubernetes.
However, now whenever I try to consume from one of my Kafka topics, thru
Kafka Streaming, i get the error:
>6687 [StreamThread-1] WARN org.apache.kafka.clients.NetworkClient -
Error while fetching metadata with correlation id 1 :
{my_topic=LEADER_NOT_AVAILABLE}
> org.apache.kafka.streams.errors.StreamsException: Topic not found during
partition assignment: my_topic
When I tried to re-create the topic via 'kafka-topics.sh --create', I
received:
> Error while executing topic command : Topic "my_topic" already exists.
Any ideas what's going on here, and how to have Kafka recover from a node
going down and automatically elect a new leader?
