Sophie Blee-Goldman created KAFKA-10006:
-------------------------------------------
Summary: Streams should not attempt to create internal topics that
may exist
Key: KAFKA-10006
URL: https://issues.apache.org/jira/browse/KAFKA-10006
Project: Kafka
Issue Type: Improvement
Components: streams
Reporter: Sophie Blee-Goldman
During assignment, Streams will attempt to validate all internal topics and
their number of partitions, and create them if necessary. However we have seen
that the InternalTopicManager will occasionally try to recreate internal topics
that already exist when the broker is unavailable, and the describeTopics
request fails.
This is because we catch both UnknownTopicOrPartitionException AND
LeaderNotAvailableException and treat them the same, ie we assume the topic
does not exist. We shouldn't try to create topics until we've validated that
they don't actually exist. If we can't connect to the brokers to check whether
the topic exists, there's no reason to believe we would be able to create the
topic anyway.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
