Jiangjie Qin created KAFKA-2042:
-----------------------------------
Summary: New producer metadata update always get all topics.
Key: KAFKA-2042
URL: https://issues.apache.org/jira/browse/KAFKA-2042
Project: Kafka
Issue Type: Bug
Reporter: Jiangjie Qin
The new java producer metadata.topics is initially empty so the producer sends
TMR with empty topic set. The broker takes the empty requested topic set as all
topics, so metadata.cluster contains all topic metadata. Later on, when a new
topic was produced, it gets added into the metadata.topics. The next metadata
update will only contain the meta data for this new topic, so the
metadata.cluster will only have this topic. Since there are a lot of messages
are still in the accumulator but has no metadata in metadata.cluster, if a
caller thread do a flush(), the caller thread will block forever because the
messages sitting in accumulator without metadata will never be ready to send.
We should add check for the metadata.topics, if it is empty, no TMR should be
sent.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
