Hi,
I tried 0.9.0.0 as well as 0.9.0.1 client and server combinations. Broker +
Zookeeper runs on VM (Ubuntu 14.04) and consumer (console-consumer) as well as
producer (Java client) runs on host (windows)
Changed advertised.host.name to reflect the VM's hostname - kafka-zook. Due to
firewall issues, I had to adjust ZK port to 80 and broker port to 25. Added few
messages to the topic using a Java producer (in fact, this was way too slow - 1
message sent every 30 seconds - again due to failure to fetch metadata while
running producer).
On console-consumer, I see following exception - especially "Failed to find
leader for Set([test,0], [test,2], [test,1])
(kafka.consumer.ConherManager$LeaderFinderThread)" continuously.
Both ZK port and broker ports are reachable from host machine
Any clue on what I might be missing ?
c:\Adventures\kafka_2.11-0.9.0.0\kafka_2.11-0.9.0.0\kafka_2.11-0.9.0.0\bin\windows>
kafka-console-consumer.bat --topic test --zookeeper kafka-zook:80
[2016-03-17 06:39:18,436] WARN Fetching topic metadata with correlation id 0
for topics [Set(test)] from broker [BrokerEndPoint(0,kafka-zook,25)] failed
(kafka.client.ClientUtils$)
java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
at
kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
[2016-03-17 06:39:18,439] WARN
[console-consumer-85209_IN00106404-1458176937011-687fb3e8-leader-finder-thread],
Failed to find leader for Set([test,0], [test,2], [test,1]) (kafka.consumer.Con
herManager$LeaderFinderThread)
kafka.common.KafkaException: fetching topic metadata for topics [Set(test)]
from broker [ArrayBuffer(BrokerEndPoint(0,kafka-zook,25))] failed
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:73)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
at
kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
Caused by: java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
... 3 more
[2016-03-17 06:39:39,661] WARN Fetching topic metadata with correlation id 1
for topics [Set(test)] from broker [BrokerEndPoint(0,kafka-zook,25)] failed
(kafka.client.ClientUtils$)
java.nio.channels.ClosedChannelException
at kafka.network.BlockingChannel.send(BlockingChannel.scala:110)
at kafka.producer.SyncProducer.liftedTree1$1(SyncProducer.scala:75)
at
kafka.producer.SyncProducer.kafka$producer$SyncProducer$$doSend(SyncProducer.scala:74)
at kafka.producer.SyncProducer.send(SyncProducer.scala:119)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:59)
at kafka.client.ClientUtils$.fetchTopicMetadata(ClientUtils.scala:94)
at
kafka.consumer.ConsumerFetcherManager$LeaderFinderThread.doWork(ConsumerFetcherManager.scala:66)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
Processed a total of 1 messages
Terminate batch job (Y/N)? y
Regards
Muthu
