Hello David, Did you create my-topic before creating the producer? I am not very familiar with the kafka python producer client, but from the trace it seems the producing is trying to first load the topic metadata from Kafka server but cannot since the topic may not exist.
Guozhang On Sat, Feb 15, 2014 at 1:02 AM, David Montgomery <[email protected] > wrote: > Hi, > > Kafka 8 is giving issues. > > I want to connect to kafka via python > > Below is the error I get in kafka and in python. I just dont get why kafka > fails.......how do I resolve....how do I just reset everything? Thanks > > from kafka.client import KafkaClient > from kafka.producer import SimpleProducer, KeyedProducer > from kafka.consumer import MultiProcessConsumer > kafka = KafkaClient(kafka_domain, 9092) > producer = SimpleProducer(kafka, async=False) > > Traceback (most recent call last): > File "/home/ubuntu/workspace/test.py", line 34, in <module> > kafka = KafkaClient(kafka_domain, 9092) > File "/usr/local/lib/python2.7/dist-packages/kafka/client.py", line 38, > in __init__ > self.load_metadata_for_topics() # bootstrap with all metadata > File "/usr/local/lib/python2.7/dist-packages/kafka/client.py", line 247, > in load_metadata_for_topics > self.topics_to_brokers[topic_part] = brokers[meta.leader] > KeyError: -1 > > > > > > [2014-02-15 08:54:51,178] ERROR [KafkaApi-1392248055] Error while fetching > metadata for partition [my-topic,0] (kafka.server.KafkaApis) > kafka.common.LeaderNotAvailableException: Leader not available for > partition [my-topic,0] > at > kafka.server.KafkaApis$$anonfun$17$$anonfun$20.apply(KafkaApis.scala:474) > at > kafka.server.KafkaApis$$anonfun$17$$anonfun$20.apply(KafkaApis.scala:462) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > > scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.scala:61) > at scala.collection.immutable.List.foreach(List.scala:45) > at > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > at scala.collection.immutable.List.map(List.scala:45) > at kafka.server.KafkaApis$$anonfun$17.apply(KafkaApis.scala:462) > at kafka.server.KafkaApis$$anonfun$17.apply(KafkaApis.scala:458) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at > > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:206) > at scala.collection.immutable.Set$Set2.foreach(Set.scala:101) > at > scala.collection.TraversableLike$class.map(TraversableLike.scala:206) > at scala.collection.immutable.Set$Set2.map(Set.scala:87) > at > kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:458) > at kafka.server.KafkaApis.handle(KafkaApis.scala:68) > at > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:42) > at java.lang.Thread.run(Thread.java:744) > [2014-02-15 08:54:51,180] ERROR [KafkaApi-1392248055] Error while fetching > metadata for partition [my-topic,1] (kafka.server.KafkaApis) > -- -- Guozhang
