This LeaderNotAvailableException only occurs once now, running kafka 8 from a
dos shell. We are following KAFKA-876 closely which we also experience.
thanks!
rob
________________________________________
From: Withers, Robert
Sent: Friday, April 19, 2013 6:38 AM
To: users@kafka.apache.org
Subject: RE: LeaderNotAvailableException: reventing the running of
kafka-console-producer.bat
Hi Jun,
It seems I failed to respond to this post. My apologies. I did test a week
ago, with the latest 0.8 and it still failed. The reason I did wait so long is
to get my home machine setup, which I finished today. At work we are tearing
it up and leaving behind issues so we can get message traffic over kafka-0.7.2
into storm. We got this working yesterday afternoon..yay!
I git cloned kafka (with EGit) and then sbt.bat update and sbt.bat package.
Here is git log results:
commit 9ff4e8eb10e0ddd86f257e99d55971a132426605
Author: Jay Kreps <jay.kr...@gmail.com>
Date: Tue Mar 12 11:17:12 2013 -0700
KAFKA-739 Handle null message payloads in messages and in the log cleaner. R
commit c1ed12e44ddebe41dc464683e3d7eeb4e6d39a45
Author: Jay Kreps <jay.kr...@gmail.com>
Date: Fri Mar 8 15:07:39 2013 -0800
KAFKA-554 Dynamic per-topic configuration. This patch adds a mechanism for s
commit 4f2742d60d16f5ba468aa66d2c3ed7aa37479dce
Merge: 82b11aa 92ecebe
Author: Jun Rao <jun...@gmail.com>
Date: Sun Mar 3 20:20:41 2013 -0800
merge from 0.8 and resolve conflicts
This problem still persists, unfortunately, running kafka-console-consumer.bat
and kafka-console-producer.bat.
Best,
rob
________________________________________
From: Jun Rao [jun...@gmail.com]
Sent: Sunday, April 07, 2013 10:59 PM
To: users@kafka.apache.org
Subject: Re: LeaderNotAvailableException: reventing the running of
kafka-console-producer.bat
That hash tag points to a commit on Apr 4 and is probably not what you
have. Try "git log" on the checkout that builds your binary. If you can't
figure this out, could you try the latest code in the 0.8 branch and see if
the problem still exists?
Thanks,
Jun
On Sat, Apr 6, 2013 at 10:36 AM, Withers, Robert <robert.with...@dish.com>wrote:
> I am not entirely sure as it has been about a year since I used git.
> Looking in .git\refs\heads\0.8, I have
> afecc9f23108b100b27017974b132331d6bab8e6. .git\HEAD says ref:
> refs/heads/0.8.
>
> If this is not what you need, tell me how I can get you the right info.
>
> Thanks,
> Rob
>
>
> ________________________________________
> From: Jun Rao [jun...@gmail.com]
> Sent: Friday, April 05, 2013 10:10 PM
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailableException: reventing the running of
> kafka-console-producer.bat
>
> The following is the problem. The broker fails to become the leader. Do you
> know the revision of the code you are using so that we know the exact line
> that's causing the problem?
>
> Thanks,
>
> Jun
>
> [2013-04-05 10:21:09,660] ERROR Replica Manager on Broker 0: Error
> processing le
> aderAndISR request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7;
> Clie
> ntId: ; AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo:
> (test,0)
> -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0",
> "leader":"0", "le
> aderEpoch":"0" },1),1); Leaders:
> id:0,host:MERD7-178041.echostar.com<http://merd7-178041.echostar.com/
> >,port:9092
> (
> kafka.server.ReplicaManager)
> java.util.NoSuchElementException: key not found: \tmp\kafka-logs
> at scala.collection.MapLike$class.default(MapLike.scala:223)
> at scala.collection.immutable.Map$Map1.default(Map.scala:93)
> at scala.collection.MapLike$class.apply(MapLike.scala:134)
> at scala.collection.immutable.Map$Map1.apply(Map.scala:93)
> at kafka.cluster.Partition.getOrCreateReplica(Partition.scala:81)
> at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
> at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
>
>
> On Fri, Apr 5, 2013 at 9:35 AM, Withers, Robert <robert.with...@dish.com
> >wrote:
>
> > I deleted all ZK and Kafka data and reran the ZK and one server. I got
> > some log traffic at this point. It looks like the server is elected
> > Leader. The ZK is on port 2181 and the server is on port 9092.
> >
> > [2013-04-05 10:17:35,523] INFO 0 successfully elected as leader
> > (kafka.server.Zo
> > okeeperLeaderElector)
> > [2013-04-05 10:17:35,623] INFO New leader is 0
> > (kafka.server.ZookeeperLeaderElec
> > tor$LeaderChangeListener)
> >
> > In ZK:
> > [2013-04-05 10:17:35,131] INFO Got user-level KeeperException when
> > processing se
> > ssionid:0x13ddafd0fc40000 type:create cxid:0x4 zxid:0xfffffffffffffffe
> > txntype:u
> > nknown reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for
> > /broke
> > rs (org.apache.zookeeper.server.PrepRequestProcessor)
> > [2013-04-05 10:17:35,238] INFO Got user-level KeeperException when
> > processing se
> > ssionid:0x13ddafd0fc40000 type:create cxid:0xa zxid:0xfffffffffffffffe
> > txntype:u
> > nknown reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for
> > /config
> > (org.apache.zookeeper.server.PrepRequestProcessor)
> > [2013-04-05 10:17:35,528] INFO Got user-level KeeperException when
> > processing se
> > ssionid:0x13ddafd0fc40000 type:setData cxid:0x15 zxid:0xfffffffffffffffe
> > txntype
> > :unknown reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode =
> > NoNode
> > for /controller_epoch (org.apache.zookeeper.server.PrepRequestProcessor)
> >
> > In server:
> > [2013-04-05 10:17:34,983] INFO Client
> > environment:java.io.tmpdir=C:\Users\ROBERT
> > ~1.WIT\AppData\Local\Temp\ (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,983] INFO Client environment:java.compiler=<NA>
> > (org.apache
> > .zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,988] INFO Client environment:os.name=Windows 7
> > (org.apache.
> > zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,988] INFO Client environment:os.arch=amd64
> > (org.apache.zook
> > eeper.ZooKeeper)
> > [2013-04-05 10:17:34,989] INFO Client environment:os.version=6.1
> > (org.apache.zoo
> > keeper.ZooKeeper)
> > [2013-04-05 10:17:34,993] INFO Client environment:user.name
> =Robert.Withers
> > (org.
> > apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,994] INFO Client
> > environment:user.home=C:\Users\Robert.With
> > ers (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,994] INFO Client
> > environment:user.dir=C:\Users\Robert.Withe
> > rs\kafka-trunk\bin (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:17:34,999] INFO Initiating client connection,
> > connectString=local
> > host:2181 sessionTimeout=6000
> watcher=org.I0Itec.zkclient.ZkClient@5da33470(org
> > .apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:17:35,012] INFO Opening socket connection to server
> > localhost/127
> > .0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:17:35,014] INFO Socket connection established to
> > localhost/127.0.
> > 0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:17:35,082] INFO Session establishment complete on server
> > localhos
> > t/127.0.0.1:2181, sessionid = 0x13ddafd0fc40000, negotiated timeout =
> > 6000 (org.
> > apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:17:35,085] INFO zookeeper state changed (SyncConnected)
> > (org.I0It
> > ec.zkclient.ZkClient)
> > [2013-04-05 10:17:35,405] INFO Log directory 'C:\tmp\kafka-logs' not
> > found, crea
> > ting it. (kafka.log.LogManager)
> > [2013-04-05 10:17:35,410] INFO Starting log cleanup with a period of
> > 300000 ms.
> > (kafka.log.LogManager)
> > [2013-04-05 10:17:35,413] INFO Starting log flusher with a default period
> > of 300
> > 0 ms. (kafka.log.LogManager)
> > [2013-04-05 10:17:35,429] INFO Awaiting socket connections on
> 0.0.0.0:9092.
> > (kaf
> > ka.network.Acceptor)
> > [2013-04-05 10:17:35,430] INFO [Socket Server on Broker 0], started
> > (kafka.netwo
> > rk.SocketServer)
> > [2013-04-05 10:17:35,477] INFO Will not load MX4J, mx4j-tools.jar is not
> > in the
> > classpath (kafka.utils.Mx4jLoader$)
> > [2013-04-05 10:17:35,523] INFO 0 successfully elected as leader
> > (kafka.server.Zo
> > okeeperLeaderElector)
> > [2013-04-05 10:17:35,623] INFO New leader is 0
> > (kafka.server.ZookeeperLeaderElec
> > tor$LeaderChangeListener)
> > [2013-04-05 10:17:35,654] INFO Registered broker 0 at path /brokers/ids/0
> > with a
> > ddress MERD7-178041.echostar.com:9092. (kafka.utils.ZkUtils$)
> > [2013-04-05 10:17:35,661] INFO [Kafka Server 0], started
> > (kafka.server.KafkaServ
> > er)
> > [2013-04-05 10:17:35,758] INFO No state transitions triggered since no
> > partition
> > s are assigned to brokers 0 (kafka.utils.ZkUtils$)
> >
> >
> >
> >
> >
> > When I ran the console-producer (kafka-console-producer.bat --broker-list
> > localhost:9092 --topic test), and sent "hello world", I got the following
> > logs:
> >
> > In ZK:
> > [2013-04-05 10:21:09,458] INFO Got user-level KeeperException when
> > processing se
> > ssionid:0x13ddafd0fc40000 type:create cxid:0x3e zxid:0xfffffffffffffffe
> > txntype:
> > unknown reqpath:n/a Error Path:/brokers/topics/test/partitions/0
> > Error:KeeperErr
> > orCode = NoNode for /brokers/topics/test/partitions/0
> > (org.apache.zookeeper.serv
> > er.PrepRequestProcessor)
> > [2013-04-05 10:21:09,497] INFO Got user-level KeeperException when
> > processing se
> > ssionid:0x13ddafd0fc40000 type:create cxid:0x3f zxid:0xfffffffffffffffe
> > txntype:
> > unknown reqpath:n/a Error Path:/brokers/topics/test/partitions
> > Error:KeeperError
> > Code = NoNode for /brokers/topics/test/partitions
> > (org.apache.zookeeper.server.P
> > repRequestProcessor)
> >
> >
> > In server:
> > [2013-04-05 10:21:09,431] INFO [KafkaApi-0] Auto creation of topic test
> > with 1 p
> > artitions and replication factor 1 is successful!
> (kafka.server.KafkaApis)
> > [2013-04-05 10:21:09,447] ERROR Error while fetching metadata for
> > partition [tes
> > t,0] (kafka.admin.AdminUtils$)
> > kafka.common.LeaderNotAvailableException: Leader not available for topic
> > test pa
> > rtition 0
> > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:217)
> > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:200)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.
> > scala:61)
> > at scala.collection.immutable.List.foreach(List.scala:45)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> >
> > at scala.collection.immutable.List.map(List.scala:45)
> > at
> > kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFro
> > mZk(AdminUtils.scala:200)
> > at
> > kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:189
> > )
> > at
> > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(Ka
> > fkaApis.scala:452)
> > at
> > kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(Ka
> > fkaApis.scala:438)
> > at scala.collection.immutable.Set$Set1.foreach(Set.scala:81)
> > at
> > kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:437
> > )
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:67)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
> > at java.lang.Thread.run(Thread.java:722)
> > Caused by: kafka.common.LeaderNotAvailableException: No leader exists for
> > partit
> > ion 0
> > at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:214)
> > ... 16 more
> > [2013-04-05 10:21:09,481] INFO Closing socket connection to /127.0.0.1.
> > (kafka.n
> > etwork.Processor)
> > [2013-04-05 10:21:09,622] INFO Replica Manager on Broker 0: Handling
> > leader and
> > isr request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7;
> > ClientId: ;
> > AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo: (test,0)
> > -> Part
> > itionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0", "leader":"0",
> > "leaderEpo
> > ch":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com,port:9092
> > (kafka.s
> > erver.ReplicaManager)
> > [2013-04-05 10:21:09,624] INFO Replica Manager on Broker 0: Becoming
> > Leader for
> > topic [test] partition [0] (kafka.server.ReplicaManager)
> > [2013-04-05 10:21:09,630] INFO [ReplicaFetcherManager on broker 0]
> > removing fetc
> > her on topic test, partition 0 (kafka.server.ReplicaFetcherManager)
> > [2013-04-05 10:21:09,646] INFO Creating or reloading log segment
> > C:\tmp\kafka-lo
> > gs\test-0\00000000000000000000.log (kafka.log.FileMessageSet)
> > [2013-04-05 10:21:09,651] INFO Loaded index file
> > C:\tmp\kafka-logs\test-0\000000
> > 00000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760,
> > entries
> > = 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex)
> > [2013-04-05 10:21:09,658] INFO Created log for topic test partition 0 in
> > C:\tmp\
> > kafka-logs with properties {segment.index.bytes -> 10485760,
> > file.delete.delay.m
> > s -> 60000, segment.bytes -> 536870912, flush.ms -> 1000,
> > delete.retention.ms ->
> > 86400000, index.interval.bytes -> 4096, retention.bytes -> -1,
> > cleanup.policy -
> > > delete, segment.ms -> 604800000, max.message.bytes -> 1000000,
> > flush.messages
> > -> 10000, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000}.
> > (kafka.l
> > og.LogManager)
> > [2013-04-05 10:21:09,660] ERROR Replica Manager on Broker 0: Error
> > processing le
> > aderAndISR request Name: LeaderAndIsrRequest; Version: 0; CorrelationId:
> > 7; Clie
> > ntId: ; AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo:
> > (test,0)
> > -> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0",
> > "leader":"0", "le
> > aderEpoch":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com
> ,port:9092
> > (
> > kafka.server.ReplicaManager)
> > java.util.NoSuchElementException: key not found: \tmp\kafka-logs
> > at scala.collection.MapLike$class.default(MapLike.scala:223)
> > at scala.collection.immutable.Map$Map1.default(Map.scala:93)
> > at scala.collection.MapLike$class.apply(MapLike.scala:134)
> > at scala.collection.immutable.Map$Map1.apply(Map.scala:93)
> > at kafka.cluster.Partition.getOrCreateReplica(Partition.scala:81)
> > at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
> > at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.
> > scala:61)
> > at scala.collection.immutable.List.foreach(List.scala:45)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> >
> > at scala.collection.immutable.List.map(List.scala:45)
> > at kafka.cluster.Partition.makeLeader(Partition.scala:145)
> > at
> > kafka.server.ReplicaManager.kafka$server$ReplicaManager$$makeLeader(R
> > eplicaManager.scala:234)
> > at
> > kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(R
> > eplicaManager.scala:208)
> > at
> > kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(R
> > eplicaManager.scala:200)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > kafka.server.ReplicaManager.becomeLeaderOrFollower(ReplicaManager.sca
> > la:200)
> > at
> > kafka.server.KafkaApis.handleLeaderAndIsrRequest(KafkaApis.scala:85)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:68)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
> > at java.lang.Thread.run(Thread.java:722)
> > [2013-04-05 10:21:09,673] INFO Replica Manager on Broker 0: Completed
> > leader and
> > isr request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7;
> > ClientId:
> > ; AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo: (test,0)
> > -> Par
> > titionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0", "leader":"0",
> > "leaderEp
> > och":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com,port:9092
> > (kafka.
> > server.ReplicaManager)
> > [2013-04-05 10:21:09,685] INFO Closing socket connection to /127.0.0.1.
> > (kafka.n
> > etwork.Processor)
> > [2013-04-05 10:21:09,702] ERROR [KafkaApi-0] Error processing
> > ProducerRequest wi
> > th correlation id 4 from client on test:0 (kafka.server.KafkaApis)
> > kafka.common.LeaderNotAvailableException: Leader not local for topic test
> > partit
> > ion 0 on broker 0
> > at
> > kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.sc
> > ala:177)
> > at
> > kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.sc
> > ala:197)
> > at
> > kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.sc
> > ala:192)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
> > la:80)
> > at
> > scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
> > la:80)
> > at scala.collection.Iterator$class.foreach(Iterator.scala:631)
> > at
> > scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:16
> > 1)
> > at
> > scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala
> > :194)
> > at
> scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
> > at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> >
> > at scala.collection.mutable.HashMap.map(HashMap.scala:39)
> > at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:192)
> > at
> > kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:126)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:64)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
> > at java.lang.Thread.run(Thread.java:722)
> >
> >
> > and finally in the console-producer:
> > hello
> > [2013-04-05 10:21:09,360] INFO Fetching metadata with correlation id 0
> for
> > 1 top
> > ic(s) Set(test) (kafka.client.ClientUtils$)
> > [2013-04-05 10:21:09,364] INFO Connected to localhost:9092 for producing
> > (kafka.
> > producer.SyncProducer)
> > [2013-04-05 10:21:09,480] INFO Disconnecting from localhost:9092
> > (kafka.producer
> > .SyncProducer)
> > [2013-04-05 10:21:09,492] WARN Error while fetching metadata for topic
> > partition
> > [test,0]: [PartitionMetadata(0,None,Vector(),Vector(),5)]
> > (kafka.producer.Broke
> > rPartitionInfo)
> > kafka.common.LeaderNotAvailableException
> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >
> > at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct
> > orAccessorImpl.java:57)
> > at
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC
> > onstructorAccessorImpl.java:45)
> > at
> java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> > at java.lang.Class.newInstance0(Class.java:374)
> > at java.lang.Class.newInstance(Class.java:327)
> > at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:72)
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
> > ly$6$$anonfun$apply$8.apply(BrokerPartitionInfo.scala:87)
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
> > ly$6$$anonfun$apply$8.apply(BrokerPartitionInfo.scala:87)
> > at kafka.utils.Logging$class.warn(Logging.scala:89)
> > at
> > kafka.producer.BrokerPartitionInfo.warn(BrokerPartitionInfo.scala:27)
> >
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
> > ly$6.apply(BrokerPartitionInfo.scala:86)
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
> > ly$6.apply(BrokerPartitionInfo.scala:84)
> > at
> > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.
> > scala:57)
> > at
> > scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1.apply(Broker
> > PartitionInfo.scala:84)
> > at
> > kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1.apply(Broker
> > PartitionInfo.scala:78)
> > at scala.collection.Iterator$class.foreach(Iterator.scala:631)
> > at
> > scala.collection.immutable.VectorIterator.foreach(Vector.scala:605)
> > at
> > scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
> > at scala.collection.immutable.Vector.foreach(Vector.scala:36)
> > at
> > kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.sca
> > la:78)
> > at
> > kafka.producer.async.DefaultEventHandler$$anonfun$handle$1.apply$mcV$
> > sp(DefaultEventHandler.scala:68)
> > at kafka.utils.Utils$.swallow(Utils.scala:165)
> > at kafka.utils.Logging$class.swallowError(Logging.scala:106)
> > at kafka.utils.Utils$.swallowError(Utils.scala:44)
> > at
> > kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.s
> > cala:68)
> > at
> > kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThrea
> > d.scala:104)
> > at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
> > y(ProducerSendThread.scala:87)
> > at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
> > y(ProducerSendThread.scala:67)
> > at scala.collection.immutable.Stream.foreach(Stream.scala:254)
> > at
> > kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThr
> > ead.scala:66)
> > at
> > kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:
> > 44)
> > [2013-04-05 10:21:09,530] WARN Failed to collate messages by
> > topic,partition due
> > to (kafka.producer.async.DefaultEventHandler)
> > kafka.common.LeaderNotAvailableException: No leader for any partition
> > at
> > kafka.producer.async.DefaultEventHandler.kafka$producer$async$Default
> > EventHandler$$getPartition(DefaultEventHandler.scala:212)
> > at
> > kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate
> > $1.apply(DefaultEventHandler.scala:150)
> > at
> > kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate
> > $1.apply(DefaultEventHandler.scala:148)
> > at
> > scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.
> > scala:57)
> > at
> > scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
> > at
> > kafka.producer.async.DefaultEventHandler.partitionAndCollate(DefaultE
> > ventHandler.scala:148)
> > at
> > kafka.producer.async.DefaultEventHandler.dispatchSerializedData(Defau
> > ltEventHandler.scala:94)
> > at
> > kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.s
> > cala:72)
> > at
> > kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThrea
> > d.scala:104)
> > at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
> > y(ProducerSendThread.scala:87)
> > at
> > kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
> > y(ProducerSendThread.scala:67)
> > at scala.collection.immutable.Stream.foreach(Stream.scala:254)
> > at
> > kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThr
> > ead.scala:66)
> > at
> > kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:
> > 44)
> > [2013-04-05 10:21:09,647] INFO Fetching metadata with correlation id 2
> for
> > 1 top
> > ic(s) Set(test) (kafka.client.ClientUtils$)
> > [2013-04-05 10:21:09,648] INFO Connected to localhost:9092 for producing
> > (kafka.
> > producer.SyncProducer)
> > [2013-04-05 10:21:09,684] INFO Disconnecting from localhost:9092
> > (kafka.producer
> > .SyncProducer)
> > [2013-04-05 10:21:09,698] INFO Connected to
> MERD7-178041.echostar.com:9092for p
> > roducing (kafka.producer.SyncProducer)
> >
> >
> >
> > Subsequent sends had no errors in the console-producer log, but there
> > continued to be LeaderNotAvailableExceptions in the server log.
> >
> > [2013-04-05 10:23:56,189] ERROR [KafkaApi-0] Error processing
> > ProducerRequest wi
> > th correlation id 6 from client on test:0 (kafka.server.KafkaApis)
> > kafka.common.LeaderNotAvailableException: Leader not local for topic test
> > partit
> > ion 0 on broker 0
> >
> >
> > When I restart the console-producer, and send more strings, the same
> > occurs, no error in the console-producer log, but
> > LeaderNoAvailableExceptions in the server log.
> >
> >
> > Then, when I start the console-consumer (kafka-console-consumer.bat
> > --zookeeper localhost:2181 --topic test), I get
> > LeaderNotAvailableExceptions in both the server log and the
> > console-consumer log:
> >
> > Server log:
> > [2013-04-05 10:32:08,108] WARN [KafkaApi-0] Error while responding to
> > offset req
> > uest (kafka.server.KafkaApis)
> > kafka.common.LeaderNotAvailableException: Leader not local for topic test
> > partit
> > ion 0 on broker 0
> > at
> > kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.sc
> > ala:177)
> > at kafka.server.KafkaApis$$anonfun$14.apply(KafkaApis.scala:341)
> > at kafka.server.KafkaApis$$anonfun$14.apply(KafkaApis.scala:336)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at
> > scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
> > .scala:206)
> > at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
> > at
> > scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
> >
> > at scala.collection.immutable.Map$Map1.map(Map.scala:93)
> > at
> kafka.server.KafkaApis.handleOffsetRequest(KafkaApis.scala:336)
> > at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
> > at
> > kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
> > at java.lang.Thread.run(Thread.java:722)
> >
> > console-consumer log:
> > [2013-04-05 10:32:07,344] INFO Verifying properties
> > (kafka.utils.VerifiablePrope
> > rties)
> > [2013-04-05 10:32:07,372] INFO Property auto.commit.enable is overridden
> > to true
> > (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,372] INFO Property auto.commit.interval.ms is
> > overridden to
> > 10000 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,372] INFO Property auto.offset.reset is overridden
> to
> > large
> > st (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,373] INFO Property consumer.timeout.ms is
> overridden
> > to -1
> > (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,373] INFO Property fetch.message.max.bytes is
> > overridden to
> > 1048576 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,373] INFO Property fetch.min.bytes is overridden to
> 1
> > (kafk
> > a.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,373] INFO Property fetch.wait.max.ms is overridden
> > to 100 (
> > kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,373] INFO Property group.id is overridden to
> > console-consum
> > er-12815 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,374] INFO Property socket.receive.buffer.bytes is
> > overridde
> > n to 2097152 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,374] INFO Property socket.timeout.ms is overridden
> > to 30000
> > (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,374] INFO Property zk.connect is overridden to
> > localhost:21
> > 81 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,384] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Connecting to zookeeper instance at localhost:2181
> > (kafka.consumer.
> > ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,391] INFO Starting ZkClient event thread.
> > (org.I0Itec.zkcli
> > ent.ZkEventThread)
> > [2013-04-05 10:32:07,396] INFO Client
> > environment:zookeeper.version=3.3.3-120305
> > 4, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,396] INFO Client environment:host.name
> > =MERD7-178041.echosta
> > r.com (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,397] INFO Client environment:java.version=1.7.0_17
> > (org.apa
> > che.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,397] INFO Client environment:java.vendor=Oracle
> > Corporation
> > (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,397] INFO Client
> > environment:java.home=D:\dish\software\Jav
> > a\jdk1.7.0_17\jre (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,397] INFO Client
> > environment:java.class.path=C:\Users\Rober
> >
> >
> t.Withers\.ivy2\cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.0.4.1.
> >
> >
> jar;C:\Users\Robert.Withers\.ivy2\cache/org.scala-lang/scala-library/jars/scala-
> >
> >
> library-2.8.0.jar;C:\Users\Robert.Withers\.ivy2\cache/org.scala-lang/scala-compi
> >
> >
> ler/jars/scala-compiler-2.8.0.jar;C:\Users\Robert.Withers\.ivy2\cache/log4j/log4
> >
> >
> j/jars/log4j-1.2.15.jar;C:\Users\Robert.Withers\.ivy2\cache/org.slf4j/slf4j-api/
> >
> >
> jars/slf4j-api-1.6.4.jar;C:\Users\Robert.Withers\.ivy2\cache/org.apache.zookeepe
> >
> >
> r/zookeeper/jars/zookeeper-3.3.4.jar;C:\Users\Robert.Withers\.ivy2\cache/net.sf.
> >
> >
> jopt-simple/jopt-simple/jars/jopt-simple-3.2.jar;C:\Users\Robert.Withers\kafka-t
> >
> >
> runk\core\target\scala-2.8.0\kafka_2.8.0-0.8-SNAPSHOT.jar;C:\Users\Robert.Wither
> >
> >
> s\kafka-trunk\core\lib\metrics-annotation-3.0.0-c0c8be71.jar;C:\Users\Robert.Wit
> >
> >
> hers\kafka-trunk\core\lib\metrics-core-3.0.0-c0c8be71.jar;C:\Users\Robert.Wither
> >
> >
> s\kafka-trunk\core\lib\zkclient-20120522.jar;C:\Users\Robert.Withers\kafka-trunk
> > \perf\target\kafka-perf_2.8.0-0.8-SNAPSHOT.jar
> > (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,398] INFO Client
> > environment:java.library.path=D:\dish\soft
> >
> >
> ware\Java\jdk1.7.0_17\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows
> > ;C:\Users\Robert.Withers\kafka-trunk\bin\windows;C:\Program Files
> > (x86)\Haskell\
> > bin;D:\dish\software\Haskell
> > Platform\2012.4.0.0\lib\extralibs\bin;D:\dish\softw
> > are\Haskell
> > Platform\2012.4.0.0\bin;C:\Windows\system32;C:\Windows;C:\Windows\Sy
> >
> >
> stem32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\PROGRA~1\CONDUS~1\DIS
> > KEE~1\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program
> > Files (x86
> > )\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program
> > Files (x86
> > )\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL
> > Server\100
> > \Tools\Binn\;C:\Program Files (x86)\Microsoft SQL
> > Server\100\DTS\Binn\;C:\Progra
> > m Files (x86)\Microsoft Visual Studio
> > 9.0\Common7\IDE\PrivateAssemblies\;C:\Prog
> > ram Files\TortoiseSVN\bin;D:\dish\software\Haskell
> > Platform\2012.4.0.0\mingw\bin
> > ;D:\dish\software\Java\jdk1.7.0_17\bin;. (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,407] INFO Client
> > environment:java.io.tmpdir=C:\Users\ROBERT
> > ~1.WIT\AppData\Local\Temp\ (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,408] INFO Client environment:java.compiler=<NA>
> > (org.apache
> > .zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,408] INFO Client environment:os.name=Windows 7
> > (org.apache.
> > zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,412] INFO Client environment:os.arch=amd64
> > (org.apache.zook
> > eeper.ZooKeeper)
> > [2013-04-05 10:32:07,413] INFO Client environment:os.version=6.1
> > (org.apache.zoo
> > keeper.ZooKeeper)
> > [2013-04-05 10:32:07,413] INFO Client environment:user.name
> =Robert.Withers
> > (org.
> > apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,417] INFO Client
> > environment:user.home=C:\Users\Robert.With
> > ers (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,418] INFO Client
> > environment:user.dir=C:\Users\Robert.Withe
> > rs\kafka-trunk\bin (org.apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,418] INFO Initiating client connection,
> > connectString=local
> > host:2181 sessionTimeout=6000
> watcher=org.I0Itec.zkclient.ZkClient@757b7533(org
> > .apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:07,433] INFO Opening socket connection to server
> > localhost/0:0
> > :0:0:0:0:0:1:2181 (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:07,434] INFO Socket connection established to
> > localhost/0:0:0:
> > 0:0:0:0:1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:07,469] INFO Session establishment complete on server
> > localhos
> > t/0:0:0:0:0:0:0:1:2181, sessionid = 0x13ddafd0fc40001, negotiated timeout
> > = 6000
> > (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:07,471] INFO zookeeper state changed (SyncConnected)
> > (org.I0It
> > ec.zkclient.ZkClient)
> > [2013-04-05 10:32:07,490] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba-leader-finder-thread], Starting
> > (kafka.consumer.ConsumerFetcherManag
> > er$$anon$1)
> > [2013-04-05 10:32:07,491] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], starting auto committer every 10000 ms
> > (kafka.consumer.ZookeeperCon
> > sumerConnector)
> > SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
> > SLF4J: Defaulting to no-operation (NOP) logger implementation
> > SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for
> further
> > detail
> > s.
> > [2013-04-05 10:32:07,535] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], begin registering consumer
> > console-consumer-12815_MERD7-178041-1365
> > 179527383-1da2aeba in ZK (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,677] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], end registering consumer
> > console-consumer-12815_MERD7-178041-136517
> > 9527383-1da2aeba in ZK (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,682] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], starting watcher executor thread for consumer
> > console-consumer-1281
> > 5_MERD7-178041-1365179527383-1da2aeba
> > (kafka.consumer.ZookeeperConsumerConnector
> > )
> > [2013-04-05 10:32:07,722] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], begin rebalancing consumer
> > console-consumer-12815_MERD7-178041-1365
> > 179527383-1da2aeba try #0 (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,837] INFO Verifying properties
> > (kafka.utils.VerifiablePrope
> > rties)
> > [2013-04-05 10:32:07,838] INFO Property broker.list is overridden to
> > MERD7-17804
> > 1.echostar.com:9092 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,838] INFO Property client.id is overridden to
> > console-consu
> > mer-12815 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,838] INFO Property request.timeout.ms is overridden
> > to 3000
> > 0 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:07,857] INFO Fetching metadata with correlation id 0
> for
> > 1 top
> > ic(s) Set(test) (kafka.client.ClientUtils$)
> > [2013-04-05 10:32:07,858] INFO Connected to
> MERD7-178041.echostar.com:9092for p
> > roducing (kafka.producer.SyncProducer)
> > [2013-04-05 10:32:07,895] INFO Disconnecting from
> > MERD7-178041.echostar.com:9092
> > (kafka.producer.SyncProducer)
> > [2013-04-05 10:32:07,901] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Cleared all relevant queues for this fetcher
> > (kafka.consumer.Zookee
> > perConsumerConnector)
> > [2013-04-05 10:32:07,902] INFO Clearing the current data chunk for this
> > consumer
> > iterator (kafka.consumer.ConsumerIterator)
> > [2013-04-05 10:32:07,902] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Cleared the data chunks in all the consumer message
> iterators
> > (kafk
> > a.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,903] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Committing all offsets after clearing the fetcher queues
> > (kafka.con
> > sumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,903] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Releasing partition ownership
> > (kafka.consumer.ZookeeperConsumerConn
> > ector)
> > [2013-04-05 10:32:07,905] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Consumer
> > console-consumer-12815_MERD7-178041-1365179527383-1da2aeba
> > rebalancing the following partitions: ArrayBuffer(0) for topic test with
> > consum
> > ers: List(console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0)
> > (kafka.c
> > onsumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:07,906] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0
> > attemp
> > ting to claim partition 0 (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:08,044] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0
> > succes
> > sfully owned partition 0 for topic test
> > (kafka.consumer.ZookeeperConsumerConnect
> > or)
> > [2013-04-05 10:32:08,045] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Updating the cache
> (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:08,050] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Consumer
> > console-consumer-12815_MERD7-178041-1365179527383-1da2aeba
> > selected partitions : test:0: fetched offset = -1: consumed offset = -1
> > (kafka.
> > consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:08,054] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], end rebalancing consumer
> > console-consumer-12815_MERD7-178041-136517
> > 9527383-1da2aeba try #0 (kafka.consumer.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:08,058] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], Not creating event watcher for trivial whitelist test
> > (kafka.consum
> > er.ZookeeperConsumerConnector)
> > [2013-04-05 10:32:08,072] INFO Verifying properties
> > (kafka.utils.VerifiablePrope
> > rties)
> > [2013-04-05 10:32:08,073] INFO Property broker.list is overridden to
> > MERD7-17804
> > 1.echostar.com:9092 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:08,073] INFO Property client.id is overridden to
> > console-consu
> > mer-12815 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:08,073] INFO Property request.timeout.ms is overridden
> > to 3000
> > 0 (kafka.utils.VerifiableProperties)
> > [2013-04-05 10:32:08,074] INFO Fetching metadata with correlation id 0
> for
> > 1 top
> > ic(s) Set(test) (kafka.client.ClientUtils$)
> > [2013-04-05 10:32:08,074] INFO Connected to
> MERD7-178041.echostar.com:9092for p
> > roducing (kafka.producer.SyncProducer)
> > [2013-04-05 10:32:08,092] INFO Disconnecting from
> > MERD7-178041.echostar.com:9092
> > (kafka.producer.SyncProducer)
> > [2013-04-05 10:32:08,102] INFO
> > [ConsumerFetcherThread-console-consumer-12815_MER
> > D7-178041-1365179527383-1da2aeba-0-0], Starting
> > (kafka.consumer.ConsumerFetcher
> > Thread)
> > [2013-04-05 10:32:08,123] WARN
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba-leader-finder-thread], Failed to add fetcher for [test,0] to
> > broker i
> > d:0,host:MERD7-178041.echostar.com,port:9092
> > (kafka.consumer.ConsumerFetcherMana
> > ger$$anon$1)
> > kafka.common.LeaderNotAvailableException
> > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> > Method)
> >
> > at
> > sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct
> > orAccessorImpl.java:57)
> > at
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC
> > onstructorAccessorImpl.java:45)
> > at
> java.lang.reflect.Constructor.newInstance(Constructor.java:525)
> > at java.lang.Class.newInstance0(Class.java:374)
> > at java.lang.Class.newInstance(Class.java:327)
> > at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:72)
> > at
> > kafka.consumer.ConsumerFetcherThread.handleOffsetOutOfRange(ConsumerF
> > etcherThread.scala:65)
> > at
> > kafka.server.AbstractFetcherThread.addPartition(AbstractFetcherThread
> > .scala:166)
> > at
> > kafka.server.AbstractFetcherManager.addFetcher(AbstractFetcherManager
> > .scala:48)
> > at
> > kafka.consumer.ConsumerFetcherManager$$anon$1$$anonfun$doWork$3.apply
> > (ConsumerFetcherManager.scala:79)
> > at
> > kafka.consumer.ConsumerFetcherManager$$anon$1$$anonfun$doWork$3.apply
> > (ConsumerFetcherManager.scala:75)
> > at
> > scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
> > la:80)
> > at
> > scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
> > la:80)
> > at scala.collection.Iterator$class.foreach(Iterator.scala:631)
> > at
> > scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:16
> > 1)
> > at
> > scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala
> > :194)
> > at
> scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
> > at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
> > at
> > kafka.consumer.ConsumerFetcherManager$$anon$1.doWork(ConsumerFetcherM
> > anager.scala:75)
> > at
> kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:51)
> > [2013-04-05 10:32:08,137] INFO
> > [ConsumerFetcherThread-console-consumer-12815_MER
> > D7-178041-1365179527383-1da2aeba-0-0], Shutting down
> > (kafka.consumer.ConsumerFet
> > cherThread)
> > [2013-04-05 10:32:08,137] INFO
> > [ConsumerFetcherThread-console-consumer-12815_MER
> > D7-178041-1365179527383-1da2aeba-0-0], Stopped
> > (kafka.consumer.ConsumerFetcherT
> > hread)
> > [2013-04-05 10:32:08,137] INFO
> > [ConsumerFetcherThread-console-consumer-12815_MER
> > D7-178041-1365179527383-1da2aeba-0-0], Shutdown completed
> > (kafka.consumer.Consum
> > erFetcherThread)
> > [2013-04-05 10:32:08,153] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], ZKConsumerConnector shutting down
> > (kafka.consumer.ZookeeperConsumer
> > Connector)
> > [2013-04-05 10:32:08,154] INFO [ConsumerFetcherManager-1365179527478]
> > shutting d
> > own (kafka.consumer.ConsumerFetcherManager)
> > [2013-04-05 10:32:08,154] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba-leader-finder-thread], Shutting down
> > (kafka.consumer.ConsumerFetcherM
> > anager$$anon$1)
> > [2013-04-05 10:32:08,154] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba-leader-finder-thread], Stopped
> > (kafka.consumer.ConsumerFetcherManage
> > r$$anon$1)
> > [2013-04-05 10:32:08,154] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba-leader-finder-thread], Shutdown completed
> > (kafka.consumer.ConsumerFet
> > cherManager$$anon$1)
> > [2013-04-05 10:32:08,158] INFO [ConsumerFetcherManager-1365179527478]
> > shutdown c
> > ompleted (kafka.consumer.ConsumerFetcherManager)
> > Consumed 0 messages
> > [2013-04-05 10:32:08,294] INFO Terminate ZkClient event thread.
> > (org.I0Itec.zkcl
> > ient.ZkEventThread)
> > [2013-04-05 10:32:08,319] INFO Session: 0x13ddafd0fc40001 closed
> > (org.apache.zoo
> > keeper.ZooKeeper)
> > [2013-04-05 10:32:08,320] INFO EventThread shut down
> > (org.apache.zookeeper.Clien
> > tCnxn)
> > [2013-04-05 10:32:08,320] INFO
> > [console-consumer-12815_MERD7-178041-136517952738
> > 3-1da2aeba], ZKConsumerConnector shut down completed
> > (kafka.consumer.ZookeeperCo
> > nsumerConnector)
> > [2013-04-05 10:32:08,321] INFO Initiating client connection,
> > connectString=local
> > host:2181 sessionTimeout=30000
> watcher=org.I0Itec.zkclient.ZkClient@3639d41(org
> > .apache.zookeeper.ZooKeeper)
> > [2013-04-05 10:32:08,321] INFO Starting ZkClient event thread.
> > (org.I0Itec.zkcli
> > ent.ZkEventThread)
> > [2013-04-05 10:32:08,324] INFO Opening socket connection to server
> > localhost/127
> > .0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:08,325] INFO Socket connection established to
> > localhost/127.0.
> > 0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:08,351] INFO Session establishment complete on server
> > localhos
> > t/127.0.0.1:2181, sessionid = 0x13ddafd0fc40002, negotiated timeout =
> > 30000 (org
> > .apache.zookeeper.ClientCnxn)
> > [2013-04-05 10:32:08,352] INFO zookeeper state changed (SyncConnected)
> > (org.I0It
> > ec.zkclient.ZkClient)
> > [2013-04-05 10:32:08,543] INFO Terminate ZkClient event thread.
> > (org.I0Itec.zkcl
> > ient.ZkEventThread)
> > [2013-04-05 10:32:08,568] INFO Session: 0x13ddafd0fc40002 closed
> > (org.apache.zoo
> > keeper.ZooKeeper)
> > [2013-04-05 10:32:08,568] INFO EventThread shut down
> > (org.apache.zookeeper.Clien
> > tCnxn)
> >
> >
> >
> > Thanks,
> > Rob
> >
> >
> > -----Original Message-----
> > From: Jun Rao [mailto:jun...@gmail.com]
> > Sent: Friday, April 05, 2013 10:02 AM
> > To: users@kafka.apache.org
> > Subject: Re: LeaderNotAvailableException: reventing the running of
> > kafka-console-producer.bat
> >
> > If this happens on every message, it indicates a problem. Could you wipe
> > out all ZK and Kafka data and try it again? If it still doesn't work,
> could
> > you try the latest revision in the 0.8 branch?
> >
> > Thanks,
> >
> > Jun
> >
> >
> > On Fri, Apr 5, 2013 at 8:50 AM, Withers, Robert <robert.with...@dish.com
> > >wrote:
> >
> > > Yes, it happens on every message. I ran the zookeeper, server,
> > > console-producer against --broker-list localhost:9092 --topic test,
> > > then shut everything down and restarted the zookeeper and server and
> > > ran the console-consumer --zookeeper localhost:2181 --topic test and
> > > both the server console and consumer console reported WARNs of
> > > LeaderNotAvailableException.
> > >
> > > Since they were WARNs, would that mean that a message got produced and
> > > then consumed?
> > >
> > > Thanks,
> > > Rob
> > >
> > >
> > >
> > > -----Original Message-----
> > > From: Jun Rao [mailto:jun...@gmail.com]
> > > Sent: Thursday, April 04, 2013 10:03 PM
> > > To: users@kafka.apache.org
> > > Subject: Re: LeaderNotAvailableException: reventing the running of
> > > kafka-console-producer.bat
> > >
> > > This can happen on the first message in a new topic. Do you see the
> > > exception on posting every message? Also, run kafka-console-consumer
> > > to see if you can see the message.
> > >
> > > Thanks,
> > >
> > > Jun
> > >
> > >
> > > On Thu, Apr 4, 2013 at 1:37 PM, Withers, Robert
> > > <robert.with...@dish.com
> > > >wrote:
> > >
> > > > I am brand new to exploration into kafka, for work. Any help is
> > > > much appreciated.
> > > >
> > > > A co-worker built and updated a package for us to use on windows. I
> > > > have no idea what version it is. We cannot update through our
> > > > firewall. :(
> > > I
> > > > am able to start the zookeeper and a kafka server, but when I run
> > > > the kafka-console-producer.bat file and enter a "hello world" input
> > > > to post to the broker, the broker throws the
> > LeaderNotAvailableException.
> > > >
> > > > Thanks for any assistance.
> > > > Rob
> > > >
> > > >
> > >
> >
>
