I deleted all ZK and Kafka data and reran the ZK and one server. I got some
log traffic at this point. It looks like the server is elected Leader. The ZK
is on port 2181 and the server is on port 9092.
[2013-04-05 10:17:35,523] INFO 0 successfully elected as leader (kafka.server.Zo
okeeperLeaderElector)
[2013-04-05 10:17:35,623] INFO New leader is 0 (kafka.server.ZookeeperLeaderElec
tor$LeaderChangeListener)
In ZK:
[2013-04-05 10:17:35,131] INFO Got user-level KeeperException when processing se
ssionid:0x13ddafd0fc40000 type:create cxid:0x4 zxid:0xfffffffffffffffe txntype:u
nknown reqpath:n/a Error Path:/brokers Error:KeeperErrorCode = NoNode for /broke
rs (org.apache.zookeeper.server.PrepRequestProcessor)
[2013-04-05 10:17:35,238] INFO Got user-level KeeperException when processing se
ssionid:0x13ddafd0fc40000 type:create cxid:0xa zxid:0xfffffffffffffffe txntype:u
nknown reqpath:n/a Error Path:/config Error:KeeperErrorCode = NoNode for /config
(org.apache.zookeeper.server.PrepRequestProcessor)
[2013-04-05 10:17:35,528] INFO Got user-level KeeperException when processing se
ssionid:0x13ddafd0fc40000 type:setData cxid:0x15 zxid:0xfffffffffffffffe txntype
:unknown reqpath:n/a Error Path:/controller_epoch Error:KeeperErrorCode = NoNode
for /controller_epoch (org.apache.zookeeper.server.PrepRequestProcessor)
In server:
[2013-04-05 10:17:34,983] INFO Client environment:java.io.tmpdir=C:\Users\ROBERT
~1.WIT\AppData\Local\Temp\ (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:17:34,983] INFO Client environment:java.compiler=<NA> (org.apache
.zookeeper.ZooKeeper)
[2013-04-05 10:17:34,988] INFO Client environment:os.name=Windows 7 (org.apache.
zookeeper.ZooKeeper)
[2013-04-05 10:17:34,988] INFO Client environment:os.arch=amd64 (org.apache.zook
eeper.ZooKeeper)
[2013-04-05 10:17:34,989] INFO Client environment:os.version=6.1 (org.apache.zoo
keeper.ZooKeeper)
[2013-04-05 10:17:34,993] INFO Client environment:user.name=Robert.Withers (org.
apache.zookeeper.ZooKeeper)
[2013-04-05 10:17:34,994] INFO Client environment:user.home=C:\Users\Robert.With
ers (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:17:34,994] INFO Client environment:user.dir=C:\Users\Robert.Withe
rs\kafka-trunk\bin (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:17:34,999] INFO Initiating client connection, connectString=local
host:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@5da33470 (org
.apache.zookeeper.ZooKeeper)
[2013-04-05 10:17:35,012] INFO Opening socket connection to server localhost/127
.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:17:35,014] INFO Socket connection established to localhost/127.0.
0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:17:35,082] INFO Session establishment complete on server localhos
t/127.0.0.1:2181, sessionid = 0x13ddafd0fc40000, negotiated timeout = 6000 (org.
apache.zookeeper.ClientCnxn)
[2013-04-05 10:17:35,085] INFO zookeeper state changed (SyncConnected) (org.I0It
ec.zkclient.ZkClient)
[2013-04-05 10:17:35,405] INFO Log directory 'C:\tmp\kafka-logs' not found, crea
ting it. (kafka.log.LogManager)
[2013-04-05 10:17:35,410] INFO Starting log cleanup with a period of 300000 ms.
(kafka.log.LogManager)
[2013-04-05 10:17:35,413] INFO Starting log flusher with a default period of 300
0 ms. (kafka.log.LogManager)
[2013-04-05 10:17:35,429] INFO Awaiting socket connections on 0.0.0.0:9092. (kaf
ka.network.Acceptor)
[2013-04-05 10:17:35,430] INFO [Socket Server on Broker 0], started (kafka.netwo
rk.SocketServer)
[2013-04-05 10:17:35,477] INFO Will not load MX4J, mx4j-tools.jar is not in the
classpath (kafka.utils.Mx4jLoader$)
[2013-04-05 10:17:35,523] INFO 0 successfully elected as leader (kafka.server.Zo
okeeperLeaderElector)
[2013-04-05 10:17:35,623] INFO New leader is 0 (kafka.server.ZookeeperLeaderElec
tor$LeaderChangeListener)
[2013-04-05 10:17:35,654] INFO Registered broker 0 at path /brokers/ids/0 with a
ddress MERD7-178041.echostar.com:9092. (kafka.utils.ZkUtils$)
[2013-04-05 10:17:35,661] INFO [Kafka Server 0], started (kafka.server.KafkaServ
er)
[2013-04-05 10:17:35,758] INFO No state transitions triggered since no partition
s are assigned to brokers 0 (kafka.utils.ZkUtils$)
When I ran the console-producer (kafka-console-producer.bat --broker-list
localhost:9092 --topic test), and sent "hello world", I got the following logs:
In ZK:
[2013-04-05 10:21:09,458] INFO Got user-level KeeperException when processing se
ssionid:0x13ddafd0fc40000 type:create cxid:0x3e zxid:0xfffffffffffffffe txntype:
unknown reqpath:n/a Error Path:/brokers/topics/test/partitions/0 Error:KeeperErr
orCode = NoNode for /brokers/topics/test/partitions/0 (org.apache.zookeeper.serv
er.PrepRequestProcessor)
[2013-04-05 10:21:09,497] INFO Got user-level KeeperException when processing se
ssionid:0x13ddafd0fc40000 type:create cxid:0x3f zxid:0xfffffffffffffffe txntype:
unknown reqpath:n/a Error Path:/brokers/topics/test/partitions Error:KeeperError
Code = NoNode for /brokers/topics/test/partitions (org.apache.zookeeper.server.P
repRequestProcessor)
In server:
[2013-04-05 10:21:09,431] INFO [KafkaApi-0] Auto creation of topic test with 1 p
artitions and replication factor 1 is successful! (kafka.server.KafkaApis)
[2013-04-05 10:21:09,447] ERROR Error while fetching metadata for partition [tes
t,0] (kafka.admin.AdminUtils$)
kafka.common.LeaderNotAvailableException: Leader not available for topic test pa
rtition 0
at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:217)
at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:200)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.
scala:61)
at scala.collection.immutable.List.foreach(List.scala:45)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.List.map(List.scala:45)
at kafka.admin.AdminUtils$.kafka$admin$AdminUtils$$fetchTopicMetadataFro
mZk(AdminUtils.scala:200)
at kafka.admin.AdminUtils$.fetchTopicMetadataFromZk(AdminUtils.scala:189
)
at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(Ka
fkaApis.scala:452)
at kafka.server.KafkaApis$$anonfun$handleTopicMetadataRequest$1.apply(Ka
fkaApis.scala:438)
at scala.collection.immutable.Set$Set1.foreach(Set.scala:81)
at kafka.server.KafkaApis.handleTopicMetadataRequest(KafkaApis.scala:437
)
at kafka.server.KafkaApis.handle(KafkaApis.scala:67)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
at java.lang.Thread.run(Thread.java:722)
Caused by: kafka.common.LeaderNotAvailableException: No leader exists for partit
ion 0
at kafka.admin.AdminUtils$$anonfun$3.apply(AdminUtils.scala:214)
... 16 more
[2013-04-05 10:21:09,481] INFO Closing socket connection to /127.0.0.1. (kafka.n
etwork.Processor)
[2013-04-05 10:21:09,622] INFO Replica Manager on Broker 0: Handling leader and
isr request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7; ClientId: ;
AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo: (test,0) -> Part
itionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0", "leader":"0", "leaderEpo
ch":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com,port:9092 (kafka.s
erver.ReplicaManager)
[2013-04-05 10:21:09,624] INFO Replica Manager on Broker 0: Becoming Leader for
topic [test] partition [0] (kafka.server.ReplicaManager)
[2013-04-05 10:21:09,630] INFO [ReplicaFetcherManager on broker 0] removing fetc
her on topic test, partition 0 (kafka.server.ReplicaFetcherManager)
[2013-04-05 10:21:09,646] INFO Creating or reloading log segment C:\tmp\kafka-lo
gs\test-0\00000000000000000000.log (kafka.log.FileMessageSet)
[2013-04-05 10:21:09,651] INFO Loaded index file C:\tmp\kafka-logs\test-0\000000
00000000000000.index with maxEntries = 1310720, maxIndexSize = 10485760, entries
= 0, lastOffset = 0, file position = 0 (kafka.log.OffsetIndex)
[2013-04-05 10:21:09,658] INFO Created log for topic test partition 0 in C:\tmp\
kafka-logs with properties {segment.index.bytes -> 10485760, file.delete.delay.m
s -> 60000, segment.bytes -> 536870912, flush.ms -> 1000, delete.retention.ms ->
86400000, index.interval.bytes -> 4096, retention.bytes -> -1, cleanup.policy -
> delete, segment.ms -> 604800000, max.message.bytes -> 1000000, flush.messages
-> 10000, min.cleanable.dirty.ratio -> 0.5, retention.ms -> 604800000}. (kafka.l
og.LogManager)
[2013-04-05 10:21:09,660] ERROR Replica Manager on Broker 0: Error processing le
aderAndISR request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7; Clie
ntId: ; AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo: (test,0)
-> PartitionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0", "leader":"0", "le
aderEpoch":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com,port:9092 (
kafka.server.ReplicaManager)
java.util.NoSuchElementException: key not found: \tmp\kafka-logs
at scala.collection.MapLike$class.default(MapLike.scala:223)
at scala.collection.immutable.Map$Map1.default(Map.scala:93)
at scala.collection.MapLike$class.apply(MapLike.scala:134)
at scala.collection.immutable.Map$Map1.apply(Map.scala:93)
at kafka.cluster.Partition.getOrCreateReplica(Partition.scala:81)
at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
at kafka.cluster.Partition$$anonfun$2.apply(Partition.scala:145)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.LinearSeqOptimized$class.foreach(LinearSeqOptimized.
scala:61)
at scala.collection.immutable.List.foreach(List.scala:45)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.List.map(List.scala:45)
at kafka.cluster.Partition.makeLeader(Partition.scala:145)
at kafka.server.ReplicaManager.kafka$server$ReplicaManager$$makeLeader(R
eplicaManager.scala:234)
at kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(R
eplicaManager.scala:208)
at kafka.server.ReplicaManager$$anonfun$becomeLeaderOrFollower$3.apply(R
eplicaManager.scala:200)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at kafka.server.ReplicaManager.becomeLeaderOrFollower(ReplicaManager.sca
la:200)
at kafka.server.KafkaApis.handleLeaderAndIsrRequest(KafkaApis.scala:85)
at kafka.server.KafkaApis.handle(KafkaApis.scala:68)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
at java.lang.Thread.run(Thread.java:722)
[2013-04-05 10:21:09,673] INFO Replica Manager on Broker 0: Completed leader and
isr request Name: LeaderAndIsrRequest; Version: 0; CorrelationId: 7; ClientId:
; AckTimeoutMs: 1000 ms; ControllerEpoch: 1; PartitionStateInfo: (test,0) -> Par
titionStateInfo(LeaderIsrAndControllerEpoch({ "ISR":"0", "leader":"0", "leaderEp
och":"0" },1),1); Leaders: id:0,host:MERD7-178041.echostar.com,port:9092 (kafka.
server.ReplicaManager)
[2013-04-05 10:21:09,685] INFO Closing socket connection to /127.0.0.1. (kafka.n
etwork.Processor)
[2013-04-05 10:21:09,702] ERROR [KafkaApi-0] Error processing ProducerRequest wi
th correlation id 4 from client on test:0 (kafka.server.KafkaApis)
kafka.common.LeaderNotAvailableException: Leader not local for topic test partit
ion 0 on broker 0
at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.sc
ala:177)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.sc
ala:197)
at kafka.server.KafkaApis$$anonfun$appendToLocalLog$2.apply(KafkaApis.sc
ala:192)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
la:80)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
la:80)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:16
1)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala
:194)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.mutable.HashMap.map(HashMap.scala:39)
at kafka.server.KafkaApis.appendToLocalLog(KafkaApis.scala:192)
at kafka.server.KafkaApis.handleProducerRequest(KafkaApis.scala:126)
at kafka.server.KafkaApis.handle(KafkaApis.scala:64)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
at java.lang.Thread.run(Thread.java:722)
and finally in the console-producer:
hello
[2013-04-05 10:21:09,360] INFO Fetching metadata with correlation id 0 for 1 top
ic(s) Set(test) (kafka.client.ClientUtils$)
[2013-04-05 10:21:09,364] INFO Connected to localhost:9092 for producing (kafka.
producer.SyncProducer)
[2013-04-05 10:21:09,480] INFO Disconnecting from localhost:9092 (kafka.producer
.SyncProducer)
[2013-04-05 10:21:09,492] WARN Error while fetching metadata for topic partition
[test,0]: [PartitionMetadata(0,None,Vector(),Vector(),5)] (kafka.producer.Broke
rPartitionInfo)
kafka.common.LeaderNotAvailableException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct
orAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC
onstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
at java.lang.Class.newInstance0(Class.java:374)
at java.lang.Class.newInstance(Class.java:327)
at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:72)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
ly$6$$anonfun$apply$8.apply(BrokerPartitionInfo.scala:87)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
ly$6$$anonfun$apply$8.apply(BrokerPartitionInfo.scala:87)
at kafka.utils.Logging$class.warn(Logging.scala:89)
at kafka.producer.BrokerPartitionInfo.warn(BrokerPartitionInfo.scala:27)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
ly$6.apply(BrokerPartitionInfo.scala:86)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1$$anonfun$app
ly$6.apply(BrokerPartitionInfo.scala:84)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.
scala:57)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1.apply(Broker
PartitionInfo.scala:84)
at kafka.producer.BrokerPartitionInfo$$anonfun$updateInfo$1.apply(Broker
PartitionInfo.scala:78)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at scala.collection.immutable.VectorIterator.foreach(Vector.scala:605)
at scala.collection.IterableLike$class.foreach(IterableLike.scala:79)
at scala.collection.immutable.Vector.foreach(Vector.scala:36)
at kafka.producer.BrokerPartitionInfo.updateInfo(BrokerPartitionInfo.sca
la:78)
at kafka.producer.async.DefaultEventHandler$$anonfun$handle$1.apply$mcV$
sp(DefaultEventHandler.scala:68)
at kafka.utils.Utils$.swallow(Utils.scala:165)
at kafka.utils.Logging$class.swallowError(Logging.scala:106)
at kafka.utils.Utils$.swallowError(Utils.scala:44)
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.s
cala:68)
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThrea
d.scala:104)
at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
y(ProducerSendThread.scala:87)
at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
y(ProducerSendThread.scala:67)
at scala.collection.immutable.Stream.foreach(Stream.scala:254)
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThr
ead.scala:66)
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:
44)
[2013-04-05 10:21:09,530] WARN Failed to collate messages by topic,partition due
to (kafka.producer.async.DefaultEventHandler)
kafka.common.LeaderNotAvailableException: No leader for any partition
at kafka.producer.async.DefaultEventHandler.kafka$producer$async$Default
EventHandler$$getPartition(DefaultEventHandler.scala:212)
at kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate
$1.apply(DefaultEventHandler.scala:150)
at kafka.producer.async.DefaultEventHandler$$anonfun$partitionAndCollate
$1.apply(DefaultEventHandler.scala:148)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.
scala:57)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:43)
at kafka.producer.async.DefaultEventHandler.partitionAndCollate(DefaultE
ventHandler.scala:148)
at kafka.producer.async.DefaultEventHandler.dispatchSerializedData(Defau
ltEventHandler.scala:94)
at kafka.producer.async.DefaultEventHandler.handle(DefaultEventHandler.s
cala:72)
at kafka.producer.async.ProducerSendThread.tryToHandle(ProducerSendThrea
d.scala:104)
at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
y(ProducerSendThread.scala:87)
at kafka.producer.async.ProducerSendThread$$anonfun$processEvents$3.appl
y(ProducerSendThread.scala:67)
at scala.collection.immutable.Stream.foreach(Stream.scala:254)
at kafka.producer.async.ProducerSendThread.processEvents(ProducerSendThr
ead.scala:66)
at kafka.producer.async.ProducerSendThread.run(ProducerSendThread.scala:
44)
[2013-04-05 10:21:09,647] INFO Fetching metadata with correlation id 2 for 1 top
ic(s) Set(test) (kafka.client.ClientUtils$)
[2013-04-05 10:21:09,648] INFO Connected to localhost:9092 for producing (kafka.
producer.SyncProducer)
[2013-04-05 10:21:09,684] INFO Disconnecting from localhost:9092 (kafka.producer
.SyncProducer)
[2013-04-05 10:21:09,698] INFO Connected to MERD7-178041.echostar.com:9092 for p
roducing (kafka.producer.SyncProducer)
Subsequent sends had no errors in the console-producer log, but there continued
to be LeaderNotAvailableExceptions in the server log.
[2013-04-05 10:23:56,189] ERROR [KafkaApi-0] Error processing ProducerRequest wi
th correlation id 6 from client on test:0 (kafka.server.KafkaApis)
kafka.common.LeaderNotAvailableException: Leader not local for topic test partit
ion 0 on broker 0
When I restart the console-producer, and send more strings, the same occurs, no
error in the console-producer log, but LeaderNoAvailableExceptions in the
server log.
Then, when I start the console-consumer (kafka-console-consumer.bat --zookeeper
localhost:2181 --topic test), I get LeaderNotAvailableExceptions in both the
server log and the console-consumer log:
Server log:
[2013-04-05 10:32:08,108] WARN [KafkaApi-0] Error while responding to offset req
uest (kafka.server.KafkaApis)
kafka.common.LeaderNotAvailableException: Leader not local for topic test partit
ion 0 on broker 0
at kafka.server.ReplicaManager.getLeaderReplicaIfLocal(ReplicaManager.sc
ala:177)
at kafka.server.KafkaApis$$anonfun$14.apply(KafkaApis.scala:341)
at kafka.server.KafkaApis$$anonfun$14.apply(KafkaApis.scala:336)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike
.scala:206)
at scala.collection.immutable.Map$Map1.foreach(Map.scala:105)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:206)
at scala.collection.immutable.Map$Map1.map(Map.scala:93)
at kafka.server.KafkaApis.handleOffsetRequest(KafkaApis.scala:336)
at kafka.server.KafkaApis.handle(KafkaApis.scala:66)
at kafka.server.KafkaRequestHandler.run(KafkaRequestHandler.scala:41)
at java.lang.Thread.run(Thread.java:722)
console-consumer log:
[2013-04-05 10:32:07,344] INFO Verifying properties (kafka.utils.VerifiablePrope
rties)
[2013-04-05 10:32:07,372] INFO Property auto.commit.enable is overridden to true
(kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,372] INFO Property auto.commit.interval.ms is overridden to
10000 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,372] INFO Property auto.offset.reset is overridden to large
st (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,373] INFO Property consumer.timeout.ms is overridden to -1
(kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,373] INFO Property fetch.message.max.bytes is overridden to
1048576 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,373] INFO Property fetch.min.bytes is overridden to 1 (kafk
a.utils.VerifiableProperties)
[2013-04-05 10:32:07,373] INFO Property fetch.wait.max.ms is overridden to 100 (
kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,373] INFO Property group.id is overridden to console-consum
er-12815 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,374] INFO Property socket.receive.buffer.bytes is overridde
n to 2097152 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,374] INFO Property socket.timeout.ms is overridden to 30000
(kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,374] INFO Property zk.connect is overridden to localhost:21
81 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,384] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Connecting to zookeeper instance at localhost:2181 (kafka.consumer.
ZookeeperConsumerConnector)
[2013-04-05 10:32:07,391] INFO Starting ZkClient event thread. (org.I0Itec.zkcli
ent.ZkEventThread)
[2013-04-05 10:32:07,396] INFO Client environment:zookeeper.version=3.3.3-120305
4, built on 11/17/2011 05:47 GMT (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,396] INFO Client environment:host.name=MERD7-178041.echosta
r.com (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,397] INFO Client environment:java.version=1.7.0_17 (org.apa
che.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,397] INFO Client environment:java.vendor=Oracle Corporation
(org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,397] INFO Client environment:java.home=D:\dish\software\Jav
a\jdk1.7.0_17\jre (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,397] INFO Client environment:java.class.path=C:\Users\Rober
t.Withers\.ivy2\cache/org.xerial.snappy/snappy-java/bundles/snappy-java-1.0.4.1.
jar;C:\Users\Robert.Withers\.ivy2\cache/org.scala-lang/scala-library/jars/scala-
library-2.8.0.jar;C:\Users\Robert.Withers\.ivy2\cache/org.scala-lang/scala-compi
ler/jars/scala-compiler-2.8.0.jar;C:\Users\Robert.Withers\.ivy2\cache/log4j/log4
j/jars/log4j-1.2.15.jar;C:\Users\Robert.Withers\.ivy2\cache/org.slf4j/slf4j-api/
jars/slf4j-api-1.6.4.jar;C:\Users\Robert.Withers\.ivy2\cache/org.apache.zookeepe
r/zookeeper/jars/zookeeper-3.3.4.jar;C:\Users\Robert.Withers\.ivy2\cache/net.sf.
jopt-simple/jopt-simple/jars/jopt-simple-3.2.jar;C:\Users\Robert.Withers\kafka-t
runk\core\target\scala-2.8.0\kafka_2.8.0-0.8-SNAPSHOT.jar;C:\Users\Robert.Wither
s\kafka-trunk\core\lib\metrics-annotation-3.0.0-c0c8be71.jar;C:\Users\Robert.Wit
hers\kafka-trunk\core\lib\metrics-core-3.0.0-c0c8be71.jar;C:\Users\Robert.Wither
s\kafka-trunk\core\lib\zkclient-20120522.jar;C:\Users\Robert.Withers\kafka-trunk
\perf\target\kafka-perf_2.8.0-0.8-SNAPSHOT.jar (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,398] INFO Client environment:java.library.path=D:\dish\soft
ware\Java\jdk1.7.0_17\bin;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows
;C:\Users\Robert.Withers\kafka-trunk\bin\windows;C:\Program Files (x86)\Haskell\
bin;D:\dish\software\Haskell Platform\2012.4.0.0\lib\extralibs\bin;D:\dish\softw
are\Haskell Platform\2012.4.0.0\bin;C:\Windows\system32;C:\Windows;C:\Windows\Sy
stem32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\PROGRA~1\CONDUS~1\DIS
KEE~1\;C:\Program Files\Microsoft SQL Server\100\DTS\Binn\;C:\Program Files (x86
)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86
)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100
\Tools\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\;C:\Progra
m Files (x86)\Microsoft Visual Studio 9.0\Common7\IDE\PrivateAssemblies\;C:\Prog
ram Files\TortoiseSVN\bin;D:\dish\software\Haskell Platform\2012.4.0.0\mingw\bin
;D:\dish\software\Java\jdk1.7.0_17\bin;. (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,407] INFO Client environment:java.io.tmpdir=C:\Users\ROBERT
~1.WIT\AppData\Local\Temp\ (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,408] INFO Client environment:java.compiler=<NA> (org.apache
.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,408] INFO Client environment:os.name=Windows 7 (org.apache.
zookeeper.ZooKeeper)
[2013-04-05 10:32:07,412] INFO Client environment:os.arch=amd64 (org.apache.zook
eeper.ZooKeeper)
[2013-04-05 10:32:07,413] INFO Client environment:os.version=6.1 (org.apache.zoo
keeper.ZooKeeper)
[2013-04-05 10:32:07,413] INFO Client environment:user.name=Robert.Withers (org.
apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,417] INFO Client environment:user.home=C:\Users\Robert.With
ers (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,418] INFO Client environment:user.dir=C:\Users\Robert.Withe
rs\kafka-trunk\bin (org.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,418] INFO Initiating client connection, connectString=local
host:2181 sessionTimeout=6000 watcher=org.I0Itec.zkclient.ZkClient@757b7533 (org
.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:07,433] INFO Opening socket connection to server localhost/0:0
:0:0:0:0:0:1:2181 (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:07,434] INFO Socket connection established to localhost/0:0:0:
0:0:0:0:1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:07,469] INFO Session establishment complete on server localhos
t/0:0:0:0:0:0:0:1:2181, sessionid = 0x13ddafd0fc40001, negotiated timeout = 6000
(org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:07,471] INFO zookeeper state changed (SyncConnected) (org.I0It
ec.zkclient.ZkClient)
[2013-04-05 10:32:07,490] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba-leader-finder-thread], Starting (kafka.consumer.ConsumerFetcherManag
er$$anon$1)
[2013-04-05 10:32:07,491] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], starting auto committer every 10000 ms (kafka.consumer.ZookeeperCon
sumerConnector)
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further detail
s.
[2013-04-05 10:32:07,535] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], begin registering consumer console-consumer-12815_MERD7-178041-1365
179527383-1da2aeba in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,677] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], end registering consumer console-consumer-12815_MERD7-178041-136517
9527383-1da2aeba in ZK (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,682] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], starting watcher executor thread for consumer console-consumer-1281
5_MERD7-178041-1365179527383-1da2aeba (kafka.consumer.ZookeeperConsumerConnector
)
[2013-04-05 10:32:07,722] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], begin rebalancing consumer console-consumer-12815_MERD7-178041-1365
179527383-1da2aeba try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,837] INFO Verifying properties (kafka.utils.VerifiablePrope
rties)
[2013-04-05 10:32:07,838] INFO Property broker.list is overridden to MERD7-17804
1.echostar.com:9092 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,838] INFO Property client.id is overridden to console-consu
mer-12815 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,838] INFO Property request.timeout.ms is overridden to 3000
0 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:07,857] INFO Fetching metadata with correlation id 0 for 1 top
ic(s) Set(test) (kafka.client.ClientUtils$)
[2013-04-05 10:32:07,858] INFO Connected to MERD7-178041.echostar.com:9092 for p
roducing (kafka.producer.SyncProducer)
[2013-04-05 10:32:07,895] INFO Disconnecting from MERD7-178041.echostar.com:9092
(kafka.producer.SyncProducer)
[2013-04-05 10:32:07,901] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Cleared all relevant queues for this fetcher (kafka.consumer.Zookee
perConsumerConnector)
[2013-04-05 10:32:07,902] INFO Clearing the current data chunk for this consumer
iterator (kafka.consumer.ConsumerIterator)
[2013-04-05 10:32:07,902] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Cleared the data chunks in all the consumer message iterators (kafk
a.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,903] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Committing all offsets after clearing the fetcher queues (kafka.con
sumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,903] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Releasing partition ownership (kafka.consumer.ZookeeperConsumerConn
ector)
[2013-04-05 10:32:07,905] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Consumer console-consumer-12815_MERD7-178041-1365179527383-1da2aeba
rebalancing the following partitions: ArrayBuffer(0) for topic test with consum
ers: List(console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0) (kafka.c
onsumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:07,906] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0 attemp
ting to claim partition 0 (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:08,044] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], console-consumer-12815_MERD7-178041-1365179527383-1da2aeba-0 succes
sfully owned partition 0 for topic test (kafka.consumer.ZookeeperConsumerConnect
or)
[2013-04-05 10:32:08,045] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Updating the cache (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:08,050] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Consumer console-consumer-12815_MERD7-178041-1365179527383-1da2aeba
selected partitions : test:0: fetched offset = -1: consumed offset = -1 (kafka.
consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:08,054] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], end rebalancing consumer console-consumer-12815_MERD7-178041-136517
9527383-1da2aeba try #0 (kafka.consumer.ZookeeperConsumerConnector)
[2013-04-05 10:32:08,058] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], Not creating event watcher for trivial whitelist test (kafka.consum
er.ZookeeperConsumerConnector)
[2013-04-05 10:32:08,072] INFO Verifying properties (kafka.utils.VerifiablePrope
rties)
[2013-04-05 10:32:08,073] INFO Property broker.list is overridden to MERD7-17804
1.echostar.com:9092 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:08,073] INFO Property client.id is overridden to console-consu
mer-12815 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:08,073] INFO Property request.timeout.ms is overridden to 3000
0 (kafka.utils.VerifiableProperties)
[2013-04-05 10:32:08,074] INFO Fetching metadata with correlation id 0 for 1 top
ic(s) Set(test) (kafka.client.ClientUtils$)
[2013-04-05 10:32:08,074] INFO Connected to MERD7-178041.echostar.com:9092 for p
roducing (kafka.producer.SyncProducer)
[2013-04-05 10:32:08,092] INFO Disconnecting from MERD7-178041.echostar.com:9092
(kafka.producer.SyncProducer)
[2013-04-05 10:32:08,102] INFO [ConsumerFetcherThread-console-consumer-12815_MER
D7-178041-1365179527383-1da2aeba-0-0], Starting (kafka.consumer.ConsumerFetcher
Thread)
[2013-04-05 10:32:08,123] WARN [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba-leader-finder-thread], Failed to add fetcher for [test,0] to broker i
d:0,host:MERD7-178041.echostar.com,port:9092 (kafka.consumer.ConsumerFetcherMana
ger$$anon$1)
kafka.common.LeaderNotAvailableException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstruct
orAccessorImpl.java:57)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingC
onstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
at java.lang.Class.newInstance0(Class.java:374)
at java.lang.Class.newInstance(Class.java:327)
at kafka.common.ErrorMapping$.exceptionFor(ErrorMapping.scala:72)
at kafka.consumer.ConsumerFetcherThread.handleOffsetOutOfRange(ConsumerF
etcherThread.scala:65)
at kafka.server.AbstractFetcherThread.addPartition(AbstractFetcherThread
.scala:166)
at kafka.server.AbstractFetcherManager.addFetcher(AbstractFetcherManager
.scala:48)
at kafka.consumer.ConsumerFetcherManager$$anon$1$$anonfun$doWork$3.apply
(ConsumerFetcherManager.scala:79)
at kafka.consumer.ConsumerFetcherManager$$anon$1$$anonfun$doWork$3.apply
(ConsumerFetcherManager.scala:75)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
la:80)
at scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.sca
la:80)
at scala.collection.Iterator$class.foreach(Iterator.scala:631)
at scala.collection.mutable.HashTable$$anon$1.foreach(HashTable.scala:16
1)
at scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala
:194)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:39)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:80)
at kafka.consumer.ConsumerFetcherManager$$anon$1.doWork(ConsumerFetcherM
anager.scala:75)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:51)
[2013-04-05 10:32:08,137] INFO [ConsumerFetcherThread-console-consumer-12815_MER
D7-178041-1365179527383-1da2aeba-0-0], Shutting down (kafka.consumer.ConsumerFet
cherThread)
[2013-04-05 10:32:08,137] INFO [ConsumerFetcherThread-console-consumer-12815_MER
D7-178041-1365179527383-1da2aeba-0-0], Stopped (kafka.consumer.ConsumerFetcherT
hread)
[2013-04-05 10:32:08,137] INFO [ConsumerFetcherThread-console-consumer-12815_MER
D7-178041-1365179527383-1da2aeba-0-0], Shutdown completed (kafka.consumer.Consum
erFetcherThread)
[2013-04-05 10:32:08,153] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], ZKConsumerConnector shutting down (kafka.consumer.ZookeeperConsumer
Connector)
[2013-04-05 10:32:08,154] INFO [ConsumerFetcherManager-1365179527478] shutting d
own (kafka.consumer.ConsumerFetcherManager)
[2013-04-05 10:32:08,154] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba-leader-finder-thread], Shutting down (kafka.consumer.ConsumerFetcherM
anager$$anon$1)
[2013-04-05 10:32:08,154] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba-leader-finder-thread], Stopped (kafka.consumer.ConsumerFetcherManage
r$$anon$1)
[2013-04-05 10:32:08,154] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba-leader-finder-thread], Shutdown completed (kafka.consumer.ConsumerFet
cherManager$$anon$1)
[2013-04-05 10:32:08,158] INFO [ConsumerFetcherManager-1365179527478] shutdown c
ompleted (kafka.consumer.ConsumerFetcherManager)
Consumed 0 messages
[2013-04-05 10:32:08,294] INFO Terminate ZkClient event thread. (org.I0Itec.zkcl
ient.ZkEventThread)
[2013-04-05 10:32:08,319] INFO Session: 0x13ddafd0fc40001 closed (org.apache.zoo
keeper.ZooKeeper)
[2013-04-05 10:32:08,320] INFO EventThread shut down (org.apache.zookeeper.Clien
tCnxn)
[2013-04-05 10:32:08,320] INFO [console-consumer-12815_MERD7-178041-136517952738
3-1da2aeba], ZKConsumerConnector shut down completed (kafka.consumer.ZookeeperCo
nsumerConnector)
[2013-04-05 10:32:08,321] INFO Initiating client connection, connectString=local
host:2181 sessionTimeout=30000 watcher=org.I0Itec.zkclient.ZkClient@3639d41 (org
.apache.zookeeper.ZooKeeper)
[2013-04-05 10:32:08,321] INFO Starting ZkClient event thread. (org.I0Itec.zkcli
ent.ZkEventThread)
[2013-04-05 10:32:08,324] INFO Opening socket connection to server localhost/127
.0.0.1:2181 (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:08,325] INFO Socket connection established to localhost/127.0.
0.1:2181, initiating session (org.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:08,351] INFO Session establishment complete on server localhos
t/127.0.0.1:2181, sessionid = 0x13ddafd0fc40002, negotiated timeout = 30000 (org
.apache.zookeeper.ClientCnxn)
[2013-04-05 10:32:08,352] INFO zookeeper state changed (SyncConnected) (org.I0It
ec.zkclient.ZkClient)
[2013-04-05 10:32:08,543] INFO Terminate ZkClient event thread. (org.I0Itec.zkcl
ient.ZkEventThread)
[2013-04-05 10:32:08,568] INFO Session: 0x13ddafd0fc40002 closed (org.apache.zoo
keeper.ZooKeeper)
[2013-04-05 10:32:08,568] INFO EventThread shut down (org.apache.zookeeper.Clien
tCnxn)
Thanks,
Rob
-----Original Message-----
From: Jun Rao [mailto:jun...@gmail.com]
Sent: Friday, April 05, 2013 10:02 AM
To: users@kafka.apache.org
Subject: Re: LeaderNotAvailableException: reventing the running of
kafka-console-producer.bat
If this happens on every message, it indicates a problem. Could you wipe out
all ZK and Kafka data and try it again? If it still doesn't work, could you try
the latest revision in the 0.8 branch?
Thanks,
Jun
On Fri, Apr 5, 2013 at 8:50 AM, Withers, Robert <robert.with...@dish.com>wrote:
> Yes, it happens on every message. I ran the zookeeper, server,
> console-producer against --broker-list localhost:9092 --topic test,
> then shut everything down and restarted the zookeeper and server and
> ran the console-consumer --zookeeper localhost:2181 --topic test and
> both the server console and consumer console reported WARNs of
> LeaderNotAvailableException.
>
> Since they were WARNs, would that mean that a message got produced and
> then consumed?
>
> Thanks,
> Rob
>
>
>
> -----Original Message-----
> From: Jun Rao [mailto:jun...@gmail.com]
> Sent: Thursday, April 04, 2013 10:03 PM
> To: users@kafka.apache.org
> Subject: Re: LeaderNotAvailableException: reventing the running of
> kafka-console-producer.bat
>
> This can happen on the first message in a new topic. Do you see the
> exception on posting every message? Also, run kafka-console-consumer
> to see if you can see the message.
>
> Thanks,
>
> Jun
>
>
> On Thu, Apr 4, 2013 at 1:37 PM, Withers, Robert
> <robert.with...@dish.com
> >wrote:
>
> > I am brand new to exploration into kafka, for work. Any help is
> > much appreciated.
> >
> > A co-worker built and updated a package for us to use on windows. I
> > have no idea what version it is. We cannot update through our
> > firewall. :(
> I
> > am able to start the zookeeper and a kafka server, but when I run
> > the kafka-console-producer.bat file and enter a "hello world" input
> > to post to the broker, the broker throws the LeaderNotAvailableException.
> >
> > Thanks for any assistance.
> > Rob
> >
> >
>
