Dell - Internal Use - Confidential Using the same zk cluster for both storm and kafka.
From: Harsha [mailto:st...@harsha.io] Sent: Wednesday, May 13, 2015 11:58 AM To: Kalluri, Rajesh - Dell Team; user@storm.apache.org Subject: Re: Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup Are you using separate zk clusters for storm and kafka. If so which zookeepers did you configure for kafka spout. -- Harsha Sent with Airmail On May 12, 2015 at 8:40:26 PM, rajesh_kall...@dellteam.com<mailto:rajesh_kall...@dellteam.com> (rajesh_kall...@dellteam.com<mailto:rajesh_kall...@dellteam.com>) wrote: Dell - Internal Use - Confidential Strom Kafka spout has sporadic issue with figuring out partition info from ZK on startup. Here is the stack trace. Any clues on how to troubleshoot this error? Did not find much help on Stackoverflow and Google. b.s.d.executor [ERROR] java.lang.RuntimeException: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:81) ~[stormjar.jar:na] at storm.kafka.trident.ZkBrokerReader.<init>(ZkBrokerReader.java:42) ~[stormjar.jar:na] at storm.kafka.KafkaUtils.makeBrokerReader(KafkaUtils.java:57) ~[stormjar.jar:na] at storm.kafka.KafkaSpout.open(KafkaSpout.java:87) ~[stormjar.jar:na] at backtype.storm.daemon.executor$fn_4081$fn_4096.invoke(executor.clj:519) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11] at backtype.storm.util$async_loop$fn__444.invoke(util.clj:434) ~[storm-core-0.9.1.2.1.7.1-11.jar:0.9.1.2.1.7.1-11] at clojure.lang.AFn.run(AFn.java:24) [clojure-1.4.0.jar:na] at java.lang.Thread.run(Thread.java:744) [na:1.7.0_45] Caused by: java.lang.RuntimeException: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/controllerlog_preprod/partitions at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:94) ~[stormjar.jar:na] at storm.kafka.DynamicBrokersReader.getBrokerInfo(DynamicBrokersReader.java:65) ~[stormjar.jar:na] ... 7 common frames omitted Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /brokers/topics/topic1/partitions at org.apache.zookeeper.KeeperException.create(KeeperException.java:111) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1] at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1] at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1586) ~[zookeeper-3.4.5.2.1.7.1-11.jar:3.4.5-11--1] at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:214) ~[stormjar.jar:na] at org.apache.curator.framework.imps.GetChildrenBuilderImpl$3.call(GetChildrenBuilderImpl.java:203) ~[stormjar.jar:na] at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107) ~[stormjar.jar:na] at org.apache.curator.framework.imps.GetChildrenBuilderImpl.pathInForeground(GetChildrenBuilderImpl.java:199) ~[stormjar.jar:na] at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:191) ~[stormjar.jar:na] at org.apache.curator.framework.imps.GetChildrenBuilderImpl.forPath(GetChildrenBuilderImpl.java:38) ~[stormjar.jar:na] at storm.kafka.DynamicBrokersReader.getNumPartitions(DynamicBrokersReader.java:91) ~[stormjar.jar:na] ... 8 common frames omitted
