Hi, I am currently using Storm version 1.0.2 and trying to connect to Kerberized Kafka (version 0.9.0 on CDH 5.8.2).
I have been getting issues with connection and I get below error as given below this mail. I would like to know from the community if the storm-kafka-client for 1.0.2 in an external package (https://github.com/apache/storm/tree/1.0.x-branch/external/storm-kafka-client) is safe to be used in production. Or does the community recommend that I upgrade Storm to version 1.1.0 and Kafka to 0.10.0 (since 1.1.0 has Kafka 0.10.0 as one of its dependencies) ? Kindly let me know. Thanks, Sreeram A: Error Stack trace when connecting to Kerberized Kafka (0.9.0 on CDH 5.8.2) from Storm (1.0.2) ================================================================================================= java.lang.NullPointerException at org.apache.kafka.common.utils.Utils.formatAddress(Utils.java:407) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer$$anonfun$disconnect$1.apply(SimpleConsumer.scala:54) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer$$anonfun$disconnect$1.apply(SimpleConsumer.scala:54) ~[stormjar.jar:?] at kafka.utils.Logging$class.debug(Logging.scala:52) [stormjar.jar:?] at kafka.consumer.SimpleConsumer.debug(SimpleConsumer.scala:35) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer.disconnect(SimpleConsumer.scala:54) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer.close(SimpleConsumer.scala:75) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer.connect(SimpleConsumer.scala:48) ~[stormjar.jar:?] at kafka.consumer.SimpleConsumer.getOrMakeConnection(SimpleConsumer.scala:173) [stormjar.jar:?] at kafka.consumer.SimpleConsumer.liftedTree1$1(SimpleConsumer.scala:84) [stormjar.jar:?] at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(SimpleConsumer.scala:83) [stormjar.jar:?] at kafka.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:149) [stormjar.jar:?] at kafka.javaapi.consumer.SimpleConsumer.getOffsetsBefore(SimpleConsumer.scala:79) [stormjar.jar:?] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:75) [stormjar.jar:?] at org.apache.storm.kafka.KafkaUtils.getOffset(KafkaUtils.java:65) [stormjar.jar:?] at org.apache.storm.kafka.PartitionManager.<init>(PartitionManager.java:103) [stormjar.jar:?] at org.apache.storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:98) [stormjar.jar:?] at org.apache.storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:69) [stormjar.jar:?] at org.apache.storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:129) [stormjar.jar:?] at org.gst.topology.spouts.MyKafkaSpout.nextTuple(MyKafkaSpout.java:30) [stormjar.jar:?] at org.apache.storm.daemon.executor$fn__7990$fn__8005$fn__8036.invoke(executor.clj:648) [storm-core-1.0.2.jar:1.0.2] at org.apache.storm.util$async_loop$fn__624.invoke(util.clj:484) [storm-core-1.0.2.jar:1.0.2] at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102] I could also see that Storm was reading null values for partition information from zookeeper. 2017-06-06 14:39:03.910 o.a.s.k.PartitionManager [INFO] Read partition information from: /path/partition_4 --> null 2017-06-06 14:39:03.910 o.a.s.k.PartitionManager [INFO] Read partition information from: /path/partition_0 --> null 2017-06-06 14:39:03.911 o.a.s.k.PartitionManager [INFO] Read partition information from: /path/partition_2 --> null
