Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-06-01 Thread Shaik Asifullah
Yes, I faced the same issue with the latest storm Kafka client. Stig's patch helps to solve this issue. On Fri, 1 Jun 2018, 20:42 Stig Rohde Døssing, wrote: > Pretty sure it's this issue > https://issues.apache.org/jira/browse/STORM-3046. There's a link to a > patched 1.x branch you can use unti

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-06-01 Thread Stig Rohde Døssing
Pretty sure it's this issue https://issues.apache.org/jira/browse/STORM-3046. There's a link to a patched 1.x branch you can use until we get a fix released. 2018-06-01 9:06 GMT+02:00 Aniket Alhat : > Hi Stig, all > > I seem to stumble upon one more NPE :) , every time I restart my topology > (ma

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-06-01 Thread Aniket Alhat
Hi Stig, all I seem to stumble upon one more NPE :) , every time I restart my topology (making use of trident opaque spout) I get the below stack trace. *kafka consumer config*2018-06-01 06:27:17.942 o.a.k.c.c.ConsumerConfig [INFO] ConsumerConfig values: auto.commit.interval.ms = 5000

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-22 Thread Stig Rohde Døssing
No, haven't seen it before. I took a look at NamedTopicFilter, and I think what's happening is that the partitionsFor call here https://github.com/apache/storm/blob/v1.2.1/external/storm-kafka-client/src/main/java/org/apache/storm/kafka/spout/NamedTopicFilter.java#L57 is returning null. Did you co

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-22 Thread Aniket Alhat
Hello, I'm using Storm 1.2.1 with new storm-kafka-client and consuming from brokers 0.11.2.0 with opaque trident spout. But unfortunately my topology crashes with below exception. 2018-05-22 06:23:02.318 o.a.s.util [ERROR] Async loop died! java.lang.NullPointerException: null at org.apac

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-17 Thread Bobby Evans
I'll try to find some time to review it. On Tue, May 15, 2018 at 11:56 PM Aniket Alhat wrote: > Hi Bobby, > > Thanks for your reply, indeed SimpleConsumer.scala doesn't support > extraction of data from Kafka via. Kerberos in which case I'll start > thinking to upgrade Storm to 1.2.1 and look to

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-15 Thread Aniket Alhat
Hi Bobby, Thanks for your reply, indeed SimpleConsumer.scala doesn't support extraction of data from Kafka via. Kerberos in which case I'll start thinking to upgrade Storm to 1.2.1 and look to use storm-kafka-client, I'm specifically using Transnational Non Opaque Spout ( https://issues.apache.org

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-15 Thread Bobby Evans
I am not sure you can. storm-kafka 0.10.0 uses kafka version 0.8.1.1, and I don't think security was added into kafka yet. https://kafka.apache.org/081/documentation.html If you have overridden that version of the kafka client and are running with a newer version of kafka, you might be able to,

Re: How to use KafkaSpout to consume kafka cluster secured with kerberos

2018-05-15 Thread Aniket Alhat
Hi Hao, Zimmer Where you guys able to get the any feedback on this? How did you get around this issue? On Wed, Jul 13, 2016 at 9:23 PM, Ziemer, Tom wrote: > Hi everybody, > > > > I am facing the same problem (with Storm 1.0.1 and Kafka 0.9.0.1). Any > ideas? > > > > Thanks, > > Tom > > > > *Fro

RE: How to use KafkaSpout to consume kafka cluster secured with kerberos

2016-07-13 Thread Ziemer, Tom
Hi everybody, I am facing the same problem (with Storm 1.0.1 and Kafka 0.9.0.1). Any ideas? Thanks, Tom From: Hao Chen [mailto:h...@apache.org] Sent: Dienstag, 12. Juli 2016 02:44 To: user@storm.apache.org Subject: How to use KafkaSpout to consume kafka cluster secured with kerberos Hi Team, H