Hey Michal, I'm cc'ing the StreamSets user list, which might be able to get you some better StreamSets-specific answers.
Thanks! Natty On Thursday, March 3, 2016, Michał Kabocik <michal.kabo...@gmail.com> wrote: > Dears, > > I’m Middleware Engineer and I’m trying to configure secure Kafka Cluster > with SSL and Kerberos authentication with StreamSets, which will be used > for data injection to HDP. > > I have two Kafka Clusters; one with SSL enabled and there I successfully > connected StreamSets to Kafka with SSL authentication, and second one with > Kerberos authentication and here I’m facing with the problem: > > Both Kafka (with Zookeeper) and StreamSets are configured to authenticate > via Kerberos. When starting all of them, I see in the logs, that they are > successfully authenticated (TGT granted etc.) > > I have two listeners defined in Kafka: > listeners=PLAINTEXT://:9092,SASL_PLAINTEXT://:9093. When starting Kafka, I > see Kafka listens on both, 9092 and 9093. > > When I connect StreamSets to Kafka on port 9092, everything works smooth. > But when I try to connect to port 9093, error occurs: > > KAFKA_41 - Could not get partition count for topic 'streamsets5' : > com.streamsets.pipeline.api.StageException: KAFKA_41 - Could not get > caseition count for topic 'streamsets5' : > org.apache.kafka.common.KafkaException: Failed to construct kafka consumer > > I see no errors in Kafka, in the log of StreamSets, there is only above > error visible. I attached major config files of Kafka, Zookeeper and > StreamSets. > > Will greatly appreciate your help in solving this case! > > Kind regards, > -- Jonathan "Natty" Natkins StreamSets | Field Engineer mobile: 609.577.1600 | linkedin <http://www.linkedin.com/in/nattyice>
