Hi Michal, Are you able to write and read from the kerberized Kafka setup using the Kafka Console Producer and Consumer?
I am taking a look at your configuration files. Thanks Hari. On Thu, Mar 3, 2016 at 8:09 AM Jonathan Natkins <na...@streamsets.com> wrote: > Hey Michal, > > I'm cc'ing the StreamSets user list, which might be able to get you some > better StreamSets-specific answers. > > Thanks! > Natty > > On Thursday, March 3, 2016, Michał Kabocik <michal.kabo...@gmail.com> > wrote: > >> Dears, >> >> I’m Middleware Engineer and I’m trying to configure secure Kafka Cluster >> with SSL and Kerberos authentication with StreamSets, which will be used >> for data injection to HDP. >> >> I have two Kafka Clusters; one with SSL enabled and there I successfully >> connected StreamSets to Kafka with SSL authentication, and second one with >> Kerberos authentication and here I’m facing with the problem: >> >> Both Kafka (with Zookeeper) and StreamSets are configured to authenticate >> via Kerberos. When starting all of them, I see in the logs, that they are >> successfully authenticated (TGT granted etc.) >> >> I have two listeners defined in Kafka: >> listeners=PLAINTEXT://:9092,SASL_PLAINTEXT://:9093. When starting Kafka, I >> see Kafka listens on both, 9092 and 9093. >> >> When I connect StreamSets to Kafka on port 9092, everything works smooth. >> But when I try to connect to port 9093, error occurs: >> >> KAFKA_41 - Could not get partition count for topic 'streamsets5' : >> com.streamsets.pipeline.api.StageException: KAFKA_41 - Could not get >> caseition count for topic 'streamsets5' : >> org.apache.kafka.common.KafkaException: Failed to construct kafka consumer >> >> I see no errors in Kafka, in the log of StreamSets, there is only above >> error visible. I attached major config files of Kafka, Zookeeper and >> StreamSets. >> >> Will greatly appreciate your help in solving this case! >> >> Kind regards, >> > > > -- > Jonathan "Natty" Natkins > StreamSets | Field Engineer > mobile: 609.577.1600 | linkedin <http://www.linkedin.com/in/nattyice> > > > -- > You received this message because you are subscribed to the Google Groups > "sdc-user" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to sdc-user+unsubscr...@streamsets.com. > Visit this group at > https://groups.google.com/a/streamsets.com/group/sdc-user/. >
