Hi Michal, Can you succesfully connect to the SASL port without StreamSet? For example using the console consumer as explain here? http://www.confluent.io/blog/apache-kafka-security-authorization-authentication-encryption (the end-to-end example is all the way at the end of the blog)
This can help us decide if the issue is with the client or server configuration... Gwen On Thu, Mar 3, 2016 at 3:29 AM, Michał Kabocik <michal.kabo...@gmail.com> wrote: > Dears, > > I’m Middleware Engineer and I’m trying to configure secure Kafka Cluster > with SSL and Kerberos authentication with StreamSets, which will be used for > data injection to HDP. > > I have two Kafka Clusters; one with SSL enabled and there I successfully > connected StreamSets to Kafka with SSL authentication, and second one with > Kerberos authentication and here I’m facing with the problem: > > Both Kafka (with Zookeeper) and StreamSets are configured to authenticate > via Kerberos. When starting all of them, I see in the logs, that they are > successfully authenticated (TGT granted etc.) > > I have two listeners defined in Kafka: > listeners=PLAINTEXT://:9092,SASL_PLAINTEXT://:9093. When starting Kafka, I > see Kafka listens on both, 9092 and 9093. > > When I connect StreamSets to Kafka on port 9092, everything works smooth. > But when I try to connect to port 9093, error occurs: > > KAFKA_41 - Could not get partition count for topic 'streamsets5' : > com.streamsets.pipeline.api.StageException: KAFKA_41 - Could not get > caseition count for topic 'streamsets5' : > org.apache.kafka.common.KafkaException: Failed to construct kafka consumer > > I see no errors in Kafka, in the log of StreamSets, there is only above > error visible. I attached major config files of Kafka, Zookeeper and > StreamSets. > > Will greatly appreciate your help in solving this case! > > Kind regards,
