Re: Kafka Authorization and ACLs Broken

2017-07-05 Thread Rajini Sivaram
Hi Raghav, Yes, you should be able to use AdminClient from 0.11.0. Take a look at the Javadocs ( https://kafka.apache.org/0110/javadoc/org/apache/kafka/clients/admin/package-summary.html). The integration tests may be useful too ( https://github.com/apache/kafka/blob/trunk/core/src/test/scala/inte

Re: Kafka Authorization and ACLs Broken

2017-07-05 Thread Raghav
Hi Rajini Now that 0.11.0 is out, can we use the Admin client ? Are there some example code for these ? Thanks. On Wed, May 24, 2017 at 9:06 PM, Rajini Sivaram wrote: > Hi Raghav, > > Yes, you can create ACLs programmatically. Take a look at the use of > AclCommand.main in https://github.com/a

Re: Kafka Authorization and ACLs Broken

2017-05-26 Thread Kamalov, Alex
Hey Raghav, Yes, I would very much love to get your configs, so I can model against it. Thanks again, Alex From: Raghav Date: Thursday, May 25, 2017 at 10:54 PM To: Mike Marzo Cc: Darshan Purandare , Rajini Sivaram , Users , Alex Kamalov Subject: Re: Kafka Authorization and ACLs Broken

Re: Kafka Authorization and ACLs Broken

2017-05-26 Thread Raghav
sers , Alex Kamalov < > alex.kama...@bnymellon.com> > *Subject: *Re: Kafka Authorization and ACLs Broken > > > > In SSL cert, there is a field which has a CN (Common Name). So when ACLs > are set, they are set for that CN. This is how the ACLs are configured and > matched against

Re: Kafka Authorization and ACLs Broken

2017-05-25 Thread Raghav
In SSL cert, there is a field which has a CN (Common Name). So when ACLs are set, they are set for that CN. This is how the ACLs are configured and matched against. I am still pretty new to Kafka in general, but this is how I think it works. I can copy my config if you want. On Thu, May 25, 2017 a

Re: Kafka Authorization and ACLs Broken

2017-05-25 Thread Mike Marzo
Stupid question If u don't specify a jaas file how does the consumer and producer specify the Id that acl's are configured against boy I am getting more and more perplexed by this... mike marzo 908 209-4484 On May 24, 2017 9:29 PM, "Raghav" wrote: > Mike > > I am not using jaas file.

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Raghav
I initially tried kerberos, but it felt too complicated, so gave up and only tried SSL. On Wed, May 24, 2017 at 7:47 PM, Mike Marzo wrote: > Thanks. We will try it. Struggling with krb5 and acls > > mike marzo > 908 209-4484 <(908)%20209-4484> > > On May 24, 2017 9:29 PM, "Raghav" wrote: > >>

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Mike Marzo
Thanks. We will try it. Struggling with krb5 and acls mike marzo 908 209-4484 On May 24, 2017 9:29 PM, "Raghav" wrote: > Mike > > I am not using jaas file. I literally took the config Rajini gave in the > previous email and it worked for me. I am using ssl Kafka with ACLs. I am > not suing ke

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Raghav
Mike I am not using jaas file. I literally took the config Rajini gave in the previous email and it worked for me. I am using ssl Kafka with ACLs. I am not suing kerberos. Thanks. On Wed, May 24, 2017 at 11:29 AM, Mike Marzo wrote: > I'm also having issues getting acls to work. Out of interea

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Mike Marzo
I'm also having issues getting acls to work. Out of intereat, are you starting ur brokers with a jaas file, if so do u mind sharing the client and server side jaas entries so I can validate what I'm doing. mike marzo 908 209-4484 On May 24, 2017 10:54 AM, "Raghav" wrote: > Hi Rajini > > Thank

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Raghav
Hi Rajini Thank you very much. It perfectly works. I think in my setup I was trying to use a CA (certificate authority) to sign the certificates from client and server, and then adding it to trust store and keystore. I think in that process, I may have messed something. I will try above config wi

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Raghav
Rajini I will try and report to you shortly. Many thanks. Raghav On Wed, May 24, 2017 at 7:04 AM, Rajini Sivaram wrote: > Raghav/Darshan, > > Can you try these steps on a clean installation of Kafka? It works for me, > so hopefully it will work for you. And then you can adapt to your scenario.

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Rajini Sivaram
Raghav/Darshan, Can you try these steps on a clean installation of Kafka? It works for me, so hopefully it will work for you. And then you can adapt to your scenario. *Create keystores and truststores:* keytool -genkey -alias kafka -keystore server.keystore.jks -dname "CN=KafkaBroker,O=Pivotal,C

Re: Kafka Authorization and ACLs Broken

2017-05-23 Thread Raghav
Darshan, I have not yet successfully gotten the ACLs to work in Kafka. I am still looking for help. I will update this email thread if I do find. In case you get it working, please let me know. Thanks. R On Tue, May 23, 2017 at 8:49 AM, Darshan Purandare < purandare.dars...@gmail.com> wrote: >

Re: Kafka Authorization and ACLs Broken

2017-05-23 Thread Darshan Purandare
Raghav I saw few posts of yours around Kafka ACLs and the problems. I have seen similar issues where Writer has not been able to write to any topic. I have seen "leader not available" and sometimes "unknown topic or partition", and "topic_authorization_failed" error. Let me know if you find a val

Kafka Authorization and ACLs Broken

2017-05-23 Thread Raghav
Hello Kafka Users I am a new Kafka user and trying to make Kafka SSL work with Authorization and ACLs. I followed posts from Kafka and Confluent docs exactly to the point but my producer cannot write to kafka broker. I get "LEADER_NOT_FOUND" errors. And even Consumer throws the same errors. Can s