Apache Kafka: Encryption and Authentication

2022-10-03 Thread Namita Jaokar
Hi All, I am trying to implement encryption and authentication using SSL with my kafka broker. I am able to successfully generate trustore and cecert and cakey files. But while proceeding with the signing of the certificate with CA I'm unable to get through the parameters. Below is the command

Re: Kafka encryption

2016-06-06 Thread Bruno Rassaerts
Yes, and if on top of that it would be possible to define an own “compression” algorithm, which actually does compress + encrypt, then this would be a non-issue. > On 06 Jun 2016, at 17:11, Ismael Juma wrote: > > On Mon, Jun 6, 2016 at 3:12 PM, Tom Brown wrote: > >> How would it be possible

Re: Kafka encryption

2016-06-06 Thread Ismael Juma
On Mon, Jun 6, 2016 at 3:12 PM, Tom Brown wrote: > How would it be possible to encrypt an entire batch? My understanding > is that the Kafka server needs to know the boundaries of each message. > (E.g. The server decompresses compressed message sets and re-compresses > individual messages). > Qu

Re: Kafka encryption

2016-06-06 Thread Jim Hoagland
since >> otherwise patterns will be apparent. Also, RSA is more CPU intensive >>than >> AES. >> >> -- Jim >> >> On 6/6/16, 6:17 AM, "Martin Gainty" > >> wrote: >> >> >MG>quick questions for bruno and jim >> > &

Re: Kafka encryption

2016-06-06 Thread Tom Brown
CPU intensive than > AES. > > -- Jim > > On 6/6/16, 6:17 AM, "Martin Gainty" > > wrote: > > >MG>quick questions for bruno and jim > > > >> Subject: Re: Kafka encryption > >> From: bruno.rassae...@novazone.be > >> Date: M

Re: Kafka encryption

2016-06-06 Thread Jim Hoagland
7 AM, "Martin Gainty" wrote: >MG>quick questions for bruno and jim > >> Subject: Re: Kafka encryption >> From: bruno.rassae...@novazone.be >> Date: Mon, 6 Jun 2016 10:51:13 +0200 >> CC: tcrayf...@heroku.com >> To: users@kafka.apache.org >> >

RE: Kafka encryption

2016-06-06 Thread Martin Gainty
MG>quick questions for bruno and jim > Subject: Re: Kafka encryption > From: bruno.rassae...@novazone.be > Date: Mon, 6 Jun 2016 10:51:13 +0200 > CC: tcrayf...@heroku.com > To: users@kafka.apache.org > > Indeed to get proper performance, messages need to be batc

Re: Kafka encryption

2016-06-06 Thread Bruno Rassaerts
ystem >>>>>> administrators do not have access to the data. >>>>>> Any suggestions ? >>>>>> >>>>>>> On 24 May 2016, at 14:40, Tom Crayford >> > wrote: >>>>>>> >>>>>>> Hi, >>

Re: Kafka encryption

2016-06-02 Thread Jim Hoagland
's no encryption at rest. It's recommended to use filesystem >> > >>> encryption, or encryption of each individual message before >>producing >> > it >> > >>> for this. >> > >>> >> > >>> Only the new pro

Re: Kafka encryption

2016-06-02 Thread Tom Crayford
>> > > >>> On Tue, May 24, 2016 at 11:33 AM, Snehalata Nagaje < > > >>> snehalata.nag...@harbingergroup.com > wrote: > > >>> > > >>>> > > >>>> > > >>>> Thanks for quick reply. > > >&

Re: Kafka encryption

2016-06-01 Thread Gerard Klijs
ote: > >>> > >>>> > >>>> > >>>> Thanks for quick reply. > >>>> > >>>> Do you mean If I see messages in kafka, those will not be readable? > >>>> > >>>> And also, we are using n

Re: Kafka encryption

2016-06-01 Thread Snehalata Nagaje
ay, June 2, 2016 10:06:33 AM Subject: Re: Kafka encryption It works indeed but encrypting individual messages really influences the batch compression done by Kafka. Performance drops to about 1/3 of what it is without (even if we prepare the encrypted samples upfront). In the end what we going f

Re: Kafka encryption

2016-06-01 Thread Bruno Rassaerts
afka, those will not be readable? >>>> >>>> And also, we are using new producer but old consumer , does old consumer >>>> have ssl support? >>>> >>>> As mentioned in document, its not there. >>>> >>>&g

Re: Kafka encryption

2016-05-31 Thread Gerard Klijs
gt; > >> Do you mean If I see messages in kafka, those will not be readable? > >> > >> And also, we are using new producer but old consumer , does old consumer > >> have ssl support? > >> > >> As mentioned in document, its not there. > >> >

Re: Kafka encryption

2016-05-31 Thread Bruno Rassaerts
t;> Thanks, >> Snehalata >> >> - Original Message - >> From: "Mudit Kumar" >> To: users@kafka.apache.org >> Sent: Tuesday, May 24, 2016 3:53:26 PM >> Subject: Re: Kafka encryption >> >> Yes,it does that.What specifically yo

Re: Kafka encryption

2016-05-30 Thread eugene miretsky
cryption? > > > > > > we are using aws environment. > > > > > > Thanks, > > > Snehalata > > > > > > - Original Message - > > > From: "Gerard Klijs" > > > > To: "Users" > > &

Re: Kafka encryption

2016-05-26 Thread Jens Rantil
p.com> wrote: > > > > > > > Thanks, > > > > How can we do file system encryption? > > > > we are using aws environment. > > > > Thanks, > > Snehalata > > > > ----- Original Message - > > From: "Gerard Klijs&q

Re: Kafka encryption

2016-05-25 Thread Tom Crayford
gaje < snehalata.nag...@harbingergroup.com> wrote: > > > Thanks, > > How can we do file system encryption? > > we are using aws environment. > > Thanks, > Snehalata > > - Original Message - > From: "Gerard Klijs" > > To: "Use

Re: Kafka encryption

2016-05-24 Thread Snehalata Nagaje
Thanks, How can we do file system encryption? we are using aws environment. Thanks, Snehalata - Original Message - From: "Gerard Klijs" To: "Users" Sent: Tuesday, May 24, 2016 7:26:27 PM Subject: Re: Kafka encryption For both old and new consumers/producers y

Re: Kafka encryption

2016-05-24 Thread Gerard Klijs
gt; > > > As mentioned in document, its not there. > > > > > > Thanks, > > Snehalata > > > > - Original Message - > > From: "Mudit Kumar" > > To: users@kafka.apache.org > > Sent: Tuesday, May 24, 2016 3:53:26 PM > > Subject:

Re: Kafka encryption

2016-05-24 Thread Tom Crayford
; > As mentioned in document, its not there. > > > Thanks, > Snehalata > > - Original Message - > From: "Mudit Kumar" > To: users@kafka.apache.org > Sent: Tuesday, May 24, 2016 3:53:26 PM > Subject: Re: Kafka encryption > > Yes,it does that.What specifica

Re: Kafka encryption

2016-05-24 Thread Snehalata Nagaje
Kumar" To: users@kafka.apache.org Sent: Tuesday, May 24, 2016 3:53:26 PM Subject: Re: Kafka encryption Yes,it does that.What specifically you are looking for? On 5/24/16, 3:52 PM, "Snehalata Nagaje" wrote: >Hi All, > > >We have requirement of encryption i

Re: Kafka encryption

2016-05-24 Thread Mudit Kumar
Yes,it does that.What specifically you are looking for? On 5/24/16, 3:52 PM, "Snehalata Nagaje" wrote: >Hi All, > > >We have requirement of encryption in kafka. > >As per docs, we can configure kafka with ssl, for secured communication. > >But does kafka also stores data in encrypted form

Kafka encryption

2016-05-24 Thread Snehalata Nagaje
Hi All, We have requirement of encryption in kafka. As per docs, we can configure kafka with ssl, for secured communication. But does kafka also stores data in encrypted format? Thanks, Snehalata