Re: Spark to Kafka communication encrypted ?

2016-08-31 Thread Luciano Resende
bm.com/profiles/html/myProfileView.do> 8200 >> Warden Ave >> Markham, ON L6G 1C7 >> Canada >> >> >> >> - Original message - >> From: Cody Koeninger <c...@koeninger.org> >> To: Eric Ho <e...@analyticsmd.com> >> Cc: "u

Re: Spark to Kafka communication encrypted ?

2016-08-31 Thread Cody Koeninger
; Warden Ave > Markham, ON L6G 1C7 > Canada > > > > - Original message - > From: Cody Koeninger <c...@koeninger.org> > To: Eric Ho <e...@analyticsmd.com> > Cc: "user@spark.apache.org" <user@spark.apache.org> > Subject: Re: Spark to

Re: Spark to Kafka communication encrypted ?

2016-08-31 Thread Mihai Iacob
: Cody Koeninger <c...@koeninger.org>To: Eric Ho <e...@analyticsmd.com>Cc: "user@spark.apache.org" <user@spark.apache.org>Subject: Re: Spark to Kafka communication encrypted ?Date: Wed, Aug 31, 2016 10:34 AMĀ  Encryption is only available in spark-streaming-kafka-0-10, not 0-

Re: Spark to Kafka communication encrypted ?

2016-08-31 Thread Cody Koeninger
Encryption is only available in spark-streaming-kafka-0-10, not 0-8. You enable it the same way you enable it for the Kafka project's new consumer, by setting kafka configuration parameters appropriately. http://kafka.apache.org/documentation.html#security_ssl On Wed, Aug 31, 2016 at 2:03 AM,

Spark to Kafka communication encrypted ?

2016-08-31 Thread Eric Ho
I can't find in Spark 1.6.2's docs in how to turn encryption on for Spark to Kafka communication ... I think that the Spark docs only tells you how to turn on encryption for inter Spark node communications .. Am I wrong ? Thanks. -- -eric ho