Re: Stream compressed data from KafkaUtils.createDirectStream

Hi Baki, It's enough for the producer to write the messages compressed. See here: https://cwiki.apache.org/confluence/display/KAFKA/Compression Thank you. Daniel > On 3 Nov 2016, at 21:27, Daniel Haviv wrote: > > Hi, > Kafka can compress/uncompress your

Re: Stream compressed data from KafkaUtils.createDirectStream

Hi, Kafka can compress/uncompress your messages for you seamlessly, adding compression on top of that will be redundant. Thank you. Daniel > On 3 Nov 2016, at 20:53, bhayat wrote: > > Hello, > > I really wonder that whether i can stream compressed data with using >

Stream compressed data from KafkaUtils.createDirectStream

Hello, I really wonder that whether i can stream compressed data with using KafkaUtils.createDirectStream(...) or not. This is formal code that i use ; JavaPairInputDStream messages = KafkaUtils.createStream(javaStreamingContext, zookeeperConfiguration, groupName, topicMap,

Fwd: Stream compressed data from KafkaUtils.createDirectStream

Hello, I really wonder that whether i can stream compressed data with using KafkaUtils.createDirectStream(...) or not. This is formal code that i use ; JavaPairInputDStream messages = KafkaUtils.createStream(javaStreamingContext, zookeeperConfiguration, groupName, topicMap,