Re: [Beginner] Kafka 0.11 header support in Spark Structured Streaming

2018-02-28 Thread karthikus
TD, Thanks for your response. -- Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/ - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[Beginner] How to save Kafka Dstream data to parquet ?

2018-02-28 Thread karthikus
Hi all, I have a Kafka stream data and I need to save the data in parquet format without using Structured Streaming (due to the lack of Kafka Message header support). val kafkaStream = KafkaUtils.createDirectStream( streamingContext,