Re: Reading Avro messages from Kafka using Structured Streaming in Spark 2.1

2017-05-12 Thread Michael Armbrust
any responses on this. Thanks. > > > > *From:* Revin Chalil [mailto:rcha...@expedia.com] > *Sent:* Wednesday, May 10, 2017 11:21 PM > *To:* user@spark.apache.org > *Subject:* Reading Avro messages from Kafka using Structured Streaming in > Spark 2.1 > > > > I am tr

RE: Reading Avro messages from Kafka using Structured Streaming in Spark 2.1

2017-05-12 Thread Revin Chalil
Just following up on this; would appreciate any responses on this. Thanks. From: Revin Chalil [mailto:rcha...@expedia.com] Sent: Wednesday, May 10, 2017 11:21 PM To: user@spark.apache.org Subject: Reading Avro messages from Kafka using Structured Streaming in Spark 2.1 I am trying to convert

Reading Avro messages from Kafka using Structured Streaming in Spark 2.1

2017-05-10 Thread Revin Chalil
I am trying to convert avro records with field type = bytes to json string using Structured Streaming in Spark 2.1. Please see below. object AvroConvert { case class KafkaMessage( payload: String ) val schemaString ="""{