Thanks Michael, that worked, appreciate your help.
From: Michael Armbrust [mailto:mich...@databricks.com]
Sent: Monday, May 15, 2017 11:45 AM
To: Revin Chalil <rcha...@expedia.com>
Cc: User <user@spark.apache.org>
Subject: Re: Spark SQL DataFrame to Kafka Topic
The foreach sink fr
elp is much appreciated. Thank you.
>
>
>
>
>
> *From:* Tathagata Das [mailto:tathagata.das1...@gmail.com]
> *Sent:* Friday, January 13, 2017 3:31 PM
> *To:* Koert Kuipers <ko...@tresata.com>
> *Cc:* Peyman Mohajerian <mohaj...@gmail.com>; Senthil Kumar <
>
rs
<ko...@tresata.com>; silvio.fior...@granturing.com
Subject: RE: Spark SQL DataFrame to Kafka Topic
Hi TD / Michael,
I am trying to use the foreach sink to write to Kafka and followed
this<https://databricks.com/blog/2017/04/04/real-time-end-to-end-integration-with-apache-kafka-in-apache-sparks-
athagata.das1...@gmail.com]
Sent: Friday, January 13, 2017 3:31 PM
To: Koert Kuipers <ko...@tresata.com>
Cc: Peyman Mohajerian <mohaj...@gmail.com>; Senthil Kumar
<senthilec...@gmail.com>; User <user@spark.apache.org>; senthilec...@apache.org
Subject: Re: Spark SQL DataFrame to Kafka
Kumar <senthilec...@gmail.com>
> wrote:
>
> Hi Team ,
>
> Sorry if this question already asked in this forum..
>
> Can we ingest data to Apache Kafka Topic from Spark SQL DataFrame ??
>
> Here is my Code which Reads Parquet File :
>
> *val sqlContext = new org.apache.s
reaming-kafka.html
>>> http://spark.apache.org/docs/latest/structured-streaming-pro
>>> gramming-guide.html
>>>
>>> On Fri, Jan 13, 2017 at 3:32 AM, Senthil Kumar <senthilec...@gmail.com>
>>> wrote:
>>>
>>>> Hi Team ,
>>&g
t;>
>>> Hi Team ,
>>>
>>> Sorry if this question already asked in this forum..
>>>
>>> Can we ingest data to Apache Kafka Topic from Spark SQL DataFrame ??
>>>
>>> Here is my Code which Reads Parquet File :
>>>
>>>
.html
> http://spark.apache.org/docs/latest/structured-streaming-
> programming-guide.html
>
> On Fri, Jan 13, 2017 at 3:32 AM, Senthil Kumar <senthilec...@gmail.com>
> wrote:
>
>> Hi Team ,
>>
>> Sorry if this question already asked in this forum..
>>
; Hi Team ,
>
> Sorry if this question already asked in this forum..
>
> Can we ingest data to Apache Kafka Topic from Spark SQL DataFrame ??
>
> Here is my Code which Reads Parquet File :
>
> *val sqlContext = new org.apache.spark.sql.SQLContext(sc);*
>
> *val df = sqlCo
Hi Team ,
Sorry if this question already asked in this forum..
Can we ingest data to Apache Kafka Topic from Spark SQL DataFrame ??
Here is my Code which Reads Parquet File :
*val sqlContext = new org.apache.spark.sql.SQLContext(sc);*
*val df = sqlContext.read.parquet("
10 matches
Mail list logo