Yes, this is what I tried, but thanks!
On Wed, Jul 9, 2014 at 6:02 PM, Tobias Pfeiffer <t...@preferred.jp> wrote:
> Siyuan,
>
> I do it like this:
>
> // get data from Kafka
> val ssc = new StreamingContext(...)
> val kvPairs = KafkaUtils.createStream(...)
> // we need to wrap the data in a case class for registerAsTable() to
> succeed
> val lines = kvPairs.map(_._2).map(s => StringWrapper(s))
> val result = lines.transform((rdd, time) => {
> // execute statement
> rdd.registerAsTable("data")
> sqlc.sql(query)
> })
>
> Don't know if it is the best way, but it works.
>
> Tobias
>
>
> On Thu, Jul 10, 2014 at 4:21 AM, hsy...@gmail.com <hsy...@gmail.com>
> wrote:
>
>> Hi guys,
>>
>> I'm a new user to spark. I would like to know is there an example of how
>> to user spark SQL and spark streaming together? My use case is I want to do
>> some SQL on the input stream from kafka.
>> Thanks!
>>
>> Best,
>> Siyuan
>>
>
>
