Re: Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
gt; > From:Mich Talebzadeh <mich.talebza...@gmail.com> > To:Praveen Devarao/India/IBM@IBMIN, "user @spark" < > user@spark.apache.org> > Date:26/04/2016 04:03 pm > Subject:Re: Splitting spark dstream into separate fields > >

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
oesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Mich Talebzadeh <mich.talebza...@gmail.com> To: Praveen Devarao/India/IBM@IBMIN, "user @spark" <user@spark.apache.org> Date: 26/04/2016 04:03 pm Subject:

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
Praveen Devarao > Spark Technology Centre > IBM India Software Labs > > ----------------- > "Courage doesn't always roar. Sometimes courage is the quiet voice at the > end of the day saying I will try again" > >

Re: Splitting spark dstream into separate fields

2016-04-26 Thread Praveen Devarao
t;Courage doesn't always roar. Sometimes courage is the quiet voice at the end of the day saying I will try again" From: Mich Talebzadeh <mich.talebza...@gmail.com> To: "user @spark" <user@spark.apache.org> Date: 26/04/2016 12:58 pm Subject:Splitting sp

Splitting spark dstream into separate fields

2016-04-26 Thread Mich Talebzadeh
Hi, Is there any optimum way of splitting a dstream into components? I am doing Spark streaming and this the dstream I get val dstream = KafkaUtils.createDirectStream[String, String, StringDecoder, StringDecoder](ssc, kafkaParams, topics) Now that dstream consists of 10,00 price lines per