Re: sql to spark scala rdd

2016-08-02 Thread Sri
.map { case (key,value) => >>>> >>>> (key,value.toArray.toSeq.sliding(2,1).map(x >>>> >>>> => x.sum/x.size))}.foreach(println) >>>> >>>> >>>> >>>> On Sun, Jul 31, 2016 at 12:03 AM, sri

Re: sql to spark scala rdd

2016-08-02 Thread Jacek Laskowski
> >>> <kali.tumm...@gmail.com> wrote: >>> >>> >>> Hi All, >>> >>> >>> I managed to write using sliding function but can it get key as well in >>> >>> my >>> >>> output ? >>> >>

Re: sql to spark scala rdd

2016-08-01 Thread sri hari kali charan Tummala
50.0 >> >> -100.0 >> >> >> I want with key how to get moving average output based on key ? >> >> >> >> 987,75.0 >> >> 987,-25 >> >> 987,5

Re: sql to spark scala rdd

2016-08-01 Thread Sri
oDouble)).toArray().sliding(2,1).map(x => >>>>>>> (x,x.size)).foreach(println) >>>>>>> >>>>>>> >>>>>>> at the moment my output:- >>>>>>> >>>>>>> 75.0 >>>>>>> -25.0 >

Re: sql to spark scala rdd

2016-08-01 Thread Mich Talebzadeh
30, 2016 at 11:24 AM, Jacek Laskowski <ja...@japila.pl> > > wrote: > > > Why? > > > Pozdrawiam, > > Jacek Laskowski > > > > https://medium.com/@jaceklaskowski/ > > Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark > > Fol

Re: sql to spark scala rdd

2016-08-01 Thread Sri
t;>> Sri >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> On Sat, Jul 30, 2016 at 11:40 AM, sri hari kali charan Tummala >>>>> <kali.tumm...@gmail.com> wrote: >>

Re: sql to spark scala rdd

2016-07-31 Thread Jacek Laskowski
>> >> >>>> Why? >> >>>> >> >>>> Pozdrawiam, >> >>>> Jacek Laskowski >> >>>> >> >>>> https://medium.com/@jaceklaskowski/ >> >>>> Mastering Apache Spark 2.0

Re: sql to spark scala rdd

2016-07-31 Thread sri hari kali charan Tummala
key ? >>>> >> >>>> >> >>>> >> 987,75.0 >>>> >> 987,-25 >>>> >> 987,50.0 >>>> >> >>>> >>

Re: sql to spark scala rdd

2016-07-31 Thread sri hari kali charan Tummala
>> >>> >> >>> >> >>> >> >>> >> >>> >> On Sat, Jul 30, 2016 at 11:40 AM, sri hari kali charan Tummala >>> >> <kali.tumm...@gmail.com> wrote: >>> >>> >>> >>> for know

Re: sql to spark scala rdd

2016-07-31 Thread Mich Talebzadeh
>> >>> Sri >> >>> >> >>> On Sat, Jul 30, 2016 at 11:24 AM, Jacek Laskowski <ja...@japila.pl> >> >>> wrote: >> >>>> >> >>>> Why? >> >>>> >> >>>&g

Re: sql to spark scala rdd

2016-07-31 Thread sri hari kali charan Tummala
>> > >>>> Pozdrawiam, > >>>> Jacek Laskowski > >>>> > >>>> https://medium.com/@jaceklaskowski/ > >>>> Mastering Apache Spark 2.0 http://bit.ly/mastering-apache-spark > >>>> Follow me

Re: sql to spark scala rdd

2016-07-31 Thread Jacek Laskowski
gt;>>> Follow me at https://twitter.com/jaceklaskowski >>>> >>>> >>>> On Sat, Jul 30, 2016 at 4:42 AM, kali.tumm...@gmail.com >>>> <kali.tumm...@gmail.com> wrote: >>>> > Hi All, >>

Re: sql to spark scala rdd

2016-07-31 Thread sri hari kali charan Tummala
I am >>> still >>> > learning scala how this below sql be written using spark RDD not spark >>> data >>> > frames. >>> > >>> > SELECT DATE,balance, >>> > SUM(balance) OVER (ORDER BY DATE ROWS BETWEEN UNBOUNDED PRECEDING AND >>

Re: sql to spark scala rdd

2016-07-31 Thread sri hari kali charan Tummala
BY DATE ROWS BETWEEN UNBOUNDED PRECEDING AND >> > CURRENT ROW) daily_balance >> > FROM table >> > >> > >> > >> > >> > >> > -- >> > View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com

Re: sql to spark scala rdd

2016-07-30 Thread sri hari kali charan Tummala
table > > > > > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/sql-to-spark-scala-rdd-tp27433.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

Re: sql to spark scala rdd

2016-07-30 Thread Jacek Laskowski
ROW) daily_balance > FROM table > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/sql-to-spark-scala-rdd-tp27433.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > ---

sql to spark scala rdd

2016-07-29 Thread kali.tumm...@gmail.com
-- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/sql-to-spark-scala-rdd-tp27433.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user