Re: Is there a reduceByKey functionality in DataFrame API?

2016-08-29 Thread Marius Soutier
ue to the reducer doing the >> aggregation (it ships partial aggregations instead). >> >> I wonder whether the DataFrame API optimizes the code doing something >> similar to what RDD.reduceByKey does. >> >> I am using Spark 1.6.2. >> >> Regards, >>

Re: Is there a reduceByKey functionality in DataFrame API?

2016-08-29 Thread ayan guha
ation (it ships partial aggregations instead). >> >> I wonder whether the DataFrame API optimizes the code doing something >> similar to what RDD.reduceByKey does. >> >> I am using Spark 1.6.2. >> >> Regards, >> Luis >> >> >> >> -

Re: Is there a reduceByKey functionality in DataFrame API?

2016-08-29 Thread Marius Soutier
hips partial aggregations instead). > > I wonder whether the DataFrame API optimizes the code doing something > similar to what RDD.reduceByKey does. > > I am using Spark 1.6.2. > > Regards, > Luis > > > > -- > View this message in context: > http://ap

Re: Is there a reduceByKey functionality in DataFrame API?

2016-08-10 Thread Holden Karau
ds, > Luis > > > > -- > View this message in context: http://apache-spark-user-list. > 1001560.n3.nabble.com/Is-there-a-reduceByKey-functionality-in-DataFrame- > API-tp27508.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > >

Is there a reduceByKey functionality in DataFrame API?

2016-08-10 Thread luismattor
t.1001560.n3.nabble.com/Is-there-a-reduceByKey-functionality-in-DataFrame-API-tp27508.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org