Re: [RDDs and Dataframes] Equivalent expressions for RDD API

2017-03-05 Thread ayan guha
mber of partitions to say 10? > > Furthermore, I would also like to ask about the equivalent expression > (using > RDD API) for the following simple transformation: > > data.select("word-ID", > "count").groupBy("word-ID").agg(sum($"count&q

Re: [RDDs and Dataframes] Equivalent expressions for RDD API

2017-03-05 Thread khwunchai jaengsawang
the number of partitions to say 10? > > Furthermore, I would also like to ask about the equivalent expression (using > RDD API) for the following simple transformation: > > data.select("word-ID", > "count").groupBy("word-ID").agg(sum($"count").as(&q

Re: [RDDs and Dataframes] Equivalent expressions for RDD API

2017-03-04 Thread bryan . jeffrey
ount")).show() Thanks in advance -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/RDDs-and-Dataframes-Equivalent-expressions-for-RDD-API-tp28455.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org

[RDDs and Dataframes] Equivalent expressions for RDD API

2017-03-04 Thread Old-School
;).groupBy("word-ID").agg(sum($"count").as("count")).show() Thanks in advance -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/RDDs-and-Dataframes-Equivalent-expressio