Thanks Zongheng for the pointer. Is there a way to achieve the same in 1.0.0 ?
On Thu, Jul 31, 2014 at 1:43 PM, Zongheng Yang <zonghen...@gmail.com> wrote: > countDistinct is recently added and is in 1.0.2. If you are using that > or the master branch, you could try something like: > > r.select('keyword, countDistinct('userId)).groupBy('keyword) > > On Thu, Jul 31, 2014 at 12:27 PM, buntu <buntu...@gmail.com> wrote: > > I'm looking to write a select statement to get a distinct count on userId > > grouped by keyword column on a parquet file SchemaRDD equivalent of: > > SELECT keyword, count(distinct(userId)) from table group by keyword > > > > How to write it using the chained select().groupBy() operations? > > > > Thanks! > > > > > > > > -- > > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/SchemaRDD-select-expression-tp11069.html > > Sent from the Apache Spark User List mailing list archive at Nabble.com. >