Re: Spark Dataset doesn't have api for changing columns

2016-01-23 Thread Milad khajavi
How can I request for this API? See this closed issue: https://issues.apache.org/jira/browse/SPARK-12863 On Tue, Jan 19, 2016 at 10:12 PM, Michael Armbrust wrote: > In Spark 2.0 we are planning to combine DataFrame and Dataset so that all > the methods will be available

Spark Dataset doesn't have api for changing columns

2016-01-19 Thread Milad khajavi
Hi Spark users, when I want to map the result of count on groupBy, I need to convert the result to Dataframe, then change the column names and map the result to new case class, Why Spark Datatset API doesn't have direct functionality? case class LogRow(id: String, location: String, time: Long)

Re: Spark Dataset doesn't have api for changing columns

2016-01-19 Thread Michael Armbrust
In Spark 2.0 we are planning to combine DataFrame and Dataset so that all the methods will be available on either class. On Tue, Jan 19, 2016 at 3:42 AM, Milad khajavi wrote: > Hi Spark users, > > when I want to map the result of count on groupBy, I need to convert the >