RE: Where is DataFrame.scala in 2.0?

2016-06-03 Thread Gerhard Fiedler
Thanks! From: Herman van Hövell tot Westerflier [mailto:hvanhov...@questtec.nl] Sent: Fri, Jun 03, 2016 10:05 To: Gerhard Fiedler <gfied...@algebraixdata.com> Cc: dev@spark.apache.org Subject: Re: Where is DataFrame.scala in 2.0? Hi Gerhard, DataFrame and DataSet have been merged in Spa

Re: Where is DataFrame.scala in 2.0?

2016-06-03 Thread Michael Malak
It's been reduced to a single line of code. http://technicaltidbit.blogspot.com/2016/03/dataframedataset-swap-places-in-spark-20.html From: Gerhard Fiedler To: "dev@spark.apache.org" Sent: Friday, June 3, 2016 9:01 AM Subject: Where

Re: Where is DataFrame.scala in 2.0?

2016-06-03 Thread Herman van Hövell tot Westerflier
Hi Gerhard, DataFrame and DataSet have been merged in Spark 2.0. A DataFrame is now a DataSet that contains Row objects. We still maintain a type alias for DataFrame: https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/package.scala#L45 HTH Kind regards,