Re: Dataframe v/s SparkSQL

2015-03-02 Thread Michael Armbrust
They are the same. These are just different ways to construct catalyst logical plans. On Mon, Mar 2, 2015 at 12:50 PM, Manoj Samel manojsamelt...@gmail.com wrote: Is it correct to say that Spark Dataframe APIs are implemented using same execution as SparkSQL ? In other words, while the

Dataframe v/s SparkSQL

2015-03-02 Thread Manoj Samel
Is it correct to say that Spark Dataframe APIs are implemented using same execution as SparkSQL ? In other words, while the dataframe API is different than SparkSQL, the runtime performance of equivalent constructs in Dataframe and SparkSQL should be same. So one should be able to choose whichever