That's right. On Sun, Apr 19, 2015 at 8:59 AM, Arun Patel <arunp.bigd...@gmail.com> wrote:
> Thanks Ted. > > So, whatever the operations I am performing now are DataFrames and not > SchemaRDD? Is that right? > > Regards, > Venkat > > On Sun, Apr 19, 2015 at 9:13 AM, Ted Yu <yuzhih...@gmail.com> wrote: > >> bq. SchemaRDD is not existing in 1.3? >> >> That's right. >> >> See this thread for more background: >> >> http://search-hadoop.com/m/JW1q5zQ1Xw/spark+DataFrame+schemardd&subj=renaming+SchemaRDD+gt+DataFrame >> >> >> >> On Sat, Apr 18, 2015 at 5:43 PM, Abhishek R. Singh < >> abhis...@tetrationanalytics.com> wrote: >> >>> I am no expert myself, but from what I understand DataFrame is >>> grandfathering SchemaRDD. This was done for API stability as spark sql >>> matured out of alpha as part of 1.3.0 release. >>> >>> It is forward looking and brings (dataframe like) syntax that was not >>> available with the older schema RDD. >>> >>> On Apr 18, 2015, at 4:43 PM, Arun Patel <arunp.bigd...@gmail.com> wrote: >>> >>> > Experts, >>> > >>> > I have few basic questions on DataFrames vs Spark SQL. My confusion >>> is more with DataFrames. >>> > >>> > 1) What is the difference between Spark SQL and DataFrames? Are they >>> same? >>> > 2) Documentation says SchemaRDD is renamed as DataFrame. This means >>> SchemaRDD is not existing in 1.3? >>> > 3) As per documentation, it looks like creating dataframe is no >>> different than SchemaRDD - df = >>> sqlContext.jsonFile("examples/src/main/resources/people.json"). >>> > So, my question is what is the difference? >>> > >>> > Thanks for your help. >>> > >>> > Arun >>> >>> >>> --------------------------------------------------------------------- >>> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org >>> For additional commands, e-mail: user-h...@spark.apache.org >>> >>> >> >
