Hi, Recently I gave a talk on a deep dive into data frame api and sql catalyst . Video of the same is available on Youtube with slides and code. Please have a look if you are interested.
*http://blog.madhukaraphatak.com/anatomy-of-spark-dataframe-api/ <http://blog.madhukaraphatak.com/anatomy-of-spark-dataframe-api/>* -- Regards, Madhukara Phatak http://datamantra.io/