Hi all, As most of you know, we are doing some API changes in Spark 2.0 to prepare Spark for the future, and a lot of focus there are on DataFrames and Datasets. We wrote a high level API doc and uploaded it to JIRA last week, but I don't think a lot of people monitor JIRA as closely. Here's a link: https://issues.apache.org/jira/browse/SPARK-13485
Please check it out and comment on it if you have any feedback. Cheers.