It shouldn't be too bad - pertinent changes & migration notes are here: http://spark.apache.org/docs/1.0.0/programming-guide.html#migrating-from-pre-10-versions-of-spark for pre-1.0 and here: http://spark.apache.org/docs/latest/sql-programming-guide.html#upgrading-from-spark-sql-10-12-to-13 for SparkSQL pre-1.3
Since you aren't using SparkSQL the 2nd link is probably not useful. Generally you should find very few changes in the core API but things like MLlib would have changed a fair bit - though again the API should have been relatively stable. Your biggest change is probably going to be running jobs through spark-submit rather than spark-class etc: http://spark.apache.org/docs/latest/submitting-applications.html — Sent from Mailbox On Sat, Apr 4, 2015 at 1:11 AM, Ritesh Kumar Singh <[email protected]> wrote: > Hi, > Are there any tutorials that explains all the changelogs between Spark > 0.8.0 and Spark 1.3.0 and how can we approach this issue.
