spark git commit: [SPARK-18462] Fix ClassCastException in SparkListenerDriverAccumUpdates event

2016-11-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 fc466be4f -> e8b1955e2 [SPARK-18462] Fix ClassCastException in SparkListenerDriverAccumUpdates event ## What changes were proposed in this pull request? This patch fixes a `ClassCastException: java.lang.Integer cannot be cast to

spark git commit: [SPARK-18462] Fix ClassCastException in SparkListenerDriverAccumUpdates event

2016-11-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master ce13c2672 -> d9dd979d1 [SPARK-18462] Fix ClassCastException in SparkListenerDriverAccumUpdates event ## What changes were proposed in this pull request? This patch fixes a `ClassCastException: java.lang.Integer cannot be cast to

spark git commit: [SPARK-18360][SQL] default table path of tables in default database should depend on the location of default database

2016-11-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-2.1 978798880 -> fc466be4f [SPARK-18360][SQL] default table path of tables in default database should depend on the location of default database ## What changes were proposed in this pull request? The current semantic of the warehouse

spark git commit: [SPARK-18360][SQL] default table path of tables in default database should depend on the location of default database

2016-11-17 Thread yhuai
Repository: spark Updated Branches: refs/heads/master b0aa1aa1a -> ce13c2672 [SPARK-18360][SQL] default table path of tables in default database should depend on the location of default database ## What changes were proposed in this pull request? The current semantic of the warehouse

spark git commit: [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 536a21593 -> 978798880 [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange ## What changes were proposed in this pull request? In ShuffleExchange, the nodename's extraInfo are the same when

spark git commit: [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master cdaf4ce9f -> b0aa1aa1a [SPARK-18490][SQL] duplication nodename extrainfo for ShuffleExchange ## What changes were proposed in this pull request? In ShuffleExchange, the nodename's extraInfo are the same when

spark git commit: [SPARK-18480][DOCS] Fix wrong links for ML guide docs

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 42777b1b3 -> 536a21593 [SPARK-18480][DOCS] Fix wrong links for ML guide docs ## What changes were proposed in this pull request? 1, There are two `[Graph.partitionBy]` in `graphx-programming-guide.md`, the first one had no effert. 2,

spark git commit: [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 4fcecb4cf -> 42777b1b3 [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings ## What changes were proposed in this pull request? Several places in MLlib use custom regexes or other approaches to parse Spark versions.

spark git commit: [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 49b6f456a -> de77c6775 [SPARK-17462][MLLIB]use VersionUtils to parse Spark version strings ## What changes were proposed in this pull request? Several places in MLlib use custom regexes or other approaches to parse Spark versions. Those

spark git commit: [SPARK-18365][DOCS] Improve Sample Method Documentation

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master a3cac7bd8 -> 49b6f456a [SPARK-18365][DOCS] Improve Sample Method Documentation ## What changes were proposed in this pull request? I found the documentation for the sample method to be confusing, this adds more clarification across all

spark git commit: [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/master 07b3f045c -> a3cac7bd8 [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md ## What changes were proposed in this pull request? Remove `spark.driver.memory`, `spark.executor.memory`, `spark.driver.cores`, and

spark git commit: [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md

2016-11-17 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.1 014fceee0 -> 2ee4fc889 [YARN][DOC] Remove non-Yarn specific configurations from running-on-yarn.md ## What changes were proposed in this pull request? Remove `spark.driver.memory`, `spark.executor.memory`, `spark.driver.cores`, and

spark git commit: [SPARK-18464][SQL] support old table which doesn't store schema in metastore

2016-11-17 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 6a3cbbc03 -> 014fceee0 [SPARK-18464][SQL] support old table which doesn't store schema in metastore ## What changes were proposed in this pull request? Before Spark 2.1, users can create an external data source table without schema,

spark git commit: [SPARK-18464][SQL] support old table which doesn't store schema in metastore

2016-11-17 Thread rxin
Repository: spark Updated Branches: refs/heads/master 170eeb345 -> 07b3f045c [SPARK-18464][SQL] support old table which doesn't store schema in metastore ## What changes were proposed in this pull request? Before Spark 2.1, users can create an external data source table without schema, and