spark git commit: [SPARK-19016][SQL][DOC] Document scalable partition handling

2016-12-30 Thread lian
Repository: spark Updated Branches: refs/heads/branch-2.1 47ab4afed -> 20ae11722 [SPARK-19016][SQL][DOC] Document scalable partition handling This PR documents the scalable partition handling feature in the body of the programming guide. Before this PR, we only mention it in the migration

spark git commit: [SPARK-19016][SQL][DOC] Document scalable partition handling

2016-12-30 Thread lian
Repository: spark Updated Branches: refs/heads/master b85e29437 -> 871f6114a [SPARK-19016][SQL][DOC] Document scalable partition handling ## What changes were proposed in this pull request? This PR documents the scalable partition handling feature in the body of the programming guide.

spark git commit: [SPARK-18123][SQL] Use db column names instead of RDD column ones during JDBC Writing

2016-12-30 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 852782b83 -> b85e29437 [SPARK-18123][SQL] Use db column names instead of RDD column ones during JDBC Writing ## What changes were proposed in this pull request? Apache Spark supports the following cases **by quoting RDD column names**

spark git commit: [SPARK-18922][TESTS] Fix more path-related test failures on Windows

2016-12-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 56d3a7eb8 -> 852782b83 [SPARK-18922][TESTS] Fix more path-related test failures on Windows ## What changes were proposed in this pull request? This PR proposes to fix the test failures due to different format of paths on Windows. Failed

spark git commit: [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is very inefficient

2016-12-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 63036aee2 -> 56d3a7eb8 [SPARK-18808][ML][MLLIB] ml.KMeansModel.transform is very inefficient ## What changes were proposed in this pull request? mllib.KMeansModel.clusterCentersWithNorm is a method than ends up being called every time