spark git commit: [SPARK-18425][STRUCTURED STREAMING][TESTS] Test `CompactibleFileStreamLog` directly

2016-11-21 Thread zsxwing
Repository: spark Updated Branches: refs/heads/branch-2.1 6dbe44891 -> aaa2a173a [SPARK-18425][STRUCTURED STREAMING][TESTS] Test `CompactibleFileStreamLog` directly ## What changes were proposed in this pull request? Right now we are testing the most of `CompactibleFileStreamLog` in

spark git commit: [SPARK-18425][STRUCTURED STREAMING][TESTS] Test `CompactibleFileStreamLog` directly

2016-11-21 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 97a8239a6 -> ebeb0830a [SPARK-18425][STRUCTURED STREAMING][TESTS] Test `CompactibleFileStreamLog` directly ## What changes were proposed in this pull request? Right now we are testing the most of `CompactibleFileStreamLog` in

spark git commit: [SPARK-18493] Add missing python APIs: withWatermark and checkpoint to dataframe

2016-11-21 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master a2d464770 -> 97a8239a6 [SPARK-18493] Add missing python APIs: withWatermark and checkpoint to dataframe ## What changes were proposed in this pull request? This PR adds two of the newly added methods of `Dataset`s to Python:

spark git commit: [SPARK-17765][SQL] Support for writing out user-defined type in ORC datasource

2016-11-21 Thread rxin
Repository: spark Updated Branches: refs/heads/master ddd02f50b -> a2d464770 [SPARK-17765][SQL] Support for writing out user-defined type in ORC datasource ## What changes were proposed in this pull request? This PR adds the support for `UserDefinedType` when writing out instead of throwing

spark git commit: [SPARK-17765][SQL] Support for writing out user-defined type in ORC datasource

2016-11-21 Thread rxin
Repository: spark Updated Branches: refs/heads/branch-2.1 406f33987 -> 2afc18be2 [SPARK-17765][SQL] Support for writing out user-defined type in ORC datasource ## What changes were proposed in this pull request? This PR adds the support for `UserDefinedType` when writing out instead of

spark git commit: [SPARK-18361][PYSPARK] Expose RDD localCheckpoint in PySpark

2016-11-21 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-2.1 b0a73c9be -> 406f33987 [SPARK-18361][PYSPARK] Expose RDD localCheckpoint in PySpark ## What changes were proposed in this pull request? Expose RDD's localCheckpoint() and associated functions in PySpark. ## How was this patch tested?

spark git commit: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn for non-existing tables

2016-11-21 Thread andrewor14
Repository: spark Updated Branches: refs/heads/branch-2.1 251a99276 -> b0a73c9be [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn for non-existing tables ## What changes were proposed in this pull request? Currently, `DROP TABLE IF EXISTS` shows warning for non-existing tables.

spark git commit: [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn for non-existing tables

2016-11-21 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 70176871a -> ddd02f50b [SPARK-18517][SQL] DROP TABLE IF EXISTS should not warn for non-existing tables ## What changes were proposed in this pull request? Currently, `DROP TABLE IF EXISTS` shows warning for non-existing tables. However,

spark git commit: [SPARK-18361][PYSPARK] Expose RDD localCheckpoint in PySpark

2016-11-21 Thread andrewor14
Repository: spark Updated Branches: refs/heads/master 07beb5d21 -> 70176871a [SPARK-18361][PYSPARK] Expose RDD localCheckpoint in PySpark ## What changes were proposed in this pull request? Expose RDD's localCheckpoint() and associated functions in PySpark. ## How was this patch tested? I

[6/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to third-party-projects.html, Powered By to powered-by.html Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo

[2/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/releases/spark-release-0-7-2.html -- diff --git a/site/releases/spark-release-0-7-2.html b/site/releases/spark-release-0-7-2.html index 2506300..0ccc6a9

[4/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/news/spark-0-7-2-released.html -- diff --git a/site/news/spark-0-7-2-released.html b/site/news/spark-0-7-2-released.html index 06f1766..12c8d35 100644 ---

[1/6] spark-website git commit: Port wiki page Committers to committers.html, Contributing to Spark and Code Style Guide to contributing.html, Third Party Projects and Additional Language Bindings to

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 46fb91025 -> 0744e8fdd http://git-wip-us.apache.org/repos/asf/spark-website/blob/0744e8fd/site/third-party-projects.html -- diff --git

spark git commit: [SPARK-18413][SQL] Add `maxConnections` JDBCOption

2016-11-21 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9f262ae16 -> 07beb5d21 [SPARK-18413][SQL] Add `maxConnections` JDBCOption ## What changes were proposed in this pull request? This PR adds a new JDBCOption `maxConnections` which means the maximum number of simultaneous JDBC connections

spark git commit: [SPARK-18398][SQL] Fix nullabilities of MapObjects and ExternalMapToCatalyst.

2016-11-21 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master e811fbf9e -> 9f262ae16 [SPARK-18398][SQL] Fix nullabilities of MapObjects and ExternalMapToCatalyst. ## What changes were proposed in this pull request? The nullabilities of `MapObject` can be made more strict by relying on

spark git commit: [SPARK-18398][SQL] Fix nullabilities of MapObjects and ExternalMapToCatalyst.

2016-11-21 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/branch-2.1 31002e4a7 -> 251a99276 [SPARK-18398][SQL] Fix nullabilities of MapObjects and ExternalMapToCatalyst. ## What changes were proposed in this pull request? The nullabilities of `MapObject` can be made more strict by relying on

spark git commit: [SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM

2016-11-21 Thread yliang
Repository: spark Updated Branches: refs/heads/branch-2.1 fb4e6359d -> 31002e4a7 [SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM ## What changes were proposed in this pull request? Add model summary APIs for `GaussianMixtureModel` and `BisectingKMeansModel` in

spark git commit: [SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM

2016-11-21 Thread yliang
Repository: spark Updated Branches: refs/heads/master 658547974 -> e811fbf9e [SPARK-18282][ML][PYSPARK] Add python clustering summaries for GMM and BKM ## What changes were proposed in this pull request? Add model summary APIs for `GaussianMixtureModel` and `BisectingKMeansModel` in

spark-website git commit: add Pull Request Template

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site d10414f83 -> 46fb91025 add Pull Request Template Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/46fb9102 Tree:

spark-website git commit: Updated FAQ to point to Community Page / StackOverflow

2016-11-21 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site e45462a52 -> d10414f83 Updated FAQ to point to Community Page / StackOverflow Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/d10414f8 Tree: