svn commit: r30445 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_26_18_03-313a1f0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Sat Oct 27 01:19:12 2018 New Revision: 30445 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_26_18_03-313a1f0 docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30444 - in /dev/spark/2.3.3-SNAPSHOT-2018_10_26_18_02-3afb3a2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Sat Oct 27 01:17:32 2018 New Revision: 30444 Log: Apache Spark 2.3.3-SNAPSHOT-2018_10_26_18_02-3afb3a2 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30434 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_26_16_02-e9b71c8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 23:17:18 2018 New Revision: 30434 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_26_16_02-e9b71c8 docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25828][K8S] Bumping Kubernetes-Client version to 4.1.0

2018-10-26 Thread eje
Repository: spark Updated Branches: refs/heads/master ca545f794 -> e9b71c8f0 [SPARK-25828][K8S] Bumping Kubernetes-Client version to 4.1.0 ## What changes were proposed in this pull request? Changed the `kubernetes-client` version and refactored code that broke as a result ## How was this

spark git commit: [SPARK-25821][SQL] Remove SQLContext methods deprecated in 1.4

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master d325ffbf3 -> ca545f794 [SPARK-25821][SQL] Remove SQLContext methods deprecated in 1.4 ## What changes were proposed in this pull request? Remove SQLContext methods deprecated in 1.4 ## How was this patch tested? Existing tests. Closes

spark git commit: [SPARK-25851][SQL][MINOR] Fix deprecated API warning in SQLListener

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6aa506394 -> d325ffbf3 [SPARK-25851][SQL][MINOR] Fix deprecated API warning in SQLListener ## What changes were proposed in this pull request? In https://github.com/apache/spark/pull/21596, Jackson is upgraded to 2.9.6. There are some

spark git commit: [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.2 8906696ac -> 5b1396596 [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown the final line in the mvn helper script in build/ attempts to shut down the zinc server. due to the zinc server being set up w/a

spark git commit: [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 0a05cf917 -> 3afb3a20e [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown the final line in the mvn helper script in build/ attempts to shut down the zinc server. due to the zinc server being set up w/a

spark git commit: [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 cb2827d28 -> 313a1f0a7 [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown ## What changes were proposed in this pull request? the final line in the mvn helper script in build/ attempts to shut down the zinc

spark git commit: [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master d367bdcf5 -> 6aa506394 [SPARK-25854][BUILD] fix `build/mvn` not to fail during Zinc server shutdown ## What changes were proposed in this pull request? the final line in the mvn helper script in build/ attempts to shut down the zinc

svn commit: r30431 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_26_12_02-d367bdc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 19:16:52 2018 New Revision: 30431 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_26_12_02-d367bdc docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30425 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_26_10_03-cb2827d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 17:17:38 2018 New Revision: 30425 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_26_10_03-cb2827d docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[2/2] spark git commit: Preparing development version 2.4.1-SNAPSHOT

2018-10-26 Thread wenchen
Preparing development version 2.4.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cb2827d2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cb2827d2 Diff:

[1/2] spark git commit: Preparing Spark release v2.4.0-rc5

2018-10-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 1757a603f -> cb2827d28 Preparing Spark release v2.4.0-rc5 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4a7ead48 Tree:

[spark] Git Push Summary

2018-10-26 Thread wenchen
Repository: spark Updated Tags: refs/tags/v2.4.0-rc5 [created] 4a7ead480 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: HOT-FIX pyspark import

2018-10-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 d868dc2b8 -> 1757a603f HOT-FIX pyspark import Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1757a603 Tree:

spark git commit: [SPARK-25255][PYTHON] Add getActiveSession to SparkSession in PySpark

2018-10-26 Thread holden
Repository: spark Updated Branches: refs/heads/master f1891ff1e -> d367bdcf5 [SPARK-25255][PYTHON] Add getActiveSession to SparkSession in PySpark ## What changes were proposed in this pull request? add getActiveSession in session.py ## How was this patch tested? add doctest Closes

[spark] Git Push Summary

2018-10-26 Thread wenchen
Repository: spark Updated Tags: refs/tags/v2.4.0-rc5 [deleted] 075447b39 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.4.1-SNAPSHOT

2018-10-26 Thread wenchen
Preparing development version 2.4.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d868dc2b Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d868dc2b Diff:

[spark] Git Push Summary

2018-10-26 Thread wenchen
Repository: spark Updated Tags: refs/tags/v2.4.0-rc5 [created] 075447b39 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[1/2] spark git commit: Preparing Spark release v2.4.0-rc5

2018-10-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 40ed093b7 -> d868dc2b8 Preparing Spark release v2.4.0-rc5 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/075447b3 Tree:

svn commit: r30424 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_26_08_02-f1891ff-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 15:17:08 2018 New Revision: 30424 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_26_08_02-f1891ff docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25760][DOCS][FOLLOWUP] Add note about AddJar return value change in migration guide

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 33e337c11 -> f1891ff1e [SPARK-25760][DOCS][FOLLOWUP] Add note about AddJar return value change in migration guide ## What changes were proposed in this pull request? Add note about AddJar return value change in migration guide ## How

spark git commit: [SPARK-24709][SQL][FOLLOW-UP] Make schema_of_json's input json as literal only

2018-10-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 7d44bc264 -> 33e337c11 [SPARK-24709][SQL][FOLLOW-UP] Make schema_of_json's input json as literal only ## What changes were proposed in this pull request? The main purpose of `schema_of_json` is the usage of combination with `from_json`

spark git commit: [SPARK-25835][K8S] Create kubernetes-tests profile and use the detected SCALA_VERSION

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.4 b47b8271d -> 26e1d3ef8 [SPARK-25835][K8S] Create kubernetes-tests profile and use the detected SCALA_VERSION - Fixes the scala version propagation issue. - Disables the tests under the k8s profile, now we will run them manually. Adds

spark git commit: [SPARK-25835][K8S] Create kubernetes-tests profile and use the detected SCALA_VERSION

2018-10-26 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6fd5ff395 -> 7d44bc264 [SPARK-25835][K8S] Create kubernetes-tests profile and use the detected SCALA_VERSION ## What changes were proposed in this pull request? - Fixes the scala version propagation issue. - Disables the tests under the

svn commit: r30422 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_26_04_02-6fd5ff3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 11:16:53 2018 New Revision: 30422 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_26_04_02-6fd5ff3 docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25797][SQL][DOCS] Add migration doc for solving issues caused by view canonicalization approach change

2018-10-26 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 89d748b33 -> 6fd5ff395 [SPARK-25797][SQL][DOCS] Add migration doc for solving issues caused by view canonicalization approach change ## What changes were proposed in this pull request? Since Spark 2.2, view definitions are stored in a

svn commit: r30419 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_26_02_02-f37bcea-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 09:17:08 2018 New Revision: 30419 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_26_02_02-f37bcea docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30418 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_26_00_02-89d748b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-26 Thread pwendell
Author: pwendell Date: Fri Oct 26 07:17:49 2018 New Revision: 30418 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_26_00_02-89d748b docs [This commit notification would consist of 1473 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]