svn commit: r30175 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_19_22_02-e3a60b0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Sat Oct 20 05:16:47 2018 New Revision: 30175 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_19_22_02-e3a60b0 docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30174 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_20_02-3370865-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Sat Oct 20 03:16:56 2018 New Revision: 30174 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_20_02-3370865 docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25785][SQL] Add prettyNames for from_json, to_json, from_csv, and schema_of_json

2018-10-19 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 4acbda4a9 -> 3370865b0 [SPARK-25785][SQL] Add prettyNames for from_json, to_json, from_csv, and schema_of_json ## What changes were proposed in this pull request? This PR adds `prettyNames` for `from_json`, `to_json`, `from_csv`, and

spark git commit: Revert "[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator"

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 432697c7b -> e3a60b0d6 Revert "[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator" This reverts commit 36307b1e4b42ce22b07e7a3fc2679c4b5e7c34c8. Project:

spark git commit: Revert "[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator"

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ec96d34e7 -> 4acbda4a9 Revert "[SPARK-25764][ML][EXAMPLES] Update BisectingKMeans example to use ClusteringEvaluator" This reverts commit d0ecff28545ac81f5ba7ac06957ced65b6e3ebcd. Project:

svn commit: r30172 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_16_03-ec96d34-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 23:17:26 2018 New Revision: 30172 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_16_03-ec96d34 docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25745][K8S] Improve docker-image-tool.sh script

2018-10-19 Thread vanzin
Repository: spark Updated Branches: refs/heads/master 43717dee5 -> ec96d34e7 [SPARK-25745][K8S] Improve docker-image-tool.sh script ## What changes were proposed in this pull request? Adds error checking and handling to `docker` invocations ensuring the script terminates early in the event

spark git commit: Revert "[SPARK-25758][ML] Deprecate computeCost on BisectingKMeans"

2018-10-19 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 1001d2314 -> 432697c7b Revert "[SPARK-25758][ML] Deprecate computeCost on BisectingKMeans" This reverts commit c2962546d9a5900a5628a31b83d2c4b22c3a7936. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

svn commit: r30171 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_19_14_03-1001d23-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 21:17:15 2018 New Revision: 30171 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_19_14_03-1001d23 docs [This commit notification would consist of 1477 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30168 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_12_02-43717de-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 19:16:51 2018 New Revision: 30168 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_12_02-43717de docs [This commit notification would consist of 1483 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25704][CORE] Allocate a bit less than Int.MaxValue

2018-10-19 Thread irashid
Repository: spark Updated Branches: refs/heads/branch-2.4 9c0c6d4d5 -> 1001d2314 [SPARK-25704][CORE] Allocate a bit less than Int.MaxValue JVMs don't you allocate arrays of length exactly Int.MaxValue, so leave a little extra room. This is necessary when reading blocks >2GB off the network

spark git commit: [SPARK-25704][CORE] Allocate a bit less than Int.MaxValue

2018-10-19 Thread irashid
Repository: spark Updated Branches: refs/heads/master 130121711 -> 43717dee5 [SPARK-25704][CORE] Allocate a bit less than Int.MaxValue JVMs don't you allocate arrays of length exactly Int.MaxValue, so leave a little extra room. This is necessary when reading blocks >2GB off the network (for

svn commit: r30165 - in /dev/spark/2.3.3-SNAPSHOT-2018_10_19_10_03-5cef11a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 17:19:05 2018 New Revision: 30165 Log: Apache Spark 2.3.3-SNAPSHOT-2018_10_19_10_03-5cef11a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30164 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_19_10_03-9c0c6d4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 17:18:18 2018 New Revision: 30164 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_19_10_03-9c0c6d4 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: fix security issue of zinc(update run-tests.py)

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9ad0f6ea8 -> 130121711 fix security issue of zinc(update run-tests.py) Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/13012171 Tree:

spark git commit: [SPARK-25269][SQL] SQL interface support specify StorageLevel when cache table

2018-10-19 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master ac586bbb0 -> 9ad0f6ea8 [SPARK-25269][SQL] SQL interface support specify StorageLevel when cache table ## What changes were proposed in this pull request? SQL interface support specify `StorageLevel` when cache table. The semantic is:

svn commit: r30163 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_08_03-ec1fafe-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 15:17:35 2018 New Revision: 30163 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_08_03-ec1fafe docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] Git Push Summary

2018-10-19 Thread wenchen
Repository: spark Updated Tags: refs/tags/v2.4.0-rc4 [deleted] 1ff8dd424 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.4.1-SNAPSHOT

2018-10-19 Thread wenchen
Preparing development version 2.4.1-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9c0c6d4d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9c0c6d4d Diff:

[spark] Git Push Summary

2018-10-19 Thread wenchen
Repository: spark Updated Tags: refs/tags/v2.4.0-rc4 [created] 1ff8dd424 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: fix security issue of zinc

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.2 2e3b923e0 -> d6542fa3f fix security issue of zinc Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d6542fa3 Tree:

spark git commit: fix security issue of zinc

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 353d32804 -> 5cef11acc fix security issue of zinc Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/5cef11ac Tree:

spark git commit: fix security issue of zinc

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 6a06b8cce -> 8926c4a62 fix security issue of zinc Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8926c4a6 Tree:

spark git commit: fix security issue of zinc

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master f38594fc5 -> ec1fafe3e fix security issue of zinc Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ec1fafe3 Tree:

spark git commit: [SPARK-25768][SQL] fix constant argument expecting UDAFs

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.3 61b301cc7 -> 353d32804 [SPARK-25768][SQL] fix constant argument expecting UDAFs ## What changes were proposed in this pull request? Without this PR some UDAFs like `GenericUDAFPercentileApprox` can throw an exception because

spark git commit: [SPARK-25768][SQL] fix constant argument expecting UDAFs

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 df60d9f34 -> 6a06b8cce [SPARK-25768][SQL] fix constant argument expecting UDAFs ## What changes were proposed in this pull request? Without this PR some UDAFs like `GenericUDAFPercentileApprox` can throw an exception because

spark git commit: [SPARK-25768][SQL] fix constant argument expecting UDAFs

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master e8167768c -> f38594fc5 [SPARK-25768][SQL] fix constant argument expecting UDAFs ## What changes were proposed in this pull request? Without this PR some UDAFs like `GenericUDAFPercentileApprox` can throw an exception because expecting a

[1/2] spark git commit: [SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/branch-2.4 9ed2e4204 -> df60d9f34 http://git-wip-us.apache.org/repos/asf/spark/blob/df60d9f3/sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala --

[2/2] spark git commit: [SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature

2018-10-19 Thread wenchen
[SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature ## What changes were proposed in this pull request? This is a follow-up PR for #22259. The extra field added in `ScalaUDF` with the original PR was declared optional, but should be indeed required, otherwise callers of `ScalaUDF`'s

[1/2] spark git commit: [SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature

2018-10-19 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 6e0fc8b0f -> e8167768c http://git-wip-us.apache.org/repos/asf/spark/blob/e8167768/sql/core/src/main/scala/org/apache/spark/sql/expressions/UserDefinedFunction.scala -- diff

[2/2] spark git commit: [SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature

2018-10-19 Thread wenchen
[SPARK-25044][FOLLOW-UP] Change ScalaUDF constructor signature ## What changes were proposed in this pull request? This is a follow-up PR for #22259. The extra field added in `ScalaUDF` with the original PR was declared optional, but should be indeed required, otherwise callers of `ScalaUDF`'s

svn commit: r30157 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_04_02-6e0fc8b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 11:17:07 2018 New Revision: 30157 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_04_02-6e0fc8b docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r30156 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_19_02_02-9ed2e42-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 09:17:01 2018 New Revision: 30156 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_19_02_02-9ed2e42 docs [This commit notification would consist of 1478 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25560][SQL] Allow FunctionInjection in SparkExtensions

2018-10-19 Thread hvanhovell
Repository: spark Updated Branches: refs/heads/master c8f7691c6 -> 6e0fc8b0f [SPARK-25560][SQL] Allow FunctionInjection in SparkExtensions This allows an implementer of Spark Session Extensions to utilize a method "injectFunction" which will add a new function to the default Spark Session

svn commit: r30154 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_19_00_02-c8f7691-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-19 Thread pwendell
Author: pwendell Date: Fri Oct 19 07:17:24 2018 New Revision: 30154 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_19_00_02-c8f7691 docs [This commit notification would consist of 1484 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]