svn commit: r27222 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_16_01-8ef167a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 23:16:03 2018 New Revision: 27222 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_16_01-8ef167a docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27221 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_01_14_01-21800b8-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 21:16:28 2018 New Revision: 27221 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_01_14_01-21800b8 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27220 - in /dev/spark/v2.3.1-rc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 21:12:21 2018 New Revision: 27220 Log: Apache Spark v2.3.1-rc4 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27219 - /dev/spark/v2.3.1-rc4-bin/

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 20:59:55 2018 New Revision: 27219 Log: Apache Spark v2.3.1-rc4 Added: dev/spark/v2.3.1-rc4-bin/ dev/spark/v2.3.1-rc4-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc4-bin/SparkR_2.3.1.tar.gz.asc

spark git commit: [SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a Standalone cluster

2018-06-01 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 09e78c1ea -> 8ef167a5f [SPARK-24340][CORE] Clean up non-shuffle disk block manager files following executor exits on a Standalone cluster ## What changes were proposed in this pull request? Currently we only clean up the local

[2/2] spark git commit: Preparing development version 2.3.2-SNAPSHOT

2018-06-01 Thread vanzin
Preparing development version 2.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/21800b87 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/21800b87 Diff:

[1/2] spark git commit: Preparing Spark release v2.3.1-rc4

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 e4e96f929 -> 21800b878 Preparing Spark release v2.3.1-rc4 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/30aaa5a3 Tree:

[spark] Git Push Summary

2018-06-01 Thread vanzin
Repository: spark Updated Tags: refs/tags/v2.3.1-rc4 [created] 30aaa5a3a - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

svn commit: r27216 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_12_01-09e78c1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 19:16:14 2018 New Revision: 27216 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_12_01-09e78c1 docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [INFRA] Close stale PRs.

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/master d2c3de7ef -> 09e78c1ea [INFRA] Close stale PRs. Closes #21444 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/09e78c1e Tree:

svn commit: r27213 - /dev/spark/v2.3.1-rc3-bin/

2018-06-01 Thread vanzin
Author: vanzin Date: Fri Jun 1 18:19:42 2018 New Revision: 27213 Log: Apache Spark v2.3.1-rc3 Added: dev/spark/v2.3.1-rc3-bin/ dev/spark/v2.3.1-rc3-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc3-bin/SparkR_2.3.1.tar.gz.asc

[1/2] spark git commit: Preparing Spark release v2.3.1-rc3

2018-06-01 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 e56266ad7 -> 2e0c3469d Preparing Spark release v2.3.1-rc3 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/1cc5f68b Tree:

[2/2] spark git commit: Preparing development version 2.3.2-SNAPSHOT

2018-06-01 Thread vanzin
Preparing development version 2.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2e0c3469 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2e0c3469 Diff:

[spark] Git Push Summary

2018-06-01 Thread vanzin
Repository: spark Updated Tags: refs/tags/v2.3.1-rc3 [created] 1cc5f68be - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

spark git commit: [SPARK-24351][SS] offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode

2018-06-01 Thread zsxwing
Repository: spark Updated Branches: refs/heads/master 98909c398 -> 6039b1323 [SPARK-24351][SS] offsetLog/commitLog purge thresholdBatchId should be computed with current committed epoch but not currentBatchId in CP mode ## What changes were proposed in this pull request? Compute the

svn commit: r27210 - in /dev/spark/2.3.2-SNAPSHOT-2018_06_01_02_01-e56266a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 09:16:28 2018 New Revision: 27210 Log: Apache Spark 2.3.2-SNAPSHOT-2018_06_01_02_01-e56266a docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27209 - in /dev/spark/2.4.0-SNAPSHOT-2018_06_01_00_01-98909c3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-06-01 Thread pwendell
Author: pwendell Date: Fri Jun 1 07:16:46 2018 New Revision: 27209 Log: Apache Spark 2.4.0-SNAPSHOT-2018_06_01_00_01-98909c3 docs [This commit notification would consist of 1466 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24444][DOCS][PYTHON][BRANCH-2.3] Improve Pandas UDF docs to explain column assignment

2018-06-01 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 b37e76fa4 -> e56266ad7 [SPARK-2][DOCS][PYTHON][BRANCH-2.3] Improve Pandas UDF docs to explain column assignment ## What changes were proposed in this pull request? Added sections to pandas_udf docs, in the grouped map section, to