svn commit: r26841 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_10_20_01-75cf369-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri May 11 03:15:44 2018 New Revision: 26841 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_10_20_01-75cf369 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26840 - in /dev/spark/2.3.1-SNAPSHOT-2018_05_10_18_01-414e4e3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri May 11 01:15:34 2018 New Revision: 26840 Log: Apache Spark 2.3.1-SNAPSHOT-2018_05_10_18_01-414e4e3 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24197][SPARKR][SQL] Adding array_sort function to SparkR

Repository: spark Updated Branches: refs/heads/master a4206d58e -> 75cf369c7 [SPARK-24197][SPARKR][SQL] Adding array_sort function to SparkR ## What changes were proposed in this pull request? The PR adds array_sort function to SparkR. ## How was this patch tested? Tests added into

spark git commit: [SPARK-22938][SQL][FOLLOWUP] Assert that SQLConf.get is accessed only on the driver

Repository: spark Updated Branches: refs/heads/master d3c426a5b -> a4206d58e [SPARK-22938][SQL][FOLLOWUP] Assert that SQLConf.get is accessed only on the driver ## What changes were proposed in this pull request? This is a followup of https://github.com/apache/spark/pull/20136 . #20136

svn commit: r26838 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_10_16_01-d3c426a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu May 10 23:16:23 2018 New Revision: 26838 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_10_16_01-d3c426a docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-10878][CORE] Fix race condition when multiple clients resolves artifacts at the same time

Repository: spark Updated Branches: refs/heads/branch-2.3 4c49b12da -> 414e4e3d7 [SPARK-10878][CORE] Fix race condition when multiple clients resolves artifacts at the same time ## What changes were proposed in this pull request? When multiple clients attempt to resolve artifacts via the

spark git commit: [SPARK-10878][CORE] Fix race condition when multiple clients resolves artifacts at the same time

Repository: spark Updated Branches: refs/heads/master 3e2600538 -> d3c426a5b [SPARK-10878][CORE] Fix race condition when multiple clients resolves artifacts at the same time ## What changes were proposed in this pull request? When multiple clients attempt to resolve artifacts via the

spark git commit: [SPARK-19181][CORE] Fixing flaky "SparkListenerSuite.local metrics"

Repository: spark Updated Branches: refs/heads/master 6282fc64e -> 3e2600538 [SPARK-19181][CORE] Fixing flaky "SparkListenerSuite.local metrics" ## What changes were proposed in this pull request? Sometimes "SparkListenerSuite.local metrics" test fails because the average of

spark git commit: [SPARK-19181][CORE] Fixing flaky "SparkListenerSuite.local metrics"

Repository: spark Updated Branches: refs/heads/branch-2.3 16cd9ac52 -> 4c49b12da [SPARK-19181][CORE] Fixing flaky "SparkListenerSuite.local metrics" ## What changes were proposed in this pull request? Sometimes "SparkListenerSuite.local metrics" test fails because the average of

svn commit: r26837 - in /dev/spark/2.3.1-SNAPSHOT-2018_05_10_14_01-16cd9ac-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu May 10 21:15:50 2018 New Revision: 26837 Log: Apache Spark 2.3.1-SNAPSHOT-2018_05_10_14_01-16cd9ac docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26835 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_10_12_01-6282fc6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu May 10 19:15:10 2018 New Revision: 26835 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_10_12_01-6282fc6 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24137][K8S] Mount local directories as empty dir volumes.

Repository: spark Updated Branches: refs/heads/master f4fed0512 -> 6282fc64e [SPARK-24137][K8S] Mount local directories as empty dir volumes. ## What changes were proposed in this pull request? Drastically improves performance and won't cause Spark applications to fail because they write

[2/2] spark git commit: [PYSPARK] Update py4j to version 0.10.7.

[PYSPARK] Update py4j to version 0.10.7. (cherry picked from commit cc613b552e753d03cb62661591de59e1c8d82c74) Signed-off-by: Marcelo Vanzin Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/323dc3ad Tree:

[1/2] spark git commit: [SPARKR] Match pyspark features in SparkR communication protocol.

Repository: spark Updated Branches: refs/heads/branch-2.3 eab10f994 -> 16cd9ac52 [SPARKR] Match pyspark features in SparkR communication protocol. (cherry picked from commit 628c7b517969c4a7ccb26ea67ab3dd61266073ca) Signed-off-by: Marcelo Vanzin Project:

svn commit: r26831 - in /dev/spark/2.3.1-SNAPSHOT-2018_05_10_10_01-eab10f9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu May 10 17:15:43 2018 New Revision: 26831 Log: Apache Spark 2.3.1-SNAPSHOT-2018_05_10_10_01-eab10f9 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24171] Adding a note for non-deterministic functions

Repository: spark Updated Branches: refs/heads/master 94d671448 -> f4fed0512 [SPARK-24171] Adding a note for non-deterministic functions ## What changes were proposed in this pull request? I propose to add a clear statement for functions like `collect_list()` about non-deterministic

spark git commit: [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader's options to Text datasource on schema inferring

Repository: spark Updated Branches: refs/heads/branch-2.3 8889d7864 -> eab10f994 [SPARK-24068][BACKPORT-2.3] Propagating DataFrameReader's options to Text datasource on schema inferring ## What changes were proposed in this pull request? While reading CSV or JSON files, DataFrameReader's

svn commit: r26830 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_10_08_01-94d6714-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu May 10 15:16:10 2018 New Revision: 26830 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_10_08_01-94d6714 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23907][SQL] Add regr_* functions

Repository: spark Updated Branches: refs/heads/master e3d434994 -> 94d671448 [SPARK-23907][SQL] Add regr_* functions ## What changes were proposed in this pull request? The PR introduces regr_slope, regr_intercept, regr_r2, regr_sxx, regr_syy, regr_sxy, regr_avgx, regr_avgy, regr_count.