svn commit: r26942 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_20_01-8a13c50-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed May 16 03:16:07 2018 New Revision: 26942 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_20_01-8a13c50 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [R][BACKPORT-2.2] backport lint fix

Repository: spark Updated Branches: refs/heads/branch-2.2 f96d13dd6 -> 8c223b651 [R][BACKPORT-2.2] backport lint fix ## What changes were proposed in this pull request? backport part of the commit that addresses lintr issue Author: Felix Cheung Closes #21325

spark git commit: [SPARK-24058][ML][PYSPARK] Default Params in ML should be saved separately: Python API

Repository: spark Updated Branches: refs/heads/master 6b94420f6 -> 8a13c5096 [SPARK-24058][ML][PYSPARK] Default Params in ML should be saved separately: Python API ## What changes were proposed in this pull request? See SPARK-23455 for reference. Now default params in ML are saved

svn commit: r26941 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_16_01-6b94420-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 23:16:08 2018 New Revision: 26941 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_16_01-6b94420 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26937 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_12_01-3fabbc5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 19:16:26 2018 New Revision: 26937 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_12_01-3fabbc5 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26935 - in /dev/spark/v2.3.1-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

Author: vanzin Date: Tue May 15 17:34:24 2018 New Revision: 26935 Log: Apache Spark v2.3.1-rc1 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24040][SS] Support single partition aggregates in continuous processing.

Repository: spark Updated Branches: refs/heads/master d610d2a3f -> 3fabbc576 [SPARK-24040][SS] Support single partition aggregates in continuous processing. ## What changes were proposed in this pull request? Support aggregates with exactly 1 partition in continuous processing. A few small

svn commit: r26934 - /dev/spark/v2.3.1-rc1-bin/

Author: vanzin Date: Tue May 15 17:20:17 2018 New Revision: 26934 Log: Apache Spark v2.3.1-rc1 Added: dev/spark/v2.3.1-rc1-bin/ dev/spark/v2.3.1-rc1-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc1-bin/SparkR_2.3.1.tar.gz.asc

svn commit: r26933 - in /dev/spark/2.3.2-SNAPSHOT-2018_05_15_10_01-e16ab6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 17:16:30 2018 New Revision: 26933 Log: Apache Spark 2.3.2-SNAPSHOT-2018_05_15_10_01-e16ab6f docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r26932 - /dev/spark/2.3.1-2018_05_15_09_29-cc93bc9-bin/

Author: vanzin Date: Tue May 15 16:49:05 2018 New Revision: 26932 Log: Apache Spark 2.3.1-2018_05_15_09_29-cc93bc9 Added: dev/spark/2.3.1-2018_05_15_09_29-cc93bc9-bin/ dev/spark/2.3.1-2018_05_15_09_29-cc93bc9-bin/SparkR_2.3.1.tar.gz (with props)

svn commit: r26931 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_08_02-d610d2a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 15:22:02 2018 New Revision: 26931 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_08_02-d610d2a docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24259][SQL] ArrayWriter for Arrow produces wrong output

Repository: spark Updated Branches: refs/heads/branch-2.3 a886dc23a -> e16ab6fe0 [SPARK-24259][SQL] ArrayWriter for Arrow produces wrong output ## What changes were proposed in this pull request? Right now `ArrayWriter` used to output Arrow data for array type, doesn't do `clear` or `reset`

spark git commit: [SPARK-24259][SQL] ArrayWriter for Arrow produces wrong output

Repository: spark Updated Branches: refs/heads/master 4a2b15f0a -> d610d2a3f [SPARK-24259][SQL] ArrayWriter for Arrow produces wrong output ## What changes were proposed in this pull request? Right now `ArrayWriter` used to output Arrow data for array type, doesn't do `clear` or `reset`

svn commit: r26923 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_04_02-4a2b15f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 11:21:07 2018 New Revision: 26923 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_04_02-4a2b15f docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24241][SUBMIT] Do not fail fast when dynamic resource allocation enabled with 0 executor

Repository: spark Updated Branches: refs/heads/master 80c6d35a3 -> 4a2b15f0a [SPARK-24241][SUBMIT] Do not fail fast when dynamic resource allocation enabled with 0 executor ## What changes were proposed in this pull request? ``` ~/spark-2.3.0-bin-hadoop2.7$ bin/spark-sql --num-executors 0

svn commit: r26917 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_15_00_01-80c6d35-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue May 15 07:17:16 2018 New Revision: 26917 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_15_00_01-80c6d35 docs [This commit notification would consist of 1462 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-23627][SQL] Provide isEmpty in Dataset

Repository: spark Updated Branches: refs/heads/master 9059f1ee6 -> e29176fd7 [SPARK-23627][SQL] Provide isEmpty in Dataset ## What changes were proposed in this pull request? This PR adds isEmpty() in DataSet ## How was this patch tested? Unit tests added Please review