svn commit: r27056 - in /dev/spark/2.3.2-SNAPSHOT-2018_05_22_22_01-ed0060c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Wed May 23 05:16:15 2018 New Revision: 27056 Log: Apache Spark 2.3.2-SNAPSHOT-2018_05_22_22_01-ed0060c docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27053 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_22_20_01-00c13cf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Wed May 23 03:15:57 2018 New Revision: 27053 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_22_20_01-00c13cf docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: Correct reference to Offset class

2018-05-22 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 efe183f7b -> ed0060ce7 Correct reference to Offset class This is a documentation-only correction; `org.apache.spark.sql.sources.v2.reader.Offset` is actually `org.apache.spark.sql.sources.v2.reader.streaming.Offset`. Author: Seth

spark git commit: Correct reference to Offset class

2018-05-22 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 79e06faa4 -> 00c13cfad Correct reference to Offset class This is a documentation-only correction; `org.apache.spark.sql.sources.v2.reader.Offset` is actually `org.apache.spark.sql.sources.v2.reader.streaming.Offset`. Author: Seth

svn commit: r27052 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_22_16_01-79e06fa-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Tue May 22 23:16:20 2018 New Revision: 27052 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_22_16_01-79e06fa docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-19185][DSTREAMS] Avoid concurrent use of cached consumers in CachedKafkaConsumer

2018-05-22 Thread vanzin
Repository: spark Updated Branches: refs/heads/master bc6ea614a -> 79e06faa4 [SPARK-19185][DSTREAMS] Avoid concurrent use of cached consumers in CachedKafkaConsumer ## What changes were proposed in this pull request? `CachedKafkaConsumer` in the project streaming-kafka-0-10 is designed to

spark git commit: [SPARK-24348][SQL] "element_at" error fix

2018-05-22 Thread lixiao
Repository: spark Updated Branches: refs/heads/master f9f055afa -> bc6ea614a [SPARK-24348][SQL] "element_at" error fix ## What changes were proposed in this pull request? ### Fixes a `scala.MatchError` in the `element_at` operation -

svn commit: r27050 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_22_12_01-f9f055a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Tue May 22 19:17:24 2018 New Revision: 27050 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_22_12_01-f9f055a docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[1/2] spark git commit: [SPARK-24121][SQL] Add API for handling expression code generation

2018-05-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 8086acc2f -> f9f055afa http://git-wip-us.apache.org/repos/asf/spark/blob/f9f055af/sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/codegen/CodeBlockSuite.scala

[2/2] spark git commit: [SPARK-24121][SQL] Add API for handling expression code generation

2018-05-22 Thread wenchen
[SPARK-24121][SQL] Add API for handling expression code generation ## What changes were proposed in this pull request? This patch tries to implement this [proposal](https://github.com/apache/spark/pull/19813#issuecomment-354045400) to add an API for handling expression code generation. It

svn commit: r27047 - in /dev/spark/2.3.2-SNAPSHOT-2018_05_22_10_01-efe183f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Tue May 22 17:16:08 2018 New Revision: 27047 Log: Apache Spark 2.3.2-SNAPSHOT-2018_05_22_10_01-efe183f docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27048 - in /dev/spark/v2.3.1-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2018-05-22 Thread vanzin
Author: vanzin Date: Tue May 22 17:16:09 2018 New Revision: 27048 Log: Apache Spark v2.3.1-rc2 docs [This commit notification would consist of 1446 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r27046 - /dev/spark/v2.3.1-rc2-bin/

2018-05-22 Thread vanzin
Author: vanzin Date: Tue May 22 17:01:57 2018 New Revision: 27046 Log: Apache Spark v2.3.1-rc2 Added: dev/spark/v2.3.1-rc2-bin/ dev/spark/v2.3.1-rc2-bin/SparkR_2.3.1.tar.gz (with props) dev/spark/v2.3.1-rc2-bin/SparkR_2.3.1.tar.gz.asc

[1/2] spark git commit: Preparing Spark release v2.3.1-rc2

2018-05-22 Thread vanzin
Repository: spark Updated Branches: refs/heads/branch-2.3 70b866548 -> efe183f7b Preparing Spark release v2.3.1-rc2 Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/93258d80 Tree:

[spark] Git Push Summary

2018-05-22 Thread vanzin
Repository: spark Updated Tags: refs/tags/v2.3.1-rc2 [created] 93258d805 - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org

[2/2] spark git commit: Preparing development version 2.3.2-SNAPSHOT

2018-05-22 Thread vanzin
Preparing development version 2.3.2-SNAPSHOT Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/efe183f7 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/efe183f7 Diff:

svn commit: r27043 - in /dev/spark/2.4.0-SNAPSHOT-2018_05_22_08_01-8086acc-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-05-22 Thread pwendell
Author: pwendell Date: Tue May 22 15:15:24 2018 New Revision: 27043 Log: Apache Spark 2.4.0-SNAPSHOT-2018_05_22_08_01-8086acc docs [This commit notification would consist of 1463 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24244][SQL] Passing only required columns to the CSV parser

2018-05-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master fc743f7b3 -> 8086acc2f [SPARK-24244][SQL] Passing only required columns to the CSV parser ## What changes were proposed in this pull request? uniVocity parser allows to specify only required column names or indexes for

spark git commit: [SPARK-20120][SQL][FOLLOW-UP] Better way to support spark-sql silent mode.

2018-05-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master d3d180731 -> fc743f7b3 [SPARK-20120][SQL][FOLLOW-UP] Better way to support spark-sql silent mode. ## What changes were proposed in this pull request? `spark-sql` silent mode will broken if`SPARK_HOME/jars` missing

spark git commit: [SPARK-24313][SQL] Fix collection operations' interpreted evaluation for complex types

2018-05-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a4470bc78 -> d3d180731 [SPARK-24313][SQL] Fix collection operations' interpreted evaluation for complex types ## What changes were proposed in this pull request? The interpreted evaluation of several collection operations works only for

spark git commit: [SPARK-21673] Use the correct sandbox environment variable set by Mesos

2018-05-22 Thread srowen
Repository: spark Updated Branches: refs/heads/master 82fb5bfa7 -> a4470bc78 [SPARK-21673] Use the correct sandbox environment variable set by Mesos ## What changes were proposed in this pull request? This change changes spark behavior to use the correct environment variable set by Mesos in

spark git commit: [SPARK-20087][CORE] Attach accumulators / metrics to 'TaskKilled' end reason

2018-05-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 952e4d1c8 -> 82fb5bfa7 [SPARK-20087][CORE] Attach accumulators / metrics to 'TaskKilled' end reason ## What changes were proposed in this pull request? The ultimate goal is for listeners to onTaskEnd to receive metrics when a task is

spark git commit: [SPARK-24321][SQL] Extract common code from Divide/Remainder to a base trait

2018-05-22 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 84d31aa5d -> 952e4d1c8 [SPARK-24321][SQL] Extract common code from Divide/Remainder to a base trait ## What changes were proposed in this pull request? Extract common code from `Divide`/`Remainder` to a new base trait, `DivModLike`.