svn commit: r24005 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_22_01-1860a43-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Jan 4 06:16:26 2018 New Revision: 24005 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_22_01-1860a43 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22933][SPARKR] R Structured Streaming API for withWatermark, trigger, partitionBy

Repository: spark Updated Branches: refs/heads/branch-2.3 f51c8fde8 -> 1860a43e9 [SPARK-22933][SPARKR] R Structured Streaming API for withWatermark, trigger, partitionBy ## What changes were proposed in this pull request? R Structured Streaming API for withWatermark, trigger, partitionBy

spark git commit: [SPARK-22933][SPARKR] R Structured Streaming API for withWatermark, trigger, partitionBy

Repository: spark Updated Branches: refs/heads/master 7d045c5f0 -> df95a908b [SPARK-22933][SPARKR] R Structured Streaming API for withWatermark, trigger, partitionBy ## What changes were proposed in this pull request? R Structured Streaming API for withWatermark, trigger, partitionBy ##

spark git commit: [SPARK-22944][SQL] improve FoldablePropagation

Repository: spark Updated Branches: refs/heads/branch-2.3 a51212b64 -> f51c8fde8 [SPARK-22944][SQL] improve FoldablePropagation ## What changes were proposed in this pull request? `FoldablePropagation` is a little tricky as it needs to handle attributes that are miss-derived from children,

spark git commit: [SPARK-22944][SQL] improve FoldablePropagation

Repository: spark Updated Branches: refs/heads/master b29702913 -> 7d045c5f0 [SPARK-22944][SQL] improve FoldablePropagation ## What changes were proposed in this pull request? `FoldablePropagation` is a little tricky as it needs to handle attributes that are miss-derived from children, e.g.

svn commit: r24004 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_18_01-a51212b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Jan 4 02:15:40 2018 New Revision: 24004 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_18_01-a51212b docs [This commit notification would consist of 1438 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark-website git commit: Updates to release process from 2.2.1 release

Repository: spark-website Updated Branches: refs/heads/asf-site 6557828a3 -> 13d8bd58a Updates to release process from 2.2.1 release Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/13d8bd58 Tree:

svn commit: r24000 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_16_01-b297029-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Jan 4 00:15:00 2018 New Revision: 24000 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_16_01-b297029 docs [This commit notification would consist of 1438 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark-website git commit: Remove SparkR from 3rd party project list

Repository: spark-website Updated Branches: refs/heads/asf-site c43cd4b56 -> 6557828a3 Remove SparkR from 3rd party project list Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/6557828a Tree:

[1/2] spark git commit: [SPARK-20960][SQL] make ColumnVector public

Repository: spark Updated Branches: refs/heads/branch-2.3 79f7263da -> a51212b64 http://git-wip-us.apache.org/repos/asf/spark/blob/a51212b6/sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarRow.java -- diff --git

[2/2] spark git commit: [SPARK-20960][SQL] make ColumnVector public

[SPARK-20960][SQL] make ColumnVector public ## What changes were proposed in this pull request? move `ColumnVector` and related classes to `org.apache.spark.sql.vectorized`, and improve the document. ## How was this patch tested? existing tests. Author: Wenchen Fan

[2/2] spark git commit: [SPARK-20960][SQL] make ColumnVector public

[SPARK-20960][SQL] make ColumnVector public ## What changes were proposed in this pull request? move `ColumnVector` and related classes to `org.apache.spark.sql.vectorized`, and improve the document. ## How was this patch tested? existing tests. Author: Wenchen Fan

[1/2] spark git commit: [SPARK-20960][SQL] make ColumnVector public

Repository: spark Updated Branches: refs/heads/master 9a2b65a3c -> b29702913 http://git-wip-us.apache.org/repos/asf/spark/blob/b2970291/sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarRow.java -- diff --git

svn commit: r23998 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_13_34-79f7263-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Jan 3 21:47:43 2018 New Revision: 23998 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_13_34-79f7263 docs [This commit notification would consist of 1431 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r23997 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_12_01-9a2b65a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Jan 3 20:17:02 2018 New Revision: 23997 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_12_01-9a2b65a docs [This commit notification would consist of 1431 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22896] Improvement in String interpolation

Repository: spark Updated Branches: refs/heads/branch-2.3 27c949d67 -> 79f7263da [SPARK-22896] Improvement in String interpolation ## What changes were proposed in this pull request? * String interpolation in ml pipeline example has been corrected as per scala standard. ## How was this

spark git commit: [SPARK-22896] Improvement in String interpolation

Repository: spark Updated Branches: refs/heads/master a66fe36ce -> 9a2b65a3c [SPARK-22896] Improvement in String interpolation ## What changes were proposed in this pull request? * String interpolation in ml pipeline example has been corrected as per scala standard. ## How was this patch

spark git commit: [SPARK-22932][SQL] Refactor AnalysisContext

Repository: spark Updated Branches: refs/heads/branch-2.3 b96248862 -> 27c949d67 [SPARK-22932][SQL] Refactor AnalysisContext ## What changes were proposed in this pull request? Add a `reset` function to ensure the state in `AnalysisContext ` is per-query. ## How was this patch tested? The

svn commit: r23992 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_03_08_01-a66fe36-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Wed Jan 3 16:18:14 2018 New Revision: 23992 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_03_08_01-a66fe36 docs [This commit notification would consist of 1431 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-20236][SQL] dynamic partition overwrite

Repository: spark Updated Branches: refs/heads/branch-2.3 a05e85ecb -> b96248862 [SPARK-20236][SQL] dynamic partition overwrite ## What changes were proposed in this pull request? When overwriting a partitioned table with dynamic partition columns, the behavior is different between data

spark git commit: [SPARK-20236][SQL] dynamic partition overwrite

Repository: spark Updated Branches: refs/heads/master 1a87a1609 -> a66fe36ce [SPARK-20236][SQL] dynamic partition overwrite ## What changes were proposed in this pull request? When overwriting a partitioned table with dynamic partition columns, the behavior is different between data source

spark git commit: [SPARK-22934][SQL] Make optional clauses order insensitive for CREATE TABLE SQL statement

Repository: spark Updated Branches: refs/heads/branch-2.3 b96a21324 -> a05e85ecb [SPARK-22934][SQL] Make optional clauses order insensitive for CREATE TABLE SQL statement ## What changes were proposed in this pull request? Currently, our CREATE TABLE syntax require the EXACT order of

spark git commit: [SPARK-22934][SQL] Make optional clauses order insensitive for CREATE TABLE SQL statement

Repository: spark Updated Branches: refs/heads/master 247a08939 -> 1a87a1609 [SPARK-22934][SQL] Make optional clauses order insensitive for CREATE TABLE SQL statement ## What changes were proposed in this pull request? Currently, our CREATE TABLE syntax require the EXACT order of clauses. It

spark git commit: [SPARK-22938] Assert that SQLConf.get is accessed only on the driver.

Repository: spark Updated Branches: refs/heads/branch-2.3 5244aafc2 -> b96a21324 [SPARK-22938] Assert that SQLConf.get is accessed only on the driver. ## What changes were proposed in this pull request? Assert if code tries to access SQLConf.get on executor. This can lead to hard to detect

spark git commit: [SPARK-22938] Assert that SQLConf.get is accessed only on the driver.

Repository: spark Updated Branches: refs/heads/master a6fc300e9 -> 247a08939 [SPARK-22938] Assert that SQLConf.get is accessed only on the driver. ## What changes were proposed in this pull request? Assert if code tries to access SQLConf.get on executor. This can lead to hard to detect bugs,