spark git commit: [SPARK-22753][SQL] Get rid of dataSource.writeAndRead

Repository: spark Updated Branches: refs/heads/master 3fea5c4f1 -> 3775dd31e [SPARK-22753][SQL] Get rid of dataSource.writeAndRead ## What changes were proposed in this pull request? As the discussion in https://github.com/apache/spark/pull/16481 and

spark git commit: [SPARK-22787][TEST][SQL] Add a TPC-H query suite

Repository: spark Updated Branches: refs/heads/master 0ea2d8c12 -> 3fea5c4f1 [SPARK-22787][TEST][SQL] Add a TPC-H query suite ## What changes were proposed in this pull request? Add a test suite to ensure all the TPC-H queries can be successfully analyzed, optimized and compiled without

spark-website git commit: Empty commit to trigger Spark website sync

Repository: spark-website Updated Branches: refs/heads/asf-site 49992614f -> 71e766a3f Empty commit to trigger Spark website sync Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/71e766a3 Tree:

svn commit: r23741 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_14_16_01-0ea2d8c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Fri Dec 15 00:14:51 2017 New Revision: 23741 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_14_16_01-0ea2d8c docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22496][SQL] thrift server adds operation logs

Repository: spark Updated Branches: refs/heads/master 59daf91b7 -> 0ea2d8c12 [SPARK-22496][SQL] thrift server adds operation logs ## What changes were proposed in this pull request? since hive 2.0+ upgrades log4j to log4j2，a lot of

spark git commit: [SPARK-22733] Split StreamExecution into MicroBatchExecution and StreamExecution.

Repository: spark Updated Branches: refs/heads/master 2fe16333d -> 59daf91b7 [SPARK-22733] Split StreamExecution into MicroBatchExecution and StreamExecution. ## What changes were proposed in this pull request? StreamExecution is now an abstract base class, which MicroBatchExecution (the

spark git commit: [SPARK-22778][KUBERNETES] Added the missing service metadata for KubernetesClusterManager

Repository: spark Updated Branches: refs/heads/master 6d9994039 -> 2fe16333d [SPARK-22778][KUBERNETES] Added the missing service metadata for KubernetesClusterManager ## What changes were proposed in this pull request? This PR added the missing service metadata for

svn commit: r23736 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_14_12_01-6d99940-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Dec 14 20:14:43 2017 New Revision: 23736 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_14_12_01-6d99940 docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22660][BUILD] Use position() and limit() to fix ambiguity issue in scala-2.12

Repository: spark Updated Branches: refs/heads/master 40de176c9 -> 6d9994039 [SPARK-22660][BUILD] Use position() and limit() to fix ambiguity issue in scala-2.12 ## What changes were proposed in this pull request? Missing some changes about limit in TaskSetManager.scala ## How was this

spark git commit: [SPARK-16496][SQL] Add wholetext as option for reading text in SQL.

Repository: spark Updated Branches: refs/heads/master 606ae491e -> 40de176c9 [SPARK-16496][SQL] Add wholetext as option for reading text in SQL. ## What changes were proposed in this pull request? In multiple text analysis problems, it is not often desirable for the rows to be split by

spark git commit: [SPARK-22774][SQL][TEST] Add compilation check into TPCDSQuerySuite

Repository: spark Updated Branches: refs/heads/master d09579543 -> 606ae491e [SPARK-22774][SQL][TEST] Add compilation check into TPCDSQuerySuite ## What changes were proposed in this pull request? This PR adds check whether Java code generated by Catalyst can be compiled by `janino`

spark git commit: [SPARK-22785][SQL] remove ColumnVector.anyNullsSet

Repository: spark Updated Branches: refs/heads/master 7d8e2ca7f -> d09579543 [SPARK-22785][SQL] remove ColumnVector.anyNullsSet ## What changes were proposed in this pull request? `ColumnVector.anyNullsSet` is not called anywhere except tests, and we can easily replace it with

[28/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/index.html -- diff --git a/site/docs/2.2.1/api/java/index.html b/site/docs/2.2.1/api/java/index.html new file mode 100644 index

[30/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/constant-values.html -- diff --git a/site/docs/2.2.1/api/java/constant-values.html b/site/docs/2.2.1/api/java/constant-values.html new

[38/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/sd.html -- diff --git a/site/docs/2.2.1/api/R/sd.html b/site/docs/2.2.1/api/R/sd.html new file mode 100644 index 000..393b819 ---

[47/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/arrange.html -- diff --git a/site/docs/2.2.1/api/R/arrange.html b/site/docs/2.2.1/api/R/arrange.html new file mode 100644 index

[31/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.2.1/api/java/allclasses-noframe.html

[11/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/TaskKilledException.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/TaskKilledException.html

[14/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/SparkFirehoseListener.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/SparkFirehoseListener.html

[23/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/CleanShuffle.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/CleanShuffle.html

[26/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/Accumulable.html

[48/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/00frame_toc.html -- diff --git a/site/docs/2.2.1/api/R/00frame_toc.html b/site/docs/2.2.1/api/R/00frame_toc.html new file mode 100644 index

[33/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/write.jdbc.html -- diff --git a/site/docs/2.2.1/api/R/write.jdbc.html b/site/docs/2.2.1/api/R/write.jdbc.html new file mode 100644 index

[37/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/spark.bisectingKmeans.html -- diff --git a/site/docs/2.2.1/api/R/spark.bisectingKmeans.html

[16/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/SparkContext.html

[45/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/crossJoin.html -- diff --git a/site/docs/2.2.1/api/R/crossJoin.html b/site/docs/2.2.1/api/R/crossJoin.html new file mode 100644 index

[19/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/NarrowDependency.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/NarrowDependency.html

[36/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/spark.randomForest.html -- diff --git a/site/docs/2.2.1/api/R/spark.randomForest.html b/site/docs/2.2.1/api/R/spark.randomForest.html new

[01/51] [partial] spark-website git commit: 2.2.1 generated doc

Repository: spark-website Updated Branches: refs/heads/asf-site c312ef84e -> 49992614f http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/function/ForeachFunction.html

[44/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/encode.html -- diff --git a/site/docs/2.2.1/api/R/encode.html b/site/docs/2.2.1/api/R/encode.html new file mode 100644 index

[08/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaNewHadoopRDD.html

[29/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/index-all.html -- diff --git a/site/docs/2.2.1/api/java/index-all.html b/site/docs/2.2.1/api/java/index-all.html new file mode 100644

[17/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/SparkConf.html

[40/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/ntile.html -- diff --git a/site/docs/2.2.1/api/R/ntile.html b/site/docs/2.2.1/api/R/ntile.html new file mode 100644 index 000..2dc30e3

[34/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/translate.html -- diff --git a/site/docs/2.2.1/api/R/translate.html b/site/docs/2.2.1/api/R/translate.html new file mode 100644 index

[18/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/Resubmitted.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/Resubmitted.html

[25/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[04/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaSparkContext.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaSparkContext.html

[07/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaPairRDD.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaPairRDD.html

[15/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/SparkEnv.html

[24/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/Aggregator.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/Aggregator.html

[35/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/structField.html -- diff --git a/site/docs/2.2.1/api/R/structField.html b/site/docs/2.2.1/api/R/structField.html new file mode 100644 index

[12/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/TaskCommitDenied.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/TaskCommitDenied.html

[09/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaFutureAction.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaFutureAction.html

[20/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/InternalAccumulator.output$.html -- diff --git

[49/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/00Index.html -- diff --git a/site/docs/2.2.1/api/R/00Index.html b/site/docs/2.2.1/api/R/00Index.html new file mode 100644 index

[06/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaRDD.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaRDD.html

[43/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/gapplyCollect.html -- diff --git a/site/docs/2.2.1/api/R/gapplyCollect.html b/site/docs/2.2.1/api/R/gapplyCollect.html new file mode 100644

[39/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/read.parquet.html -- diff --git a/site/docs/2.2.1/api/R/read.parquet.html b/site/docs/2.2.1/api/R/read.parquet.html new file mode 100644

[13/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/SparkStageInfoImpl.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/SparkStageInfoImpl.html

[42/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/intersect.html -- diff --git a/site/docs/2.2.1/api/R/intersect.html b/site/docs/2.2.1/api/R/intersect.html new file mode 100644 index

[02/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/function/CoGroupFunction.html -- diff --git

[10/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaDoubleRDD.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaDoubleRDD.html

[21/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/FetchFailed.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/FetchFailed.html

[03/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaSparkStatusTracker.html -- diff --git

[22/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/ExceptionFailure.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/ExceptionFailure.html

[41/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/R/log1p.html -- diff --git a/site/docs/2.2.1/api/R/log1p.html b/site/docs/2.2.1/api/R/log1p.html new file mode 100644 index 000..bb9396b

[05/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaRDDLike.html -- diff --git a/site/docs/2.2.1/api/java/org/apache/spark/api/java/JavaRDDLike.html

[50/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/README.md -- diff --git a/site/docs/2.2.1/README.md b/site/docs/2.2.1/README.md new file mode 100644 index 000..90e10a1 --- /dev/null +++

[32/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/allclasses-frame.html -- diff --git a/site/docs/2.2.1/api/java/allclasses-frame.html b/site/docs/2.2.1/api/java/allclasses-frame.html new

[27/51] [partial] spark-website git commit: 2.2.1 generated doc

http://git-wip-us.apache.org/repos/asf/spark-website/blob/49992614/site/docs/2.2.1/api/java/lib/jquery.js -- diff --git a/site/docs/2.2.1/api/java/lib/jquery.js b/site/docs/2.2.1/api/java/lib/jquery.js new file mode 100644 index

svn commit: r23725 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_14_04_01-7d8e2ca-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Dec 14 12:16:20 2017 New Revision: 23725 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_14_04_01-7d8e2ca docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22775][SQL] move dictionary related APIs from ColumnVector to WritableColumnVector

Repository: spark Updated Branches: refs/heads/master c3dd2a26d -> 7d8e2ca7f [SPARK-22775][SQL] move dictionary related APIs from ColumnVector to WritableColumnVector ## What changes were proposed in this pull request? These dictionary related APIs are special to `WritableColumnVector` and

svn commit: r23724 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_14_00_01-c3dd2a2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Thu Dec 14 08:15:03 2017 New Revision: 23724 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_14_00_01-c3dd2a2 docs [This commit notification would consist of 1414 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]