spark git commit: [SPARK-21322][SQL] support histogram in filter cardinality estimation

2017-12-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master a4002651a -> ecc179eca [SPARK-21322][SQL] support histogram in filter cardinality estimation ## What changes were proposed in this pull request? Histogram is effective in dealing with skewed distribution. After we generate histogram

svn commit: r23597 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_11_20_01-a400265-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-11 Thread pwendell
Author: pwendell Date: Tue Dec 12 04:15:29 2017 New Revision: 23597 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_11_20_01-a400265 docs [This commit notification would consist of 1406 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-20557][SQL] Only support TIMESTAMP WITH TIME ZONE for Oracle Dialect

2017-12-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3d82f6eb7 -> a4002651a [SPARK-20557][SQL] Only support TIMESTAMP WITH TIME ZONE for Oracle Dialect ## What changes were proposed in this pull request? In the previous PRs, https://github.com/apache/spark/pull/17832 and

svn commit: r23554 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_11_16_01-3d82f6e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-11 Thread pwendell
Author: pwendell Date: Tue Dec 12 00:14:30 2017 New Revision: 23554 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_11_16_01-3d82f6e docs [This commit notification would consist of 1406 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[2/2] spark git commit: [SPARK-22726][TEST] Basic tests for Binary Comparison and ImplicitTypeCasts

2017-12-11 Thread lixiao
[SPARK-22726][TEST] Basic tests for Binary Comparison and ImplicitTypeCasts ## What changes were proposed in this pull request? Before we deliver the Hive compatibility mode, we plan to write a set of test cases that can be easily run in both Spark and Hive sides. We can easily compare whether

[1/2] spark git commit: [SPARK-22726][TEST] Basic tests for Binary Comparison and ImplicitTypeCasts

2017-12-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 3f4060c34 -> 3d82f6eb7 http://git-wip-us.apache.org/repos/asf/spark/blob/3d82f6eb/sql/core/src/test/resources/sql-tests/results/typeCoercion/native/implicitTypeCasts.sql.out

[1/2] spark git commit: [SPARK-22646][K8S] Spark on Kubernetes - basic submission client

2017-12-11 Thread vanzin
Repository: spark Updated Branches: refs/heads/master c235b5f97 -> 3f4060c34 http://git-wip-us.apache.org/repos/asf/spark/blob/3f4060c3/resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverKubernetesCredentialsStep.scala

spark git commit: [SPARK-22746][SQL] Avoid the generation of useless mutable states by SortMergeJoin

2017-12-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master a04f2bea6 -> c235b5f97 [SPARK-22746][SQL] Avoid the generation of useless mutable states by SortMergeJoin ## What changes were proposed in this pull request? This PR reduce the number of global mutable variables in generated code of

spark git commit: Revert "[SPARK-22496][SQL] thrift server adds operation logs"

2017-12-11 Thread lixiao
Repository: spark Updated Branches: refs/heads/master bf20abb2d -> a04f2bea6 Revert "[SPARK-22496][SQL] thrift server adds operation logs" This reverts commit 4289ac9d8dbbc45fc2ee6d0250a2113107bf08d0. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

svn commit: r23551 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_11_12_01-bf20abb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-11 Thread pwendell
Author: pwendell Date: Mon Dec 11 20:14:27 2017 New Revision: 23551 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_11_12_01-bf20abb docs [This commit notification would consist of 1406 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22642][SQL] the createdTempDir will not be deleted if an exception occurs, should delete it with try-finally.

2017-12-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 6cc7021a4 -> bf20abb2d [SPARK-22642][SQL] the createdTempDir will not be deleted if an exception occurs, should delete it with try-finally. ## What changes were proposed in this pull request? We found staging directories will not be

svn commit: r23507 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_11_08_01-6cc7021-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-11 Thread pwendell
Author: pwendell Date: Mon Dec 11 16:17:12 2017 New Revision: 23507 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_11_08_01-6cc7021 docs [This commit notification would consist of 1406 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22267][SQL][TEST] Spark SQL incorrectly reads ORC files when column order is different

2017-12-11 Thread wenchen
Repository: spark Updated Branches: refs/heads/master ec873a4fd -> 6cc7021a4 [SPARK-22267][SQL][TEST] Spark SQL incorrectly reads ORC files when column order is different ## What changes were proposed in this pull request? Until 2.2.1, with the default configuration, Apache Spark returns

spark git commit: [SPARK-14516][FOLLOWUP] Adding ClusteringEvaluator to examples

2017-12-11 Thread srowen
Repository: spark Updated Branches: refs/heads/master 4289ac9d8 -> ec873a4fd [SPARK-14516][FOLLOWUP] Adding ClusteringEvaluator to examples ## What changes were proposed in this pull request? In SPARK-14516 we have introduced ClusteringEvaluator, but we didn't put any reference in the

svn commit: r23493 - in /dev/spark/2.3.0-SNAPSHOT-2017_12_11_00_01-4289ac9-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2017-12-11 Thread pwendell
Author: pwendell Date: Mon Dec 11 08:14:59 2017 New Revision: 23493 Log: Apache Spark 2.3.0-SNAPSHOT-2017_12_11_00_01-4289ac9 docs [This commit notification would consist of 1406 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]