spark git commit: [SPARK-20220][DOCS] Documentation Add thrift scheduling pool config to scheduling docs

2018-07-16 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master d57a267b7 -> f876d3fa8 [SPARK-20220][DOCS] Documentation Add thrift scheduling pool config to scheduling docs ## What changes were proposed in this pull request? The thrift scheduling pool configuration was removed from a previous

spark git commit: [SPARK-23259][SQL] Clean up legacy code around hive external catalog and HiveClientImpl

2018-07-16 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 0f0d1865f -> d57a267b7 [SPARK-23259][SQL] Clean up legacy code around hive external catalog and HiveClientImpl ## What changes were proposed in this pull request? Three legacy statements are removed by this patch: - in

svn commit: r28159 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_16_16_01-0f0d186-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-16 Thread pwendell
Author: pwendell Date: Mon Jul 16 23:15:42 2018 New Revision: 28159 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_16_16_01-0f0d186 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty

2018-07-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master ba437fc5c -> 0f0d1865f [SPARK-24402][SQL] Optimize `In` expression when only one element in the collection or collection is empty ## What changes were proposed in this pull request? Two new rules in the logical plan optimizers are added.

spark git commit: [SPARK-24805][SQL] Do not ignore avro files without extensions by default

2018-07-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b0c95a1d6 -> ba437fc5c [SPARK-24805][SQL] Do not ignore avro files without extensions by default ## What changes were proposed in this pull request? In the PR, I propose to change default behaviour of AVRO datasource which currently

spark git commit: [SPARK-23901][SQL] Removing masking functions

2018-07-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master b045315e5 -> b0c95a1d6 [SPARK-23901][SQL] Removing masking functions The PR reverts #21246. Author: Marek Novotny Closes #21786 from mn-mikke/SPARK-23901. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

svn commit: r28155 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_16_12_01-b045315-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-16 Thread pwendell
Author: pwendell Date: Mon Jul 16 19:16:21 2018 New Revision: 28155 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_16_12_01-b045315 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28148 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_16_08_02-cf97045-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-16 Thread pwendell
Author: pwendell Date: Mon Jul 16 15:16:19 2018 New Revision: 28148 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_16_08_02-cf97045 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24734][SQL] Fix type coercions and nullabilities of nested data types of some functions.

2018-07-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master cf9704534 -> b045315e5 [SPARK-24734][SQL] Fix type coercions and nullabilities of nested data types of some functions. ## What changes were proposed in this pull request? We have some functions which need to aware the nullabilities of

spark git commit: [SPARK-18230][MLLIB] Throw a better exception, if the user or product doesn't exist

2018-07-16 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9549a2814 -> cf9704534 [SPARK-18230][MLLIB] Throw a better exception, if the user or product doesn't exist When invoking MatrixFactorizationModel.recommendProducts(Int, Int) with a non-existing user, a java.util.NoSuchElementException is

spark git commit: Update for spark 2.2.2 release

2018-07-16 Thread tgraves
Repository: spark Updated Branches: refs/heads/branch-2.2 4bc4ccd63 -> 17db57213 Update for spark 2.2.2 release Release process for Spark 2.2.2 say to update the test. Author: Thomas Graves Closes #21707 from tgravescs/spark222-release. Project:

svn commit: r28142 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_16_06_07-9549a28-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-16 Thread pwendell
Author: pwendell Date: Mon Jul 16 13:21:42 2018 New Revision: 28142 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_16_06_07-9549a28 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24549][SQL] Support Decimal type push down to the parquet data sources

2018-07-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 2603ae30b -> 9549a2814 [SPARK-24549][SQL] Support Decimal type push down to the parquet data sources ## What changes were proposed in this pull request? Support Decimal type push down to the parquet data sources. The Decimal comparator

svn commit: r28134 - in /dev/spark/2.4.0-SNAPSHOT-2018_07_16_00_02-2603ae3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-07-16 Thread pwendell
Author: pwendell Date: Mon Jul 16 07:17:15 2018 New Revision: 28134 Log: Apache Spark 2.4.0-SNAPSHOT-2018_07_16_00_02-2603ae3 docs [This commit notification would consist of 1467 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-24558][CORE] wrong Idle Timeout value is used in case of the cacheBlock.

2018-07-16 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 9f929458f -> 2603ae30b [SPARK-24558][CORE] wrong Idle Timeout value is used in case of the cacheBlock. It is corrected as per the configuration. ## What changes were proposed in this pull request? IdleTimeout info used to print in the

spark git commit: [SPARK-24810][SQL] Fix paths to test files in AvroSuite

2018-07-16 Thread lixiao
Repository: spark Updated Branches: refs/heads/master d463533de -> 9f929458f [SPARK-24810][SQL] Fix paths to test files in AvroSuite ## What changes were proposed in this pull request? In the PR, I propose to move `testFile()` to the common trait `SQLTestUtilsBase` and wrap test files in