svn commit: r28870 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_20_20_02-f984ec7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-20 Thread pwendell
Author: pwendell Date: Tue Aug 21 03:16:12 2018 New Revision: 28870 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_20_20_02-f984ec7 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25132][SQL] Case-insensitive field resolution when reading from Parquet

2018-08-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master b461acb2d -> f984ec75e [SPARK-25132][SQL] Case-insensitive field resolution when reading from Parquet ## What changes were proposed in this pull request? Spark SQL returns NULL for a column whose Hive metastore schema and Parquet schema

spark git commit: [SPARK-25134][SQL] Csv column pruning with checking of headers throws incorrect error

2018-08-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 883f3aff6 -> b461acb2d [SPARK-25134][SQL] Csv column pruning with checking of headers throws incorrect error ## What changes were proposed in this pull request? When column pruning is turned on the checking of headers in the csv should

spark git commit: [SPARK-25144][SQL][TEST] Free aggregate map when task ends

2018-08-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 219ed7b48 -> 883f3aff6 [SPARK-25144][SQL][TEST] Free aggregate map when task ends ## What changes were proposed in this pull request? [SPARK-25144](https://issues.apache.org/jira/browse/SPARK-25144) reports memory leaks on Apache Spark

svn commit: r28867 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_20_16_01-219ed7b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-20 Thread pwendell
Author: pwendell Date: Mon Aug 20 23:15:57 2018 New Revision: 28867 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_20_16_01-219ed7b docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28862 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_20_14_02-9702bb6-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-20 Thread pwendell
Author: pwendell Date: Mon Aug 20 21:15:36 2018 New Revision: 28862 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_20_14_02-9702bb6 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [DOCS] Fixed NDCG formula issues

2018-08-20 Thread srowen
Repository: spark Updated Branches: refs/heads/master 60af2501e -> 219ed7b48 [DOCS] Fixed NDCG formula issues When j is 0, log(j+1) will be 0, and this leads to division by 0 issue. ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was

spark git commit: [DOCS] Fixed NDCG formula issues

2018-08-20 Thread srowen
Repository: spark Updated Branches: refs/heads/branch-2.3 ea01e362f -> 9702bb637 [DOCS] Fixed NDCG formula issues When j is 0, log(j+1) will be 0, and this leads to division by 0 issue. ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

svn commit: r28853 - in /dev/spark/2.4.0-SNAPSHOT-2018_08_20_08_01-60af250-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-20 Thread pwendell
Author: pwendell Date: Mon Aug 20 15:16:36 2018 New Revision: 28853 Log: Apache Spark 2.4.0-SNAPSHOT-2018_08_20_08_01-60af250 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r28850 - in /dev/spark/2.3.3-SNAPSHOT-2018_08_20_06_02-ea01e36-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-08-20 Thread pwendell
Author: pwendell Date: Mon Aug 20 13:19:42 2018 New Revision: 28850 Log: Apache Spark 2.3.3-SNAPSHOT-2018_08_20_06_02-ea01e36 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25144][SQL][TEST][BRANCH-2.3] Free aggregate map when task ends

2018-08-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/branch-2.3 032f6d9ba -> ea01e362f [SPARK-25144][SQL][TEST][BRANCH-2.3] Free aggregate map when task ends ## What changes were proposed in this pull request? [SPARK-25144](https://issues.apache.org/jira/browse/SPARK-25144) reports memory leaks

spark git commit: [SPARK-25160][SQL] Avro: remove sql configuration spark.sql.avro.outputTimestampType

2018-08-20 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 6b8fbbfb1 -> 60af2501e [SPARK-25160][SQL] Avro: remove sql configuration spark.sql.avro.outputTimestampType ## What changes were proposed in this pull request? In the PR for supporting logical timestamp types