svn commit: r29922 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_06_18_02-c8b9409-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-06 Thread pwendell
Author: pwendell Date: Sun Oct 7 01:17:09 2018 New Revision: 29922 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_06_18_02-c8b9409 docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29919 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_06_16_02-8bb2429-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-06 Thread pwendell
Author: pwendell Date: Sat Oct 6 23:16:47 2018 New Revision: 29919 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_06_16_02-8bb2429 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25671] Build external/spark-ganglia-lgpl in Jenkins Test

2018-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/branch-2.4 48e2e6fcc -> c8b94099a [SPARK-25671] Build external/spark-ganglia-lgpl in Jenkins Test ## What changes were proposed in this pull request? Currently, we do not build external/spark-ganglia-lgpl in Jenkins tests when the code is

spark git commit: [SPARK-25671] Build external/spark-ganglia-lgpl in Jenkins Test

2018-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 756a3ab18 -> 8bb242902 [SPARK-25671] Build external/spark-ganglia-lgpl in Jenkins Test ## What changes were proposed in this pull request? Currently, we do not build external/spark-ganglia-lgpl in Jenkins tests when the code is changed.

spark git commit: [SPARK-25575][WEBUI][FOLLOWUP] SQL tab in the spark UI support hide tables

2018-10-06 Thread srowen
Repository: spark Updated Branches: refs/heads/master b0cee9605 -> 756a3ab18 [SPARK-25575][WEBUI][FOLLOWUP] SQL tab in the spark UI support hide tables ## What changes were proposed in this pull request? After the PR, https://github.com/apache/spark/pull/22592, SQL tab supports collapsing

spark git commit: [SPARK-25062][SQL] Clean up BlockLocations in InMemoryFileIndex

2018-10-06 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 9cbf105ab -> b0cee9605 [SPARK-25062][SQL] Clean up BlockLocations in InMemoryFileIndex ## What changes were proposed in this pull request? `InMemoryFileIndex` contains a cache of `LocatedFileStatus` objects. Each `LocatedFileStatus`

svn commit: r29918 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_06_12_02-9cbf105-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-06 Thread pwendell
Author: pwendell Date: Sat Oct 6 19:16:50 2018 New Revision: 29918 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_06_12_02-9cbf105 docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r29917 - in /dev/spark/2.4.1-SNAPSHOT-2018_10_06_10_02-48e2e6f-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-06 Thread pwendell
Author: pwendell Date: Sat Oct 6 17:17:07 2018 New Revision: 29917 Log: Apache Spark 2.4.1-SNAPSHOT-2018_10_06_10_02-48e2e6f docs [This commit notification would consist of 1472 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25644][SS][FOLLOWUP][BUILD] Fix Scala 2.12 build error due to foreachBatch

2018-10-06 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 5a617ec4e -> 9cbf105ab [SPARK-25644][SS][FOLLOWUP][BUILD] Fix Scala 2.12 build error due to foreachBatch ## What changes were proposed in this pull request? This PR fixes the Scala-2.12 build error due to ambiguity in `foreachBatch`

spark git commit: [SPARK-25644][SS][FOLLOWUP][BUILD] Fix Scala 2.12 build error due to foreachBatch

2018-10-06 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 a2991d233 -> 48e2e6fcc [SPARK-25644][SS][FOLLOWUP][BUILD] Fix Scala 2.12 build error due to foreachBatch ## What changes were proposed in this pull request? This PR fixes the Scala-2.12 build error due to ambiguity in `foreachBatch`

spark git commit: [MINOR] Clean up the joinCriteria in SQL parser

2018-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master 7ef65c053 -> 5a617ec4e [MINOR] Clean up the joinCriteria in SQL parser ## What changes were proposed in this pull request? Clean up the joinCriteria parsing in the parser by directly using identifierList ## How was this patch tested? N/A

spark-website git commit: improve the document about contributing to bug reports

2018-10-06 Thread srowen
Repository: spark-website Updated Branches: refs/heads/asf-site 9ba1fcee8 -> a45ba4718 improve the document about contributing to bug reports Recently we hit many correctness bugs, and some of them do not get enough attention. I want to highlight the importance of data correctness/data loss

spark git commit: [HOT-FIX] Fix compilation errors.

2018-10-06 Thread lixiao
Repository: spark Updated Branches: refs/heads/master edf428661 -> 7ef65c053 [HOT-FIX] Fix compilation errors. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7ef65c05 Tree:

spark git commit: [SPARK-25488][SQL][TEST] Refactor MiscBenchmark to use main method

2018-10-06 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 1ee472eec -> edf428661 [SPARK-25488][SQL][TEST] Refactor MiscBenchmark to use main method ## What changes were proposed in this pull request? Refactor `MiscBenchmark ` to use main method. Generate benchmark result: ```sh

svn commit: r29905 - in /dev/spark/3.0.0-SNAPSHOT-2018_10_06_00_02-1ee472e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-10-06 Thread pwendell
Author: pwendell Date: Sat Oct 6 07:17:00 2018 New Revision: 29905 Log: Apache Spark 3.0.0-SNAPSHOT-2018_10_06_00_02-1ee472e docs [This commit notification would consist of 1485 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-25621][SPARK-25622][TEST] Reduce test time of BucketedReadWithHiveSupportSuite

2018-10-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master f2f4e7afe -> 1ee472eec [SPARK-25621][SPARK-25622][TEST] Reduce test time of BucketedReadWithHiveSupportSuite ## What changes were proposed in this pull request? By replacing loops with random possible value. - `read partitioning bucketed

spark git commit: [SPARK-25600][SQL][MINOR] Make use of TypeCoercion.findTightestCommonType while inferring CSV schema.

2018-10-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 17781d753 -> f2f4e7afe [SPARK-25600][SQL][MINOR] Make use of TypeCoercion.findTightestCommonType while inferring CSV schema. ## What changes were proposed in this pull request? Current the CSV's infer schema code inlines

spark git commit: [SPARK-25202][SQL] Implements split with limit sql function

2018-10-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 44cf800c8 -> 17781d753 [SPARK-25202][SQL] Implements split with limit sql function ## What changes were proposed in this pull request? Adds support for the setting limit in the sql split function ## How was this patch tested? 1. Updated

spark git commit: [SPARK-25655][BUILD] Add -Pspark-ganglia-lgpl to the scala style check.

2018-10-06 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 58287a398 -> 44cf800c8 [SPARK-25655][BUILD] Add -Pspark-ganglia-lgpl to the scala style check. ## What changes were proposed in this pull request? Our lint failed due to the following errors: ``` [INFO] ---