svn commit: r31468 - in /dev/spark/2.4.1-SNAPSHOT-2018_12_08_21_29-a073b1c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-12-08 Thread pwendell
Author: pwendell Date: Sun Dec 9 05:44:02 2018 New Revision: 31468 Log: Apache Spark 2.4.1-SNAPSHOT-2018_12_08_21_29-a073b1c docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r31467 - in /dev/spark/3.0.0-SNAPSHOT-2018_12_08_19_24-877f82c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-12-08 Thread pwendell
Author: pwendell Date: Sun Dec 9 03:36:52 2018 New Revision: 31467 Log: Apache Spark 3.0.0-SNAPSHOT-2018_12_08_19_24-877f82c docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-26193][SQL] Implement shuffle write metrics in SQL

2018-12-08 Thread wenchen
Repository: spark Updated Branches: refs/heads/master 55276d3a2 -> 877f82cb3 [SPARK-26193][SQL] Implement shuffle write metrics in SQL ## What changes were proposed in this pull request? 1. Implement `SQLShuffleWriteMetricsReporter` on the SQL side as the customized `ShuffleWriteMetricsRepor

spark git commit: [SPARK-25132][SQL][FOLLOWUP][DOC] Add migration doc for case-insensitive field resolution when reading from Parquet

2018-12-08 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 14b75ebea -> a073b1c69 [SPARK-25132][SQL][FOLLOWUP][DOC] Add migration doc for case-insensitive field resolution when reading from Parquet ## What changes were proposed in this pull request? #22148 introduces a behavior change. Accordi

spark git commit: [SPARK-25132][SQL][FOLLOWUP][DOC] Add migration doc for case-insensitive field resolution when reading from Parquet

2018-12-08 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master bdf32847b -> 55276d3a2 [SPARK-25132][SQL][FOLLOWUP][DOC] Add migration doc for case-insensitive field resolution when reading from Parquet ## What changes were proposed in this pull request? #22148 introduces a behavior change. According t

svn commit: r31466 - in /dev/spark/3.0.0-SNAPSHOT-2018_12_08_15_13-bdf3284-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-12-08 Thread pwendell
Author: pwendell Date: Sat Dec 8 23:25:45 2018 New Revision: 31466 Log: Apache Spark 3.0.0-SNAPSHOT-2018_12_08_15_13-bdf3284 docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

svn commit: r31463 - in /dev/spark/2.4.1-SNAPSHOT-2018_12_08_13_06-14b75eb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-12-08 Thread pwendell
Author: pwendell Date: Sat Dec 8 21:21:25 2018 New Revision: 31463 Log: Apache Spark 2.4.1-SNAPSHOT-2018_12_08_13_06-14b75eb docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-26021][SQL][FOLLOWUP] only deal with NaN and -0.0 in UnsafeWriter

2018-12-08 Thread dongjoon
Repository: spark Updated Branches: refs/heads/master 678e1aca6 -> bdf32847b [SPARK-26021][SQL][FOLLOWUP] only deal with NaN and -0.0 in UnsafeWriter ## What changes were proposed in this pull request? A followup of https://github.com/apache/spark/pull/23043 There are 4 places we need to dea

spark git commit: [SPARK-26266][BUILD] Update to Scala 2.12.8 (branch-2.4)

2018-12-08 Thread dongjoon
Repository: spark Updated Branches: refs/heads/branch-2.4 910bfc87b -> 14b75ebea [SPARK-26266][BUILD] Update to Scala 2.12.8 (branch-2.4) ## What changes were proposed in this pull request? Back-port of https://github.com/apache/spark/pull/23218 ; updates Scala 2.12 build to 2.12.8 ## How w

svn commit: r31461 - in /dev/spark/3.0.0-SNAPSHOT-2018_12_08_06_49-678e1ac-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2018-12-08 Thread pwendell
Author: pwendell Date: Sat Dec 8 15:01:59 2018 New Revision: 31461 Log: Apache Spark 3.0.0-SNAPSHOT-2018_12_08_06_49-678e1ac docs [This commit notification would consist of 1764 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

spark git commit: [SPARK-24207][R] follow-up PR for SPARK-24207 to fix code style problems

2018-12-08 Thread gurwls223
Repository: spark Updated Branches: refs/heads/master 2ea9792fd -> 678e1aca6 [SPARK-24207][R] follow-up PR for SPARK-24207 to fix code style problems ## What changes were proposed in this pull request? follow-up PR for SPARK-24207 to fix code style problems Closes #23256 from huaxingao/spark

spark git commit: [SPARK-26266][BUILD] Update to Scala 2.12.8

2018-12-08 Thread srowen
Repository: spark Updated Branches: refs/heads/master 9b1f6c8ba -> 2ea9792fd [SPARK-26266][BUILD] Update to Scala 2.12.8 ## What changes were proposed in this pull request? Update to Scala 2.12.8 ## How was this patch tested? Existing tests. Closes #23218 from srowen/SPARK-26266. Authored