svn commit: r24090 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_22_01-fd46a27-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 9 06:15:41 2018 New Revision: 24090 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_22_01-fd46a27 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-21293][SPARKR][DOCS] structured streaming doc update

Repository: spark Updated Branches: refs/heads/branch-2.3 911a4dbe7 -> a23c07ecb [SPARK-21293][SPARKR][DOCS] structured streaming doc update ## What changes were proposed in this pull request? doc update Author: Felix Cheung Closes #20197 from

spark git commit: [SPARK-21293][SPARKR][DOCS] structured streaming doc update

Repository: spark Updated Branches: refs/heads/master 8486ad419 -> 02214b094 [SPARK-21293][SPARKR][DOCS] structured streaming doc update ## What changes were proposed in this pull request? doc update Author: Felix Cheung Closes #20197 from felixcheung/rwadoc.

spark git commit: [SPARK-21292][DOCS] refreshtable example

Repository: spark Updated Branches: refs/heads/branch-2.3 fd46a276c -> 911a4dbe7 [SPARK-21292][DOCS] refreshtable example ## What changes were proposed in this pull request? doc update Author: Felix Cheung Closes #20198 from felixcheung/rrefreshdoc. (cherry

spark git commit: [SPARK-21292][DOCS] refreshtable example

Repository: spark Updated Branches: refs/heads/master f20131dd3 -> 8486ad419 [SPARK-21292][DOCS] refreshtable example ## What changes were proposed in this pull request? doc update Author: Felix Cheung Closes #20198 from felixcheung/rrefreshdoc. Project:

svn commit: r24089 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_20_01-f20131d-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 9 04:15:10 2018 New Revision: 24089 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_20_01-f20131d docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner

Repository: spark Updated Branches: refs/heads/branch-2.2 7c30ae39f -> 24f1f2a54 [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner ## What changes were proposed in this pull request? This PR fixes a longstanding correctness bug in

spark git commit: [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner

Repository: spark Updated Branches: refs/heads/branch-2.3 850b9f391 -> fd46a276c [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner ## What changes were proposed in this pull request? This PR fixes a longstanding correctness bug in

spark git commit: [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner

Repository: spark Updated Branches: refs/heads/master 849043ce1 -> f20131dd3 [SPARK-22984] Fix incorrect bitmap copying and offset adjustment in GenerateUnsafeRowJoiner ## What changes were proposed in this pull request? This PR fixes a longstanding correctness bug in

spark git commit: [SPARK-22990][CORE] Fix method isFairScheduler in JobsTab and StagesTab

Repository: spark Updated Branches: refs/heads/master 68ce792b5 -> 849043ce1 [SPARK-22990][CORE] Fix method isFairScheduler in JobsTab and StagesTab ## What changes were proposed in this pull request? In current implementation, the function `isFairScheduler` is always false, since it is

spark git commit: [SPARK-22990][CORE] Fix method isFairScheduler in JobsTab and StagesTab

Repository: spark Updated Branches: refs/heads/branch-2.3 8032cf852 -> 850b9f391 [SPARK-22990][CORE] Fix method isFairScheduler in JobsTab and StagesTab ## What changes were proposed in this pull request? In current implementation, the function `isFairScheduler` is always false, since it is

spark git commit: [SPARK-22972] Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc

Repository: spark Updated Branches: refs/heads/branch-2.3 eecd83cb2 -> 8032cf852 [SPARK-22972] Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc ## What changes were proposed in this pull request? Fix the warning: Couldn't find corresponding Hive

spark git commit: [SPARK-22972] Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc

Repository: spark Updated Branches: refs/heads/master 4f7e75883 -> 68ce792b5 [SPARK-22972] Couldn't find corresponding Hive SerDe for data source provider org.apache.spark.sql.hive.orc ## What changes were proposed in this pull request? Fix the warning: Couldn't find corresponding Hive SerDe

svn commit: r24086 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_16_01-4f7e758-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 9 00:15:01 2018 New Revision: 24086 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_16_01-4f7e758 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24085 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_14_01-eecd83c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 22:17:41 2018 New Revision: 24085 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_14_01-eecd83c docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22912] v2 data source support in MicroBatchExecution

Repository: spark Updated Branches: refs/heads/master eed82a0b2 -> 4f7e75883 [SPARK-22912] v2 data source support in MicroBatchExecution ## What changes were proposed in this pull request? Support for v2 data sources in microbatch streaming. ## How was this patch tested? A very basic new

spark git commit: [SPARK-22992][K8S] Remove assumption of the DNS domain

Repository: spark Updated Branches: refs/heads/branch-2.3 06fd842e3 -> eecd83cb2 [SPARK-22992][K8S] Remove assumption of the DNS domain ## What changes were proposed in this pull request? Remove the use of FQDN to access the driver because it assumes that it's set up in a DNS zone -

spark git commit: [SPARK-22992][K8S] Remove assumption of the DNS domain

Repository: spark Updated Branches: refs/heads/master 40b983c3b -> eed82a0b2 [SPARK-22992][K8S] Remove assumption of the DNS domain ## What changes were proposed in this pull request? Remove the use of FQDN to access the driver because it assumes that it's set up in a DNS zone -

spark-website git commit: update latest

Repository: spark-website Updated Branches: refs/heads/asf-site 8c5354f29 -> 1a8adcaa8 update latest Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo Commit: http://git-wip-us.apache.org/repos/asf/spark-website/commit/1a8adcaa Tree:

svn commit: r24082 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_10_01-06fd842-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 18:18:59 2018 New Revision: 24082 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_10_01-06fd842 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24079 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_08_01-40b983c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 16:20:17 2018 New Revision: 24079 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_08_01-40b983c docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22952][CORE] Deprecate stageAttemptId in favour of stageAttemptNumber

Repository: spark Updated Branches: refs/heads/branch-2.3 4a45f0a53 -> 06fd842e3 [SPARK-22952][CORE] Deprecate stageAttemptId in favour of stageAttemptNumber ## What changes were proposed in this pull request? 1. Deprecate attemptId in StageInfo and add `def attemptNumber() = attemptId` 2.

spark git commit: [SPARK-22952][CORE] Deprecate stageAttemptId in favour of stageAttemptNumber

Repository: spark Updated Branches: refs/heads/master eb45b52e8 -> 40b983c3b [SPARK-22952][CORE] Deprecate stageAttemptId in favour of stageAttemptNumber ## What changes were proposed in this pull request? 1. Deprecate attemptId in StageInfo and add `def attemptNumber() = attemptId` 2.

svn commit: r24074 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_06_01-4a45f0a-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 14:14:57 2018 New Revision: 24074 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_06_01-4a45f0a docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24071 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_05_06-eb45b52-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 13:19:57 2018 New Revision: 24071 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_05_06-eb45b52 docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-21865][SQL] simplify the distribution semantic of Spark SQL

Repository: spark Updated Branches: refs/heads/branch-2.3 6964dfe47 -> 4a45f0a53 [SPARK-21865][SQL] simplify the distribution semantic of Spark SQL ## What changes were proposed in this pull request? **The current shuffle planning logic** 1. Each operator specifies the distribution

spark git commit: [SPARK-21865][SQL] simplify the distribution semantic of Spark SQL

Repository: spark Updated Branches: refs/heads/master 2c73d2a94 -> eb45b52e8 [SPARK-21865][SQL] simplify the distribution semantic of Spark SQL ## What changes were proposed in this pull request? **The current shuffle planning logic** 1. Each operator specifies the distribution requirements

svn commit: r24067 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_02_01-6964dfe-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 10:15:29 2018 New Revision: 24067 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_02_01-6964dfe docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r24065 - in /dev/spark/2.3.0-SNAPSHOT-2018_01_08_00_01-8fdeb4b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 8 08:16:44 2018 New Revision: 24065 Log: Apache Spark 2.3.0-SNAPSHOT-2018_01_08_00_01-8fdeb4b docs [This commit notification would consist of 1439 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

spark git commit: [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions

Repository: spark Updated Branches: refs/heads/branch-2.2 41f705a57 -> 7c30ae39f [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions ## What changes were proposed in this pull request? The following SQL query should return zero rows, but in Spark it actually

spark git commit: [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions

Repository: spark Updated Branches: refs/heads/branch-2.3 8bf24e9fe -> 6964dfe47 [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions ## What changes were proposed in this pull request? The following SQL query should return zero rows, but in Spark it actually

spark git commit: [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions

Repository: spark Updated Branches: refs/heads/master 8fdeb4b99 -> 2c73d2a94 [SPARK-22983] Don't push filters beneath aggregates with empty grouping expressions ## What changes were proposed in this pull request? The following SQL query should return zero rows, but in Spark it actually