Author: pwendell
Date: Thu Sep 20 05:19:10 2018
New Revision: 29533
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_19_22_02-dfcff38 docs
[This commit notification would consist of 1475 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Thu Sep 20 05:17:54 2018
New Revision: 29532
Log:
Apache Spark 2.3.3-SNAPSHOT-2018_09_19_22_02-e319a62 docs
[This commit notification would consist of 1443 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 95b177c8f -> 0e31a6f25
[SPARK-25339][TEST] Refactor FilterPushdownBenchmark
## What changes were proposed in this pull request?
Refactor `FilterPushdownBenchmark` use `main` method. we can use 3 ways to run
this test now:
1. bin/spark-su
Repository: spark
Updated Branches:
refs/heads/master 76399d75e -> 95b177c8f
[SPARK-23648][R][SQL] Adds more types for hint in SparkR
## What changes were proposed in this pull request?
Addition of numeric and list hints for SparkR.
## How was this patch tested?
Add test in test_sparkSQL.R
Repository: spark
Updated Branches:
refs/heads/branch-2.4 06efed290 -> dfcff3839
[SPARK-4502][SQL] Rename to spark.sql.optimizer.nestedSchemaPruning.enabled
## What changes were proposed in this pull request?
This patch adds an "optimizer" prefix to nested schema pruning.
## How was this patc
Repository: spark
Updated Branches:
refs/heads/master 47d6e80a2 -> 76399d75e
[SPARK-4502][SQL] Rename to spark.sql.optimizer.nestedSchemaPruning.enabled
## What changes were proposed in this pull request?
This patch adds an "optimizer" prefix to nested schema pruning.
## How was this patch te
Author: pwendell
Date: Thu Sep 20 03:16:55 2018
New Revision: 29531
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_19_20_02-47d6e80 docs
[This commit notification would consist of 1484 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 8aae49afc -> 47d6e80a2
[SPARK-25457][SQL] IntegralDivide returns data type of the operands
## What changes were proposed in this pull request?
The PR proposes to return the data type of the operands as a result for the
`div` operator. Bef
Repository: spark
Updated Branches:
refs/heads/branch-2.4 535bf1cc9 -> 06efed290
[SPARK-24341][FOLLOWUP][DOCS] Add migration note for IN subqueries behavior
## What changes were proposed in this pull request?
The PR updates the migration guide in order to explain the changes introduced
in th
Repository: spark
Updated Branches:
refs/heads/master 936c92034 -> 8aae49afc
[SPARK-24341][FOLLOWUP][DOCS] Add migration note for IN subqueries behavior
## What changes were proposed in this pull request?
The PR updates the migration guide in order to explain the changes introduced
in the be
Repository: spark
Updated Branches:
refs/heads/branch-2.4 99ae693b3 -> 535bf1cc9
[SPARK-24157][SS][FOLLOWUP] Rename to
spark.sql.streaming.noDataMicroBatches.enabled
## What changes were proposed in this pull request?
This patch changes the config option
`spark.sql.streaming.noDataMicroBatch
Repository: spark
Updated Branches:
refs/heads/master 90e3955f3 -> 936c92034
[SPARK-24157][SS][FOLLOWUP] Rename to
spark.sql.streaming.noDataMicroBatches.enabled
## What changes were proposed in this pull request?
This patch changes the config option
`spark.sql.streaming.noDataMicroBatchesEn
Repository: spark
Updated Branches:
refs/heads/branch-2.3 7b5da37c0 -> e319a624e
[SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python 3.6
and Pandas 0.23
## What changes were proposed in this pull request?
Fix test that constructs a Pandas DataFrame by specifying the colu
Repository: spark
Updated Branches:
refs/heads/branch-2.4 a9a8d3a4b -> 99ae693b3
[SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python 3.6
and Pandas 0.23
## What changes were proposed in this pull request?
Fix test that constructs a Pandas DataFrame by specifying the colu
Repository: spark
Updated Branches:
refs/heads/master 6f681d429 -> 90e3955f3
[SPARK-25471][PYTHON][TEST] Fix pyspark-sql test error when using Python 3.6
and Pandas 0.23
## What changes were proposed in this pull request?
Fix test that constructs a Pandas DataFrame by specifying the column o
Author: pwendell
Date: Thu Sep 20 01:17:31 2018
New Revision: 29529
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_19_18_03-a9a8d3a docs
[This commit notification would consist of 1475 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/branch-2.4 9031c7848 -> a9a8d3a4b
[SPARK-25425][SQL][BACKPORT-2.4] Extra options should override session options
in DataSource V2
## What changes were proposed in this pull request?
In the PR, I propose overriding session options by extra option
Author: pwendell
Date: Wed Sep 19 23:17:10 2018
New Revision: 29527
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_19_16_02-6f681d4 docs
[This commit notification would consist of 1484 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/branch-2.4 83a75a83c -> 9031c7848
[SPARK-25021][K8S][BACKPORT] Add spark.executor.pyspark.memory limit for K8S
## What changes were proposed in this pull request?
Add spark.executor.pyspark.memory limit for K8S [BACKPORT]
## How was this patch t
Repository: spark
Updated Branches:
refs/heads/master cb1b55cf7 -> 6f681d429
[SPARK-22666][ML][FOLLOW-UP] Improve testcase to tolerate different schema
representation
## What changes were proposed in this pull request?
Improve testcase "image datasource test: read non image" to tolerate diff
Repository: spark
Updated Branches:
refs/heads/branch-2.4 9fefb47fe -> 83a75a83c
[SPARK-22666][ML][FOLLOW-UP] Improve testcase to tolerate different schema
representation
## What changes were proposed in this pull request?
Improve testcase "image datasource test: read non image" to tolerate
Repository: spark
Updated Branches:
refs/heads/branch-2.4 538ae62e0 -> 9fefb47fe
Revert "[SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema"
This reverts commit 6c7db7fd1ced1d143b1389d09990a620fc16be46.
(cherry picked from commit cb1b55cf771018f1560f6b173cdd7c6ca8061bc7)
Signed-o
Repository: spark
Updated Branches:
refs/heads/master a71f6a175 -> cb1b55cf7
Revert "[SPARK-23173][SQL] rename spark.sql.fromJsonForceNullableSchema"
This reverts commit 6c7db7fd1ced1d143b1389d09990a620fc16be46.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wi
Repository: spark-website
Updated Branches:
refs/heads/asf-site 9b21d71d2 -> 806a1bd52
Added the Spark Operator as a third-party project
srowen.
Author: Yinan Li
Closes #148 from liyinan926/asf-site.
Project: http://git-wip-us.apache.org/repos/asf/spark-website/repo
Commit: http://git-wip
Repository: spark
Updated Branches:
refs/heads/master 12b1e91e6 -> a71f6a175
[SPARK-25414][SS][TEST] make it clear that the numRows metrics should be
counted for each scan of the source
## What changes were proposed in this pull request?
For self-join/self-union, Spark will produce a physica
Author: pwendell
Date: Wed Sep 19 15:29:02 2018
New Revision: 29514
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_19_08_14-12b1e91 docs
[This commit notification would consist of 1484 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Wed Sep 19 13:17:20 2018
New Revision: 29509
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_19_06_03-538ae62 docs
[This commit notification would consist of 1475 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 5534a3a58 -> 12b1e91e6
[SPARK-25358][SQL] MutableProjection supports fallback to an interpreted mode
## What changes were proposed in this pull request?
In SPARK-23711, `UnsafeProjection` supports fallback to an interpreted mode.
Therefore
Author: pwendell
Date: Wed Sep 19 11:17:13 2018
New Revision: 29507
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_19_04_02-5534a3a docs
[This commit notification would consist of 1484 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/branch-2.4 f11f44548 -> 538ae62e0
[SPARK-25445][BUILD][FOLLOWUP] Resolve issues in release-build.sh for
publishing scala-2.12 build
## What changes were proposed in this pull request?
This is a follow up for #22441.
1. Remove flag "-Pkafka-0-8"
Repository: spark
Updated Branches:
refs/heads/master 4193c7623 -> 5534a3a58
[SPARK-25445][BUILD][FOLLOWUP] Resolve issues in release-build.sh for
publishing scala-2.12 build
## What changes were proposed in this pull request?
This is a follow up for #22441.
1. Remove flag "-Pkafka-0-8" for
Author: pwendell
Date: Wed Sep 19 09:17:32 2018
New Revision: 29506
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_09_19_02_02-f11f445 docs
[This commit notification would consist of 1475 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Wed Sep 19 07:17:46 2018
New Revision: 29504
Log:
Apache Spark 2.5.0-SNAPSHOT-2018_09_19_00_02-4193c76 docs
[This commit notification would consist of 1484 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
33 matches
Mail list logo
