Author: pwendell
Date: Thu Nov 22 07:48:36 2018
New Revision: 31040
Log:
Apache Spark 2.3.3-SNAPSHOT-2018_11_21_23_34-62010d6 docs
[This commit notification would consist of 1443 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master 8d54bf79f -> 15c038497
[SPARK-26134][CORE] Upgrading Hadoop to 2.7.4 to fix java.version problem
## What changes were proposed in this pull request?
When I ran spark-shell on JDK11+28(2018-09-25), It failed with the error below.
```
Repository: spark
Updated Branches:
refs/heads/branch-2.2 1d8a4a2aa -> 9ceee6f18
[SPARK-26118][BACKPORT-2.2][WEB UI] Introducing spark.ui.requestHeaderSize for
setting HTTP requestHeaderSize
## What changes were proposed in this pull request?
Introducing spark.ui.requestHeaderSize for
Repository: spark
Updated Branches:
refs/heads/branch-2.3 8b6504e33 -> 62010d648
[SPARK-26118][BACKPORT-2.3][WEB UI] Introducing spark.ui.requestHeaderSize for
setting HTTP requestHeaderSize
## What changes were proposed in this pull request?
Introducing spark.ui.requestHeaderSize for
Author: pwendell
Date: Thu Nov 22 05:45:49 2018
New Revision: 31036
Log:
Apache Spark 3.0.0-SNAPSHOT-2018_11_21_21_33-8d54bf7 docs
[This commit notification would consist of 1755 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master ab2eafb3c -> 8d54bf79f
[SPARK-26099][SQL] Verification of the corrupt column in from_csv/from_json
## What changes were proposed in this pull request?
The corrupt column specified via JSON/CSV option *columnNameOfCorruptRecord*
must have
Repository: spark
Updated Branches:
refs/heads/master 38628dd1b -> ab2eafb3c
[SPARK-26085][SQL] Key attribute of non-struct type under typed aggregation
should be named as "key" too
## What changes were proposed in this pull request?
When doing typed aggregation on a Dataset, for struct key
Author: pwendell
Date: Thu Nov 22 01:44:00 2018
New Revision: 31032
Log:
Apache Spark 3.0.0-SNAPSHOT-2018_11_21_17_31-ce7b57c docs
[This commit notification would consist of 1755 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master ce7b57cb5 -> 38628dd1b
[SPARK-25935][SQL] Prevent null rows from JSON parser
## What changes were proposed in this pull request?
An input without valid JSON tokens on the root level will be treated as a bad
record, and handled according
Repository: spark
Updated Branches:
refs/heads/master 9b48107f9 -> ce7b57cb5
[SPARK-26106][PYTHON] Prioritizes ML unittests over the doctests in PySpark
## What changes were proposed in this pull request?
Arguably, unittests usually takes longer then doctests. We better prioritize
unittests
Repository: spark
Updated Branches:
refs/heads/master 4aa9ccbde -> 9b48107f9
[SPARK-25957][K8S] Make building alternate language binding docker images
optional
## What changes were proposed in this pull request?
bin/docker-image-tool.sh tries to build all docker images (JVM, PySpark
and
Repository: spark
Updated Branches:
refs/heads/master 81550b38e -> 4aa9ccbde
[SPARK-26127][ML] Remove deprecated setters from tree regression and
classification models
## What changes were proposed in this pull request?
The setter methods are deprecated since 2.1 for the models of
Author: pwendell
Date: Wed Nov 21 21:41:14 2018
New Revision: 31027
Log:
Apache Spark 3.0.0-SNAPSHOT-2018_11_21_13_29-81550b3 docs
[This commit notification would consist of 1755 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Author: pwendell
Date: Wed Nov 21 19:43:24 2018
New Revision: 31025
Log:
Apache Spark 2.4.1-SNAPSHOT-2018_11_21_11_27-8705a9d docs
[This commit notification would consist of 1476 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Author: pwendell
Date: Wed Nov 21 19:41:56 2018
New Revision: 31024
Log:
Apache Spark 2.3.3-SNAPSHOT-2018_11_21_11_27-8b6504e docs
[This commit notification would consist of 1443 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master 07a700b37 -> 81550b38e
[SPARK-26066][SQL] Move truncatedString to sql/catalyst and add
spark.sql.debug.maxToStringFields conf
## What changes were proposed in this pull request?
In the PR, I propose:
- new SQL config
Author: pwendell
Date: Wed Nov 21 17:35:10 2018
New Revision: 31022
Log:
Apache Spark 3.0.0-SNAPSHOT-2018_11_21_09_22-07a700b docs
[This commit notification would consist of 1755 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master 6bbdf34ba -> 07a700b37
[SPARK-26129][SQL] Instrumentation for per-query planning time
## What changes were proposed in this pull request?
We currently don't have good visibility into query planning time (analysis vs
optimization vs
Repository: spark
Updated Branches:
refs/heads/master 540afc2b1 -> 6bbdf34ba
[SPARK-8288][SQL] ScalaReflection can use companion object constructor
## What changes were proposed in this pull request?
This change fixes a particular scenario where default spark SQL can't encode
(thrift) types
Repository: spark
Updated Branches:
refs/heads/branch-2.3 0fb830c49 -> 8b6504e33
[SPARK-26109][WEBUI] Duration in the task summary metrics table and the task
table are different
## What changes were proposed in this pull request?
Task summary table displays the summary of the task table in
Repository: spark
Updated Branches:
refs/heads/branch-2.4 d8e05d23a -> 8705a9dd7
[SPARK-26109][WEBUI] Duration in the task summary metrics table and the task
table are different
## What changes were proposed in this pull request?
Task summary table displays the summary of the task table in
Repository: spark
Updated Branches:
refs/heads/master a480a6256 -> 540afc2b1
[SPARK-26109][WEBUI] Duration in the task summary metrics table and the task
table are different
## What changes were proposed in this pull request?
Task summary table displays the summary of the task table in the
Author: pwendell
Date: Wed Nov 21 09:17:50 2018
New Revision: 31021
Log:
Apache Spark 3.0.0-SNAPSHOT-2018_11_21_01_02-a480a62 docs
[This commit notification would consist of 1755 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
Repository: spark
Updated Branches:
refs/heads/master 4b7f7ef50 -> a480a6256
[SPARK-25954][SS] Upgrade to Kafka 2.1.0
## What changes were proposed in this pull request?
[Kafka 2.1.0
24 matches
Mail list logo
