Repository: spark
Updated Branches:
refs/heads/branch-1.1 78e3c036e - 54ccd93e6
[HOTFIX] Wait for EOF only for the PySpark shell
In `SparkSubmitDriverBootstrapper`, we wait for the parent process to send us
an `EOF` before finishing the application. This is applicable for the PySpark
shell
Repository: spark
Updated Branches:
refs/heads/master f38fab97c - dafe34349
[HOTFIX] Wait for EOF only for the PySpark shell
In `SparkSubmitDriverBootstrapper`, we wait for the parent process to send us
an `EOF` before finishing the application. This is applicable for the PySpark
shell
Repository: spark
Updated Branches:
refs/heads/master dafe34349 - 024178c57
[HOTFIX][SQL] Remove cleaning of UDFs
It is not safe to run the closure cleaner on slaves. #2153 introduced this
which broke all UDF execution on slaves. Will re-add cleaning of UDF closures
in a follow-up PR.
Repository: spark
Updated Branches:
refs/heads/branch-1.1 54ccd93e6 - 233c283e3
[HOTFIX][SQL] Remove cleaning of UDFs
It is not safe to run the closure cleaner on slaves. #2153 introduced this
which broke all UDF execution on slaves. Will re-add cleaning of UDF closures
in a follow-up PR.
Repository: spark
Updated Branches:
refs/heads/branch-1.1 233c283e3 - ad0fab23d
HOTFIX: Don't build with YARN support for Mapr3
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ad0fab23
Tree:
Repository: spark
Updated Tags: refs/tags/v1.1.0-rc1 [deleted] 1dc825d90
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.1 79e86ef3e - a118ea5c5
[maven-release-plugin] prepare for next development iteration
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a118ea5c
Tree:
Repository: spark
Updated Tags: refs/tags/v1.1.0-rc1 [created] d6d19b581
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.1 ad0fab23d - 79e86ef3e
[maven-release-plugin] prepare release v1.1.0-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/79e86ef3
Tree:
Repository: spark
Updated Branches:
refs/heads/master 024178c57 - 68f75dcdf
[SQL] Fixed 2 comment typos in SQLConf
Author: Cheng Lian lian.cs@gmail.com
Closes #2172 from liancheng/sqlconf-typo and squashes the following commits:
115cc71 [Cheng Lian] Fixed 2 comment typos in SQLConf
Repository: spark
Updated Tags: refs/tags/v1.1.0-rc1 [deleted] d6d19b581
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/master 68f75dcdf - 76e3ba426
[SPARK-3230][SQL] Fix udfs that return structs
We need to convert the case classes into Rows.
Author: Michael Armbrust mich...@databricks.com
Closes #2133 from marmbrus/structUdfs and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 2e8ad9976 - a9df70308
Revert [maven-release-plugin] prepare release v1.1.0-rc1
This reverts commit 79e86ef3e1a3ee03a7e3b166a5c7dee11c6d60d7.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit:
Revert [maven-release-plugin] prepare for next development iteration
This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/71ec0140
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 da4b94c86 - 96926c5a4
[maven-release-plugin] prepare for next development iteration
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/96926c5a
Tree:
Revert [maven-release-plugin] prepare for next development iteration
This reverts commit a118ea5c59d653f5a3feda21455ba60bc722b3b1.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d01b3faf
Tree:
Revert Revert [maven-release-plugin] prepare release v1.1.0-rc1
This reverts commit 56070f12f455bae645cba887a74c72b12f1085f8.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/4186c45f
Tree:
Repository: spark
Updated Tags: refs/tags/v1.1.0-rc1 [created] c0cb9d6b5
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.1 1d03330ec - f07183249
[maven-release-plugin] prepare release v1.1.0-rc1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f0718324
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.0 edea1efe0 - 31de05b08
[SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing
default values in DriverInfo.init()
The issue happens when Spark is run standalone on a cluster.
When master and driver fall
Repository: spark
Updated Branches:
refs/heads/branch-1.1 f8f7a0c9d - fd98020a9
[SPARK-3150] Fix NullPointerException in in Spark recovery: Add initializing
default values in DriverInfo.init()
The issue happens when Spark is run standalone on a cluster.
When master and driver fall
Repository: spark
Updated Branches:
refs/heads/master be53c54b5 - 39012452d
[SPARK-3285] [examples] Using values.sum is easier to understand than using
values.foldLeft(0)(_ + _)
def sum[B : A](implicit num: Numeric[B]): B = foldLeft(num.zero)(num.plus)
Using values.sum is easier to
Repository: spark
Updated Branches:
refs/heads/master 41dc5987d - be53c54b5
[SPARK-3281] Remove Netty specific code in BlockManager / shuffle
Netty functionality will be added back in subsequent PRs by using the
BlockTransferService interface.
Author: Reynold Xin r...@apache.org
Closes
Repository: spark
Updated Branches:
refs/heads/master 39012452d - 96df92906
[SPARK-3190] Avoid overflow in VertexRDD.count()
VertexRDDs with more than 4 billion elements are counted incorrectly due to
integer overflow when summing partition sizes. This PR fixes the issue by
converting
Repository: spark
Updated Branches:
refs/heads/branch-1.0 31de05b08 - 5481196ab
[SPARK-3190] Avoid overflow in VertexRDD.count()
VertexRDDs with more than 4 billion elements are counted incorrectly due to
integer overflow when summing partition sizes. This PR fixes the issue by
converting
Repository: spark
Updated Branches:
refs/heads/master 96df92906 - 92af2314f
SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...
...d queue doesn't exist
Author: Sandy Ryza sa...@cloudera.com
Closes #1984 from sryza/sandy-spark-3082 and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 0b9718add - f4cbf5e3d
SPARK-3082. yarn.Client.logClusterResourceDetails throws NPE if requeste...
...d queue doesn't exist
Author: Sandy Ryza sa...@cloudera.com
Closes #1984 from sryza/sandy-spark-3082 and squashes the following
Repository: spark
Updated Branches:
refs/heads/master 92af2314f - a46b8f2d7
[SPARK-3277] Fix external spilling with LZ4 assertion error
**Summary of the changes**
The bulk of this PR is comprised of tests and documentation; the actual fix is
really just adding 1 line of code (see
Repository: spark
Updated Branches:
refs/heads/branch-1.1 f4cbf5e3d - fe4df343d
[SPARK-3277] Fix external spilling with LZ4 assertion error
**Summary of the changes**
The bulk of this PR is comprised of tests and documentation; the actual fix is
really just adding 1 line of code (see
Revert [maven-release-plugin] prepare for next development iteration
This reverts commit f8f7a0c9dce764ece8acdc41d35bbf448dba7e92.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/587dff21
Tree:
Revert [maven-release-plugin] prepare release v1.1.0-rc1
This reverts commit f07183249b74dd857069028bf7d570b35f265585.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb2b40a5
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 fe4df343d - fb2b40a52
Adding new CHANGES.txt
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7db87b3e
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 711aebb32 - a4a7a2414
[maven-release-plugin] prepare for next development iteration
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a4a7a241
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.1 fb2b40a52 - 711aebb32
[maven-release-plugin] prepare release v1.1.0-rc2
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/711aebb3
Tree:
Repository: spark
Updated Branches:
refs/heads/master a46b8f2d7 - 3c517a812
[Spark QA] Link to console output on test time out
When tests time out we should link to the Jenkins console output for easy
review. We already do this for when tests start or complete normally.
Here's [a recent
Repository: spark
Updated Branches:
refs/heads/master 3c517a812 - 665e71d14
[SPARK-1912] Lazily initialize buffers for local shuffle blocks.
This is a simplified fix for SPARK-1912.
Author: Reynold Xin r...@apache.org
Closes #2179 from rxin/SPARK-1912 and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/master 665e71d14 - 27df6ce6a
[SPARK-3279] Remove useless field variable in ApplicationMaster
Author: Kousuke Saruta saru...@oss.nttdata.co.jp
Closes #2177 from sarutak/SPARK-3279 and squashes the following commits:
2955edc [Kousuke Saruta]
37 matches
Mail list logo