spark git commit: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631
Repository: spark
Updated Branches:
refs/heads/master 56e8f48a4 -> 15c3c9830
[HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory,
got 224631
## What changes were proposed in this pull request?
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88263/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88260/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88257/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88224/testReport
These tests all failed:
```
org.apache.spark.memory.SparkOutOfMemoryError: Unable to acquire 262144 bytes
of memory, got 224631
at org.apache.spark.memory.MemoryConsumer.throwOom(MemoryConsumer.java:157)
at org.apache.spark.memory.MemoryConsumer.allocateArray(MemoryConsumer.java:98)
at
org.apache.spark.unsafe.map.BytesToBytesMap.allocate(BytesToBytesMap.java:787)
at org.apache.spark.unsafe.map.BytesToBytesMap.(BytesToBytesMap.java:204)
at org.apache.spark.unsafe.map.BytesToBytesMap.(BytesToBytesMap.java:219)
...
```
This PR ignore this test.
## How was this patch tested?
N/A
Author: Yuming Wang
Closes #20835 from wangyum/SPARK-23598.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/15c3c983
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/15c3c983
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/15c3c983
Branch: refs/heads/master
Commit: 15c3c983008557165cc91713ddaf2dbd6d5a506c
Parents: 56e8f48
Author: Yuming Wang
Authored: Thu Mar 15 19:54:58 2018 +0100
Committer: Herman van Hovell
Committed: Thu Mar 15 19:54:58 2018 +0100
--
.../org/apache/spark/sql/execution/WholeStageCodegenSuite.scala| 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/15c3c983/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
--
diff --git
a/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
b/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
index 4b40e4e..9180a22 100644
---
a/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
+++
b/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
@@ -310,7 +310,7 @@ class WholeStageCodegenSuite extends QueryTest with
SharedSQLContext {
}
}
- test("SPARK-23598: Codegen working for lots of aggregation operations
without runtime errors") {
+ ignore("SPARK-23598: Codegen working for lots of aggregation operations
without runtime errors") {
withSQLConf(SQLConf.SHUFFLE_PARTITIONS.key -> "1") {
var df = Seq((8, "bat"), (15, "mouse"), (5, "horse")).toDF("age", "name")
for (i <- 0 until 70) {
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
spark git commit: [HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory, got 224631
Repository: spark
Updated Branches:
refs/heads/branch-2.3 57026a185 -> 2fd7acabf
[HOT-FIX] Fix SparkOutOfMemoryError: Unable to acquire 262144 bytes of memory,
got 224631
## What changes were proposed in this pull request?
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88263/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88260/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88257/testReport
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88224/testReport
These tests all failed:
```
org.apache.spark.memory.SparkOutOfMemoryError: Unable to acquire 262144 bytes
of memory, got 224631
at org.apache.spark.memory.MemoryConsumer.throwOom(MemoryConsumer.java:157)
at org.apache.spark.memory.MemoryConsumer.allocateArray(MemoryConsumer.java:98)
at
org.apache.spark.unsafe.map.BytesToBytesMap.allocate(BytesToBytesMap.java:787)
at org.apache.spark.unsafe.map.BytesToBytesMap.(BytesToBytesMap.java:204)
at org.apache.spark.unsafe.map.BytesToBytesMap.(BytesToBytesMap.java:219)
...
```
This PR ignore this test.
## How was this patch tested?
N/A
Author: Yuming Wang
Closes #20835 from wangyum/SPARK-23598.
(cherry picked from commit 15c3c983008557165cc91713ddaf2dbd6d5a506c)
Signed-off-by: Herman van Hovell
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2fd7acab
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/2fd7acab
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2fd7acab
Branch: refs/heads/branch-2.3
Commit: 2fd7acabf8d55789662d52d94bd30f84b05a577a
Parents: 57026a1
Author: Yuming Wang
Authored: Thu Mar 15 19:54:58 2018 +0100
Committer: Herman van Hovell
Committed: Mon Mar 26 00:00:34 2018 +0200
--
.../org/apache/spark/sql/execution/WholeStageCodegenSuite.scala| 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
--
http://git-wip-us.apache.org/repos/asf/spark/blob/2fd7acab/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
--
diff --git
a/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
b/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
index 4b40e4e..9180a22 100644
---
a/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
+++
b/sql/core/src/test/scala/org/apache/spark/sql/execution/WholeStageCodegenSuite.scala
@@ -310,7 +310,7 @@ class WholeStageCodegenSuite extends QueryTest with
SharedSQLContext {
}
}
- test("SPARK-23598: Codegen working for lots of aggregation operations
without runtime errors") {
+ ignore("SPARK-23598: Codegen working for lots of aggregation operations
without runtime errors") {
withSQLConf(SQLConf.SHUFFLE_PARTITIONS.key -> "1") {
var df = Seq((8, "bat"), (15, "mouse"), (5, "horse")).toDF("age", "name")
for (i <- 0 until 70) {
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
