Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21527#discussion_r218656012
--- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala ---
@@ -50,7 +50,9 @@ private[spark] sealed trait MapStatus {
private[spark
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21953
@tgravescs I updated it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21936
@tgravescs I updated. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21953
@tgravescs Can you test this please? Thank you.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21953
[SPARK-24992][Core] spark should randomize yarn local dir selection
**Description:
[SPARK-24992](https://issues.apache.org/jira/browse/SPARK-24992)**
Utils.getLocalDir is used to get path
Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21936#discussion_r206918869
--- Diff: core/src/main/scala/org/apache/spark/SparkContext.scala ---
@@ -571,7 +571,12 @@ class SparkContext(config: SparkConf) extends Logging
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21936
@tgravescs Can you please have a look at it? Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21936
[SPARK-24981][Core] ShutdownHook timeout causes job to fail when succeeded
when SparkContext stop() not called by user program
**Description**
The issue is described in
[SPARK-24981](https
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
@tgravescs Can you please run the test again, thank you.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
@tgravescs I updated it. Can you please have a look at it when you have
time. Thank you.
---
-
To unsubscribe, e-mail: reviews
Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21729#discussion_r201412205
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -87,7 +87,7 @@ private[spark] class TaskSetManager(
// Set
Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21729#discussion_r201411743
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -87,7 +87,7 @@ private[spark] class TaskSetManager(
// Set
Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21729#discussion_r201372921
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -87,7 +87,7 @@ private[spark] class TaskSetManager(
// Set
Github user hthuynh2 commented on a diff in the pull request:
https://github.com/apache/spark/pull/21729#discussion_r201371752
--- Diff:
core/src/main/scala/org/apache/spark/scheduler/TaskSetManager.scala ---
@@ -87,7 +87,7 @@ private[spark] class TaskSetManager(
// Set
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21729
@xuanyuanking Thanks for the comments. I also thought about modifying the
UT of SPARK-22074 instead of adding new UT but I was afraid it might cause
confusing since they are 2 different issues
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21729
cc @mridulm @xuanyuanking
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21729
SPARK-24755 Executor loss can cause task to not be resubmitted
**Description**
As described in
[SPARK-24755](https://issues.apache.org/jira/browse/SPARK-24755), when
speculation is enabled
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
@squito Thanks for the suggestions. I updated it. Could you please have a
look at it to see if there is anything else I need to change? Thanks
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
@jiangxb1987 yes, you are correct that it is actually ignored. I think it
doesn't worth to add a new TaskState because we might need to add changes in
many places but does not add much benefit
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
I updated it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21653
cc @tgravescs
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21653
[SPARK-13343] speculative tasks that didn't commit shouldn't be marked as
success
**Description**
Currently Speculative tasks that didn't commit can show up as success of
failures (depending
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21527
@vanzin @squito Thank for the comments. I updated the PR, please have a
look and let me know if anything need to be changed. Thank you
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21527
@tgravescs I updated it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21527
I updated it. Thanks.
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail
Github user hthuynh2 commented on the issue:
https://github.com/apache/spark/pull/21527
@tgravescs
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h
GitHub user hthuynh2 opened a pull request:
https://github.com/apache/spark/pull/21527
Spark branch 1
**Problem**
MapStatus uses hardcoded value of 2000 partitions to determine if it should
use highly compressed map status. We should make it configurable.
**What
27 matches
Mail list logo
