[jira] [Assigned] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-17 Thread Kousuke Saruta (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kousuke Saruta reassigned SPARK-32000:
--

Assignee: (was: Kousuke Saruta)

> Fix the flaky testcase for partially launched task in barrier-mode.
> ---
>
> Key: SPARK-32000
> URL: https://issues.apache.org/jira/browse/SPARK-32000
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core, Tests
>Affects Versions: 3.1.0
>Reporter: Kousuke Saruta
>Priority: Major
>
> I noticed sometimes the testcase for SPARK-31485 fails.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-16 Thread Apache Spark (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-32000:


Assignee: Apache Spark  (was: Kousuke Saruta)

> Fix the flaky testcase for partially launched task in barrier-mode.
> ---
>
> Key: SPARK-32000
> URL: https://issues.apache.org/jira/browse/SPARK-32000
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core, Tests
>Affects Versions: 3.1.0
>Reporter: Kousuke Saruta
>Assignee: Apache Spark
>Priority: Major
>
> I noticed sometimes the testcase for SPARK-31485 fails.
> The reason should be related to the locality wait. 
> If the scheduler waits for a resource offer which meets the preferred 
> location for a task until the time-limit of process-local but no resource can 
> be offered for the locality level, the scheduler will give up the preferred 
> location. In this case, such task can be assigned to off-preferred location.
> The testcase for SPARK-31485, there are two tasks and only one task is 
> supposed to be assigned at one schedule round but both two tasks can be 
> assigned in that situation mentioned above and the testcase will fail.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Assigned] (SPARK-32000) Fix the flaky testcase for partially launched task in barrier-mode.

2020-06-16 Thread Apache Spark (Jira)


 [ 
https://issues.apache.org/jira/browse/SPARK-32000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Apache Spark reassigned SPARK-32000:


Assignee: Kousuke Saruta  (was: Apache Spark)

> Fix the flaky testcase for partially launched task in barrier-mode.
> ---
>
> Key: SPARK-32000
> URL: https://issues.apache.org/jira/browse/SPARK-32000
> Project: Spark
>  Issue Type: Bug
>  Components: Spark Core, Tests
>Affects Versions: 3.1.0
>Reporter: Kousuke Saruta
>Assignee: Kousuke Saruta
>Priority: Major
>
> I noticed sometimes the testcase for SPARK-31485 fails.
> The reason should be related to the locality wait. 
> If the scheduler waits for a resource offer which meets the preferred 
> location for a task until the time-limit of process-local but no resource can 
> be offered for the locality level, the scheduler will give up the preferred 
> location. In this case, such task can be assigned to off-preferred location.
> The testcase for SPARK-31485, there are two tasks and only one task is 
> supposed to be assigned at one schedule round but both two tasks can be 
> assigned in that situation mentioned above and the testcase will fail.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org