[ 
https://issues.apache.org/jira/browse/SPARK-31509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

wuyi updated SPARK-31509:
-------------------------
    Affects Version/s:     (was: 3.1.0)
                       2.4.0

> Recommend user to disable delay scheduling for barrier taskset
> --------------------------------------------------------------
>
>                 Key: SPARK-31509
>                 URL: https://issues.apache.org/jira/browse/SPARK-31509
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 2.4.0
>            Reporter: wuyi
>            Priority: Major
>
> Currently, barrier taskset can only be scheduled when all tasks are launched 
> at the same time. As a result, delay scheduling becomes the biggest obstacle 
> for the barrier taskset  to get scheduled. And the application can be easily 
> fail with barrier taskset when delay scheduling is on. So, probably, we 
> should recommend user to disable delay scheduling while using barrier 
> execution.
>  
> BTW, we could still support delay scheduling with barrier taskset if we find 
> a way to resolve SPARK-24818



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to