[ https://issues.apache.org/jira/browse/SPARK-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-3413. ------------------------------ Resolution: Cannot Reproduce > Spark Blocked due to Executor lost in FIFO MODE > ----------------------------------------------- > > Key: SPARK-3413 > URL: https://issues.apache.org/jira/browse/SPARK-3413 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 0.9.2 > Reporter: Patrick Liu > > I run spark on yarn. > Spark scheduler is running in FIFO mode. > I have 80 worker instances setup. However, as time passes, some worker will > be lost. (Killed by JVM when OOM, etc). > But some tasks will still run in those executors. > Obviously the task will never finished. > Then the stage will not finish. So the later stages will be blocked. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org