deshanxiao created SPARK-26954:
----------------------------------

             Summary: Do not attemp when user code throws exception
                 Key: SPARK-26954
                 URL: https://issues.apache.org/jira/browse/SPARK-26954
             Project: Spark
          Issue Type: Improvement
          Components: YARN
    Affects Versions: 2.4.0, 2.3.3
            Reporter: deshanxiao


Yarn attemps the failed App depending on YarnRMClient#unregister. However, some 
attemps are useless:

{code:java}
sc.parallelize(Seq(1,2,3)).map(_ => throw new 
RuntimeException("exception")).collect()
{code}

Some environment errors, such as node dead, attemps reasonablely.




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to