[ https://issues.apache.org/jira/browse/SPARK-16095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15341903#comment-15341903 ]
Thomas Graves commented on SPARK-16095: --------------------------------------- FINISHED does not mean success, finished means it completed in some fashion on yarn, the FinalApplicationStatus is what tells you failed or success of the application itself. This is a YARN thing, state is what yarn things its in, accepted, running, finished, sometimes failed if it things went really bad, but the actual application status is the FinalApplicationStatus and that is what you should be looking at. > Yarn cluster mode should return consistent result for command line and > SparkLauncher > ------------------------------------------------------------------------------------ > > Key: SPARK-16095 > URL: https://issues.apache.org/jira/browse/SPARK-16095 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 2.0.0 > Reporter: Peng Zhang > > For an application with YarnApplicationState.FINISHED and > FinalApplicationStatus.FAILED, invoking spark-submit from command line will > got Exception, submit with SparkLauncher will got state with FINISHED which > means app succeeded. > Also because the above fact, in test YarnClusterSuite, assert with false > condition will not fail the test. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org