[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ZhongyuWang updated SPARK-33986: -------------------------------- Comment: was deleted (was: Yes, other applications have the same scenario(in cluster mode, after a while, the SparkSubmit process was suddenly stopped). when i try to submit PI Spark example with spark-submit shell, SparkSubmit process was also stopped after submitted job to spark cluster(not supervise spark job)) > Spark handle always return LOST status in standalone cluster mode with Spark > launcher > ------------------------------------------------------------------------------------- > > Key: SPARK-33986 > URL: https://issues.apache.org/jira/browse/SPARK-33986 > Project: Spark > Issue Type: Question > Components: Spark Submit > Affects Versions: 2.4.4 > Environment: apache hadoop 2.6.5 > apache spark 2.4.4 > Reporter: ZhongyuWang > Priority: Major > > I can use it to submit spark app successfully in standalone client/yarn > client/yarn cluster mode,and get correct app status, but when i submit spark > app in standalone cluster mode, Spark handle always return LOST status(once) > and app running stablely until FINISHED( handle wasn't get any state change > infomation). I noticed when I submited app from code, after a while, the > SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher > redirect log) doesn't have any useful information. > this is my pseudo code, > {code:java} > SparkAppHandle handle = launcher.startApplication(new > SparkAppHandle.Listener() { > @Override > public void stateChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > @Override > public void infoChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > });{code} > any idea ? thx -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org