[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17259338#comment-17259338 ]
Hyukjin Kwon commented on SPARK-33986: -------------------------------------- Do other applications work fine in cluster modes? > Spark handle always return LOST status in standalone cluster mode with Spark > launcher > ------------------------------------------------------------------------------------- > > Key: SPARK-33986 > URL: https://issues.apache.org/jira/browse/SPARK-33986 > Project: Spark > Issue Type: Question > Components: Spark Submit > Affects Versions: 2.4.4 > Environment: apache hadoop 2.6.5 > apache spark 2.4.4 > Reporter: ZhongyuWang > Priority: Major > > I can use it to submit spark app successfully in standalone client/yarn > client/yarn cluster mode,and get correct app status, but when i submit spark > app in standalone cluster mode, Spark handle always return LOST status(once) > and app running stablely until FINISHED( handle wasn't get any state change > infomation). I noticed when I submited app from code, after a while, the > SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher > redirect log) doesn't have any useful information. > this is my pseudo code, > {code:java} > SparkAppHandle handle = launcher.startApplication(new > SparkAppHandle.Listener() { > @Override > public void stateChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > @Override > public void infoChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > });{code} > any idea ? thx -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org