[ https://issues.apache.org/jira/browse/SPARK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ZhongyuWang updated SPARK-33986: -------------------------------- Description: I can use it to submit spark app successfully in standalone client/yarn client/yarn cluster mode,and get correct app status, but when i submit spark app in standalone cluster mode, Spark handle always return LOST status(once) and app running stablely until FINISHED( handle wasn't get any state change infomation). I noticed when I submited app from code, after a while, the SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher redirect log) doesn't have any useful information. this is my pseudo code, {code:java} SparkAppHandle handle = launcher.startApplication(new SparkAppHandle.Listener() { @Override public void stateChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } @Override public void infoChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } });{code} any idea ? thx was: I can use it to submit spark app successfully in standalone client/yarn client/yarn cluster mode,and get correct app status, but when i submit spark app in standalone cluster mode, Spark handle always return LOST status(once) and app running stablely until FINISHED( handle wasn't get any state change infomation). I noticed when I submited app from code, after a while, the SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher redirect log) doesn't have any useful information. this is my pseudo code, {code:java} SparkAppHandle handle = launcher.startApplication(new SparkAppHandle.Listener() { @Override public void stateChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } @Override public void infoChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } });{code} any idea ? thx > Spark handle always return LOST status in standalone cluster mode with Spark > launcher > ------------------------------------------------------------------------------------- > > Key: SPARK-33986 > URL: https://issues.apache.org/jira/browse/SPARK-33986 > Project: Spark > Issue Type: Question > Components: Spark Submit > Affects Versions: 2.4.4 > Environment: apache hadoop 2.6.5 > apache spark 2.4.4 > Reporter: ZhongyuWang > Priority: Major > > I can use it to submit spark app successfully in standalone client/yarn > client/yarn cluster mode,and get correct app status, but when i submit spark > app in standalone cluster mode, Spark handle always return LOST status(once) > and app running stablely until FINISHED( handle wasn't get any state change > infomation). I noticed when I submited app from code, after a while, the > SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher > redirect log) doesn't have any useful information. > this is my pseudo code, > {code:java} > SparkAppHandle handle = launcher.startApplication(new > SparkAppHandle.Listener() { > @Override > public void stateChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > @Override > public void infoChanged(SparkAppHandle handle) { > stateChangedHandle(handle.getAppId(), jobId, code, execId, > handle.getState(), driverInfo, request, infoLog, errorLog); > } > });{code} > any idea ? thx -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org