ZhongyuWang created SPARK-33986: ----------------------------------- Summary: Spark handle always return LOST status in standalone cluster mode with Spark launcher Key: SPARK-33986 URL: https://issues.apache.org/jira/browse/SPARK-33986 Project: Spark Issue Type: Question Components: Spark Submit Affects Versions: 2.4.4 Environment: apache hadoop 2.6.5
apache spark 2.4.4 Reporter: ZhongyuWang I can use it to submit spark app successfully in standalone client/yarn client/yarn cluster mode,and get correct app status, but when i submit spark app in standalone cluster mode, Spark handle always return LOST status(once) and app running stablely until FINISHED( handle wasn't get any state change infomation). I noticed when I submited app from code, after a while, the SparkSubmit process was suddenly stopped. I checked sparkSubmit log(launcher redirect log) doesn't have any useful information. this is my pseudo code, {code:java} SparkAppHandle handle = launcher.startApplication(new SparkAppHandle.Listener() { @Override public void stateChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } @Override public void infoChanged(SparkAppHandle handle) { stateChangedHandle(handle.getAppId(), jobId, code, execId, handle.getState(), driverInfo, request, infoLog, errorLog); } });{code} any idea ? thx -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org