Andrew Or created SPARK-3591: -------------------------------- Summary: Yarn cluster mode fires but does not forget Key: SPARK-3591 URL: https://issues.apache.org/jira/browse/SPARK-3591 Project: Spark Issue Type: Improvement Components: YARN Affects Versions: 1.1.0 Reporter: Andrew Or
After launching an application through yarn-cluster mode, the SparkSubmit process sticks around and enters a monitoring loop to track the application's status. This is really a responsibility that belongs to a different process, such that SparkSubmit can run yarn-cluster applications in a fire-and-forget mode. We currently already do this for standalone-cluster mode. we should do it for yarn-cluster mode too. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org