[ https://issues.apache.org/jira/browse/SPARK-37863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zhou Yifan updated SPARK-37863: ------------------------------- Description: Spark Driver may take a long time to startup when running with cluster mode, if YARN temporarily does not have enough resources, or HDFS's performance is poor due to high pressure. After`submitTime` is added, we can detect such situation by comparing it with the `spark.app.startTime`(already exists) . was: Spark Driver may take a long time to startup when running with cluster mode, if YARN temporarily does not have enough resources, or HDFS's performance is poor due to high pressure. If `submitTime` is added, we can detect such situation by comparing it with the `spark.app.startTime`(already exists) . > Add submitTime for Spark Application > ------------------------------------ > > Key: SPARK-37863 > URL: https://issues.apache.org/jira/browse/SPARK-37863 > Project: Spark > Issue Type: New Feature > Components: Spark Submit > Affects Versions: 3.3.0 > Reporter: Zhou Yifan > Priority: Major > > Spark Driver may take a long time to startup when running with cluster mode, > if YARN temporarily does not have enough resources, or HDFS's performance is > poor due to high pressure. > After`submitTime` is added, we can detect such situation by comparing it with > the `spark.app.startTime`(already exists) . -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org