[ https://issues.apache.org/jira/browse/SPARK-29880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120731#comment-17120731 ]
Apache Spark commented on SPARK-29880: -------------------------------------- User 'caneGuy' has created a pull request for this issue: https://github.com/apache/spark/pull/28688 > Handle submit exception when target hadoop cluster is Federation > ---------------------------------------------------------------- > > Key: SPARK-29880 > URL: https://issues.apache.org/jira/browse/SPARK-29880 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 3.1.0 > Reporter: zhoukang > Priority: Major > > When we submit application to federation yarn cluster. Since > getYarnClusterMetrics is not implemented. The submission will exit with > failure. > {code:java} > def submitApplication(): ApplicationId = { > ResourceRequestHelper.validateResources(sparkConf) > var appId: ApplicationId = null > try { > launcherBackend.connect() > yarnClient.init(hadoopConf) > yarnClient.start() > logInfo("Requesting a new application from cluster with %d NodeManagers" > .format(yarnClient.getYarnClusterMetrics.getNumNodeManagers)) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org