[jira] [Commented] (SPARK-3072) Yarn AM not always properly exiting after unregistering from RM
[ https://issues.apache.org/jira/browse/SPARK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101134#comment-14101134 ] Thomas Graves commented on SPARK-3072: -- Note that this also isn't an issue on hadoop 0.23 because there it shoots the containers after unregister. In hadoop 2.x it doesn't shoot them as aggressively to give the application time to cleanup . Yarn AM not always properly exiting after unregistering from RM --- Key: SPARK-3072 URL: https://issues.apache.org/jira/browse/SPARK-3072 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.0.2 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical The yarn application master doesn't always exit properly after unregistering from the RM. One way to reproduce is to ask for large containers ( 4g) but use jdk32 so that all of them fail. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3072) Yarn AM not always properly exiting after unregistering from RM
[ https://issues.apache.org/jira/browse/SPARK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14101331#comment-14101331 ] Apache Spark commented on SPARK-3072: - User 'tgravescs' has created a pull request for this issue: https://github.com/apache/spark/pull/2022 Yarn AM not always properly exiting after unregistering from RM --- Key: SPARK-3072 URL: https://issues.apache.org/jira/browse/SPARK-3072 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.0.2 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical The yarn application master doesn't always exit properly after unregistering from the RM. One way to reproduce is to ask for large containers ( 4g) but use jdk32 so that all of them fail. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-3072) Yarn AM not always properly exiting after unregistering from RM
[ https://issues.apache.org/jira/browse/SPARK-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098705#comment-14098705 ] Thomas Graves commented on SPARK-3072: -- Note that in yarn-cluster mode the client side does quit, but the application master is still running on the cluster. Yarn AM not always properly exiting after unregistering from RM --- Key: SPARK-3072 URL: https://issues.apache.org/jira/browse/SPARK-3072 Project: Spark Issue Type: Bug Components: YARN Affects Versions: 1.0.2 Reporter: Thomas Graves Assignee: Thomas Graves Priority: Critical The yarn application master doesn't always exit properly after unregistering from the RM. One way to reproduce is to ask for large containers ( 4g) but use jdk32 so that all of them fail. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
