[
https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148023#comment-15148023
]
SaintBacchus commented on SPARK-12316:
--------------------------------------
[~tgraves] The application would not hit the same condition because one minute
later all the non-deamon threads had exited.
[~hshreedharan] Driver and ApplicationMaster will both try to delete the
staging directory. If we want to make sure the ExecutorDelegationTokenUpdater
stopped before the ApplicationMaster had exited, it will have to add some RPC
call between these threads. So I think add a try after one minuter may be an
easy to avoid this issue.
> Stack overflow with endless call of `Delegation token thread` when
> application end.
> -----------------------------------------------------------------------------------
>
> Key: SPARK-12316
> URL: https://issues.apache.org/jira/browse/SPARK-12316
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: SaintBacchus
> Assignee: SaintBacchus
> Attachments: 20151210045149.jpg, 20151210045533.jpg
>
>
> When application end, AM will clean the staging dir.
> But if the driver trigger to update the delegation token, it will can't find
> the right token file and then it will endless cycle call the method
> 'updateCredentialsIfRequired'.
> Then it lead to StackOverflowError.
> !https://issues.apache.org/jira/secure/attachment/12779495/20151210045149.jpg!
> !https://issues.apache.org/jira/secure/attachment/12779496/20151210045533.jpg!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
