[
https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148662#comment-15148662
]
Thomas Graves commented on SPARK-12316:
---------------------------------------
I'm not following how this ended up in an infinite loop. Can you please
describe exactly what you are seeing?
for instance, shutdown is happening you happen to hit
updateCredentialsIfRequired. But if the File isn't found you would get an
exception and fall back to schedule it an hour later in the catch NonFatal. If
the stop was already called then delegationTokenRenewer.shutdown() should have
happened and I assume schedule would have thrown (perhaps I'm wrong here).
> Stack overflow with endless call of `Delegation token thread` when
> application end.
> -----------------------------------------------------------------------------------
>
> Key: SPARK-12316
> URL: https://issues.apache.org/jira/browse/SPARK-12316
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: SaintBacchus
> Assignee: SaintBacchus
> Attachments: 20151210045149.jpg, 20151210045533.jpg
>
>
> When application end, AM will clean the staging dir.
> But if the driver trigger to update the delegation token, it will can't find
> the right token file and then it will endless cycle call the method
> 'updateCredentialsIfRequired'.
> Then it lead to StackOverflowError.
> !https://issues.apache.org/jira/secure/attachment/12779495/20151210045149.jpg!
> !https://issues.apache.org/jira/secure/attachment/12779496/20151210045533.jpg!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
