[
https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15140024#comment-15140024
]
Hari Shreedharan commented on SPARK-12316:
------------------------------------------
So the issue is that the driver got rid of the staging directory before the
executors/client-mode-driver were done, correct? I don't think delaying is the
check - we should probably look at another solution - either wait for all
executors to be done before removing the staging directory, or if we find that
the staging directory is gone, just don't retry (because there is no point?)
> Stack overflow with endless call of `Delegation token thread` when
> application end.
> -----------------------------------------------------------------------------------
>
> Key: SPARK-12316
> URL: https://issues.apache.org/jira/browse/SPARK-12316
> Project: Spark
> Issue Type: Bug
> Components: YARN
> Affects Versions: 1.6.0
> Reporter: SaintBacchus
> Assignee: SaintBacchus
> Attachments: 20151210045149.jpg, 20151210045533.jpg
>
>
> When application end, AM will clean the staging dir.
> But if the driver trigger to update the delegation token, it will can't find
> the right token file and then it will endless cycle call the method
> 'updateCredentialsIfRequired'.
> Then it lead to StackOverflowError.
> !https://issues.apache.org/jira/secure/attachment/12779495/20151210045149.jpg!
> !https://issues.apache.org/jira/secure/attachment/12779496/20151210045533.jpg!
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
