[ https://issues.apache.org/jira/browse/SPARK-12316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15150616#comment-15150616 ]
Thomas Graves commented on SPARK-12316: --------------------------------------- [~hshreedharan] I think what you are saying also makes sense but is a much bigger change. as I mention on the Pr we just checked for the credentials file so if it didn't get renewed then something strange happened anyway so delaying 1 minute to retry seems reasonable. We can definitely add in more logic around this too. For instance only retry a certain number of tries or if the staging dir is gone rather then no files within it, immediately exit but I think that can be done separately. Please comment on the PR if you have alternate ideas. > Stack overflow with endless call of `Delegation token thread` when > application end. > ----------------------------------------------------------------------------------- > > Key: SPARK-12316 > URL: https://issues.apache.org/jira/browse/SPARK-12316 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 1.6.0 > Reporter: SaintBacchus > Assignee: SaintBacchus > Attachments: 20151210045149.jpg, 20151210045533.jpg > > > When application end, AM will clean the staging dir. > But if the driver trigger to update the delegation token, it will can't find > the right token file and then it will endless cycle call the method > 'updateCredentialsIfRequired'. > Then it lead to StackOverflowError. > !https://issues.apache.org/jira/secure/attachment/12779495/20151210045149.jpg! > !https://issues.apache.org/jira/secure/attachment/12779496/20151210045533.jpg! -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org