[ https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15943284#comment-15943284 ]
Thomas Graves commented on SPARK-19143: --------------------------------------- I assume this needs to go through the new spip process: http://spark.apache.org/improvement-proposals.html > API in Spark for distributing new delegation tokens (Improve delegation token > handling in secure clusters) > ---------------------------------------------------------------------------------------------------------- > > Key: SPARK-19143 > URL: https://issues.apache.org/jira/browse/SPARK-19143 > Project: Spark > Issue Type: Improvement > Components: Spark Core, YARN > Affects Versions: 2.0.2, 2.1.0 > Reporter: Ruslan Dautkhanov > > Spin off from SPARK-14743 and comments chain in [recent comments| > https://issues.apache.org/jira/browse/SPARK-5493?focusedCommentId=15802179&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15802179] > in SPARK-5493. > Spark currently doesn't have a way for distribution new delegation tokens. > Quoting [~vanzin] from SPARK-5493 > {quote} > IIRC Livy doesn't yet support delegation token renewal. Once it reaches the > TTL, the session is unusable. > There might be ways to hack support for that without changes in Spark, but > I'd like to see a proper API in Spark for distributing new delegation tokens. > I mentioned that in SPARK-14743, but although that bug is closed, that > particular feature hasn't been implemented yet. > {quote} > Other thoughts? -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org