[ https://issues.apache.org/jira/browse/SPARK-19143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15904497#comment-15904497 ]
Saisai Shao commented on SPARK-19143: ------------------------------------- Hi all, I wrote a rough design doc based on the comments above, here is the link (https://docs.google.com/document/d/1DFWGHu4_GJapbbfXGWsot_z_W9Wka_39DFNmg9r9SAI/edit?usp=sharing). [~tgraves] [~vanzin] [~mridulm80] please review and comment, greatly appreciate your suggestions. > API in Spark for distributing new delegation tokens (Improve delegation token > handling in secure clusters) > ---------------------------------------------------------------------------------------------------------- > > Key: SPARK-19143 > URL: https://issues.apache.org/jira/browse/SPARK-19143 > Project: Spark > Issue Type: Improvement > Components: Spark Core, YARN > Affects Versions: 2.0.2, 2.1.0 > Reporter: Ruslan Dautkhanov > > Spin off from SPARK-14743 and comments chain in [recent comments| > https://issues.apache.org/jira/browse/SPARK-5493?focusedCommentId=15802179&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15802179] > in SPARK-5493. > Spark currently doesn't have a way for distribution new delegation tokens. > Quoting [~vanzin] from SPARK-5493 > {quote} > IIRC Livy doesn't yet support delegation token renewal. Once it reaches the > TTL, the session is unusable. > There might be ways to hack support for that without changes in Spark, but > I'd like to see a proper API in Spark for distributing new delegation tokens. > I mentioned that in SPARK-14743, but although that bug is closed, that > particular feature hasn't been implemented yet. > {quote} > Other thoughts? -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org