[ https://issues.apache.org/jira/browse/HADOOP-12563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15134394#comment-15134394 ]
Steve Loughran commented on HADOOP-12563: ----------------------------------------- SLIDER-1081 added a similar command, in order to create all the tokens needed to simulate launching slider and spark under OOzie. {{slider tokens}} lets you create a token file with HDFS, RM and ATS delegation tokens, and to list the contents of a file. Tokens will be created as the current user unless keytab and principal are defined. Looking at that code, If I were to evolve it I'd add # a {{renew}} option: go through the tokens, renew them. # a way to explicitly list the HDFS, webhdfs, RM, NN, .. endpoints. # a way to explicitly identify the classname + endpoint of other token providers (hbase, hive, ...) There's a class there, {{CredentialUtils| https://github.com/apache/incubator-slider/blob/develop/slider-core/src/main/java/org/apache/slider/core/launch/CredentialUtils.java}} which contains core functions usable here and by YARN applications. > Updated utility to create/modify token files > -------------------------------------------- > > Key: HADOOP-12563 > URL: https://issues.apache.org/jira/browse/HADOOP-12563 > Project: Hadoop Common > Issue Type: New Feature > Affects Versions: 3.0.0 > Reporter: Allen Wittenauer > Assignee: Matthew Paduano > Attachments: HADOOP-12563.01.patch, HADOOP-12563.02.patch, > HADOOP-12563.03.patch, HADOOP-12563.04.patch, HADOOP-12563.05.patch, > HADOOP-12563.06.patch, example_dtutil_commands_and_output.txt, > generalized_token_case.pdf > > > hdfs fetchdt is missing some critical features and is geared almost > exclusively towards HDFS operations. Additionally, the token files that are > created use Java serializations which are hard/impossible to deal with in > other languages. It should be replaced with a better utility in common that > can read/write protobuf-based token files, has enough flexibility to be used > with other services, and offers key functionality such as append and rename. > The old version file format should still be supported for backward > compatibility, but will be effectively deprecated. > A follow-on JIRA will deprecrate fetchdt. -- This message was sent by Atlassian JIRA (v6.3.4#6332)