Robert Kanter created HDFS-4951: ----------------------------------- Summary: FsShell commands using secure httpfs throw exceptions due to missing TokenRenewer Key: HDFS-4951 URL: https://issues.apache.org/jira/browse/HDFS-4951 Project: Hadoop HDFS Issue Type: Bug Components: security Affects Versions: 3.0.0 Reporter: Robert Kanter Assignee: Robert Kanter
It looks like there isn't a {{TokenRenewer}} for HttpFS delegation tokens ({{HTTPFS_DELEGATION_TOKENS}} tokens, so when it goes to cancel the token, it throws an exception: {noformat} $ hadoop fs -ls webhdfs://host:14000 // File listing omitted 13/06/21 13:09:04 WARN token.Token: No TokenRenewer defined for token kind HTTPFS_DELEGATION_TOKEN 13/06/21 13:09:04 WARN util.ShutdownHookManager: ShutdownHook 'ClientFinalizer' failed, java.lang.UnsupportedOperationException: Token cancel is not supported for HTTPFS_DELEGATION_TOKEN tokens java.lang.UnsupportedOperationException: Token cancel is not supported for HTTPFS_DELEGATION_TOKEN tokens at org.apache.hadoop.security.token.Token$TrivialRenewer.cancel(Token.java:417) at org.apache.hadoop.security.token.Token.cancel(Token.java:382) at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.cancel(DelegationTokenRenewer.java:146) at org.apache.hadoop.fs.DelegationTokenRenewer$RenewAction.access$200(DelegationTokenRenewer.java:58) at org.apache.hadoop.fs.DelegationTokenRenewer.removeRenewAction(DelegationTokenRenewer.java:233) at org.apache.hadoop.hdfs.web.WebHdfsFileSystem.close(WebHdfsFileSystem.java:790) at org.apache.hadoop.fs.FileSystem$Cache.closeAll(FileSystem.java:2398) at org.apache.hadoop.fs.FileSystem$Cache$ClientFinalizer.run(FileSystem.java:2414) at org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54) {noformat} WebHDFS doesn't have this problem because it has a {{TokenRenewer}}. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira