[
https://issues.apache.org/jira/browse/HDFS-7206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164812#comment-14164812
]
Yi Liu commented on HDFS-7206:
------------------------------
This warning is because {{tokenKindMap}} is initialized through service loader
of {{TokenIdentifier}} and _token kind_ is const for each one. But for
{{org.apache.hadoop.security.token.delegation.web.DelegationTokenIdentifier}},
it has not been added to provider-configuration file and the _token kind_ is
variable, so service loader can't find it.
dt for KMS is in this case. It works fine since server side construct that
kind of token identifier directly, this warnings happen in client side where
try to log the token and need to decode it.
The patch simply suppresses the warnings to debug message, otherwise there are
too many such warning and will confuse user.
> Fix warning of "token.Token: Cannot find class for token kind kms-dt" for KMS
> when running jobs on Encryption zones
> -------------------------------------------------------------------------------------------------------------------
>
> Key: HDFS-7206
> URL: https://issues.apache.org/jira/browse/HDFS-7206
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: encryption
> Affects Versions: 2.6.0
> Reporter: Yi Liu
> Assignee: Yi Liu
>
> This issue is produced when running MapReduce job and encryption zones are
> configured.
> {quote}
> 14/10/09 05:06:02 INFO security.TokenCache: Got dt for
> hdfs://hnode1.sh.intel.com:9000; Kind: HDFS_DELEGATION_TOKEN, Service:
> 10.239.47.8:9000, Ident: (HDFS_DELEGATION_TOKEN token 21 for user)
> 14/10/09 05:06:02 WARN token.Token: Cannot find class for token kind kms-dt
> 14/10/09 05:06:02 INFO security.TokenCache: Got dt for
> hdfs://hnode1.sh.intel.com:9000; Kind: kms-dt, Service: 10.239.47.8:16000,
> Ident: 00 04 75 73 65 72 04 79 61 72 6e 00 8a 01 48 f1 8e 85 07 8a 01 49 15
> 9b 09 07 04 02
> 14/10/09 05:06:03 INFO input.FileInputFormat: Total input paths to process : 1
> 14/10/09 05:06:03 INFO mapreduce.JobSubmitter: number of splits:1
> 14/10/09 05:06:03 INFO mapreduce.JobSubmitter: Submitting tokens for job:
> job_1412723333197_0004
> 14/10/09 05:06:03 WARN token.Token: Cannot find class for token kind kms-dt
> 14/10/09 05:06:03 WARN token.Token: Cannot find class for token kind kms-dt
> {quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
