[
https://issues.apache.org/jira/browse/YARN-11854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zeekling updated YARN-11854:
----------------------------
Description:
In RM, the key configurations are as follows:
fs.defaultFS=hdfs://nsfed
yarn.nodemanager.remote-app-log-dir=hdfs://ns1/tmp/logs
The client has requested tokens for the following nameservices:
hdfs://nsfed,hdfs://ns1,hdfs://hacluster
After more than 7 days, only the delegation token for hdfs://nsfed will be
request new delegation token.
In the function `DelegationTokenRenewer#requestNewHdfsDelegationTokenIfNeeded`,
when the delegation token is nearing the `maxDate` time, all HDFS delegation
tokens under the current job are deleted. However, in
`DelegationTokenRenewer#requestNewHdfsDelegationTokenAsProxyUser`, only a new
delegation token is requested for the nameservice configured in the
`fs.defaultFS` of the RM.
was:
In RM, the key configurations are as follows:
fs.defaultFS=hdfs://nsfed
yarn.nodemanager.remote-app-log-dir=hdfs://ns1/tmp/logs
The client has requested tokens for the following nameservices:
hdfs://nsfed,hdfs://ns1,hdfs://hacluster
After more than 7 days, only the delegation token for hdfs://nsfed will be
request new delegation token.
The reanson is we when
> The HDFS delegation token in ResourceManager only requested a new delegation
> token for some of the them after 7 days.
> ----------------------------------------------------------------------------------------------------------------------
>
> Key: YARN-11854
> URL: https://issues.apache.org/jira/browse/YARN-11854
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: zeekling
> Priority: Critical
>
> In RM, the key configurations are as follows:
> fs.defaultFS=hdfs://nsfed
> yarn.nodemanager.remote-app-log-dir=hdfs://ns1/tmp/logs
> The client has requested tokens for the following nameservices:
> hdfs://nsfed,hdfs://ns1,hdfs://hacluster
> After more than 7 days, only the delegation token for hdfs://nsfed will be
> request new delegation token.
>
> In the function
> `DelegationTokenRenewer#requestNewHdfsDelegationTokenIfNeeded`, when the
> delegation token is nearing the `maxDate` time, all HDFS delegation tokens
> under the current job are deleted. However, in
> `DelegationTokenRenewer#requestNewHdfsDelegationTokenAsProxyUser`, only a new
> delegation token is requested for the nameservice configured in the
> `fs.defaultFS` of the RM.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
