[
https://issues.apache.org/jira/browse/TEZ-4109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999191#comment-16999191
]
László Bodor edited comment on TEZ-4109 at 12/18/19 2:04 PM:
-------------------------------------------------------------
e.g. new log message in am logs (tez.am.log.level=DEBUG):
{code}
Credentials: #amTokens=3,
Services=(YARN_AM_RM_TOKEN),10.14.67.148:8020(HDFS_DELEGATION_TOKEN),application_1575894822778_0013(tez.job),
TokenDetails=Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
application_id { id: 13 cluster_timestamp: 1575894822778 } attemptId: 1 }
keyId: -2036341922),Kind: HDFS_DELEGATION_TOKEN, Service: 10.14.67.148:8020,
Ident: (token for hive: HDFS_DELEGATION_TOKEN
owner=hive/dev-lbodor-hiveontez-sec-3.domain.com@REALM, renewer=yarn,
realUser=, issueDate=1576677644719, maxDate=1577282444719,
sequenceNumber=148649, masterKeyId=46),Kind: tez.job, Service:
application_1575894822778_0013, Ident: 1e 61 70 70 6c 69 63 61 74 69 6f 6e 5f
31 35 37 35 38 39 34 38 32 32 37 37 38 5f 30 30 31 33
{code}
was (Author: abstractdog):
e.g. new log messages in am logs (tez.am.log.level=DEBUG):
{code}
Credentials: #amTokens=3,
Services=(YARN_AM_RM_TOKEN),10.14.67.148:8020(HDFS_DELEGATION_TOKEN),application_1575894822778_0013(tez.job),
TokenDetails=Kind: YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId {
application_id { id: 13 cluster_timestamp: 1575894822778 } attemptId: 1 }
keyId: -2036341922),Kind: HDFS_DELEGATION_TOKEN, Service: 10.14.67.148:8020,
Ident: (token for hive: HDFS_DELEGATION_TOKEN
owner=hive/dev-lbodor-hiveontez-sec-3.domain.com@REALM, renewer=yarn,
realUser=, issueDate=1576677644719, maxDate=1577282444719,
sequenceNumber=148649, masterKeyId=46),Kind: tez.job, Service:
application_1575894822778_0013, Ident: 1e 61 70 70 6c 69 63 61 74 69 6f 6e 5f
31 35 37 35 38 39 34 38 32 32 37 37 38 5f 30 30 31 33
{code}
> Improve TezCommonUtils.getCredentialsInfo and use it from more contexts
> -----------------------------------------------------------------------
>
> Key: TEZ-4109
> URL: https://issues.apache.org/jira/browse/TEZ-4109
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Attachments: TEZ-4109.01.patch
>
>
> While debugging token related issues, I found the current implementation of
> TezCommonUtils.getCredentialsInfo doesn't provide enough info about tokens.
> 1. I think on DEBUG level it should give more verbose output
> currently it's
> {code}
> token.getService()).append("(").append(token.getKind()).append(")")
> {code}
> but in case of delegation token issue, we would need to see token's full
> string representation, like this below:
> {code}
> Kind: HDFS_DELEGATION_TOKEN, Service: 10.14.67.148:8020, Ident: (token for
> hive: HDFS_DELEGATION_TOKEN
> owner=hive/dev-lbodor-hiveontez-sec-3.domain.com@REALM, renewer=yarn,
> realUser=, issueDate=1573566780144, maxDate=1574171580144,
> sequenceNumber=7611, masterKeyId=3)
> {code}
> 2. It should be called from more code paths (e.g. from within tasks), so it's
> going to let us follow tokens for every level of execution (AM, Container,
> Task)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
