[
https://issues.apache.org/jira/browse/YARN-10410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
KWON BYUNGCHANG updated YARN-10410:
-----------------------------------
Attachment: YARN-10410.002.patch
> Does not work specifying the docker client configuration in distributed shell
> -----------------------------------------------------------------------------
>
> Key: YARN-10410
> URL: https://issues.apache.org/jira/browse/YARN-10410
> Project: Hadoop YARN
> Issue Type: Bug
> Components: applications/distributed-shell
> Affects Versions: 3.1.2
> Reporter: KWON BYUNGCHANG
> Priority: Major
> Attachments: YARN-10410.001.patch, YARN-10410.002.patch
>
>
> Job sumbit client side log
> {noformat}
> 2020-08-26 12:07:30,756 INFO distributedshell.Client: Got dt for hdfs://at;
> Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:at, Ident: (token for magnum:
> HDFS_DELEGATION_TOKEN owner=mag...@test.com, renewer=yarn, realUser=,
> issueDate=1598411249950, maxDate=1599275249950, sequenceNumber=1359401,
> masterKeyId=461)
> 2020-08-26 12:07:30,757 INFO distributedshell.Client: Got dt for hdfs://at;
> Kind: kms-dt, Service: kms://ht...@ranger-kms.test.com:9393/kms, Ident:
> (kms-dt owner=magnum, renewer=yarn, realUser=, issueDate=1598411250569,
> maxDate=1599016050569, sequenceNumber=2791602, masterKeyId=908)
> 2020-08-26 12:07:30,969 INFO util.DockerClientConfigHandler: Token read from
> Docker client configuration file: Kind: DOCKER_CLIENT_CREDENTIAL_TOKEN,
> Service: reg.test.com, Ident: (registryUrl: "reg.test.com" applicationId:
> "application_1593772175687_475926")
> {noformat}
>
> AM LOG
> {noformat}
> 20/08/26 12:07:33 INFO distributedshell.ApplicationMaster: Executing with
> tokens:
> 20/08/26 12:07:33 INFO distributedshell.ApplicationMaster: Kind:
> YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id:
> 475926 cluster_timestamp: 1593772175687 } attemptId: 1 } keyId: 1589057158)
> 20/08/26 12:07:33 INFO distributedshell.ApplicationMaster: Kind: kms-dt,
> Service: kms://ht...@ranger-kms.test.com:9393/kms, Ident: (kms-dt
> owner=magnum, renewer=yarn, realUser=, issueDate=1598411250569,
> maxDate=1599016050569, sequenceNumber=2791602, masterKeyId=908)
> 20/08/26 12:07:33 INFO distributedshell.ApplicationMaster: Kind:
> HDFS_DELEGATION_TOKEN, Service: ha-hdfs:at, Ident: (token for magnum:
> HDFS_DELEGATION_TOKEN owner=mag...@test.com, renewer=yarn, realUser=,
> issueDate=1598411249950, maxDate=1599275249950, sequenceNumber=1359401,
> masterKeyId=461)
> 20/08/26 12:07:33 INFO impl.NMClientAsyncImpl: Upper bound of the thread pool
> size is 500
> 20/08/26 12:07:33 WARN distributedshell.ApplicationMaster: Timeline service
> is not enabled
> {noformat}
>
> On the client side in distributea shell, Client read docker_client_config and
> put it in credentials instances
> DOCKER_CLIENT_CREDENTIAL_TOKEN is not propagated to the container.
> eventually docker container launch that requires auth token failed.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
