[
https://issues.apache.org/jira/browse/TEZ-4600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4600:
------------------------------
Summary: Secret managers in Tez should respect the algorithm set by hadoop
(was: ClientToAMTokenSecretManager in Tez should respect the algorithm set by
hadoop)
> Secret managers in Tez should respect the algorithm set by hadoop
> -----------------------------------------------------------------
>
> Key: TEZ-4600
> URL: https://issues.apache.org/jira/browse/TEZ-4600
> Project: Apache Tez
> Issue Type: Bug
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Time Spent: 20m
> Remaining Estimate: 0h
>
> after YARN-11738, hadoop can use a core-site config to use a default algorithm
> in case of a mismatch (as tez uses the hardcoded value from TEZ-1596), the
> dagClient and server communication fails with:
> {code}
> Caused by: org.apache.hadoop.ipc.RemoteException: DIGEST-SHA: digest response
> format violation. Mismatched response.
> {code}
> https://github.com/apache/hadoop/commit/b9060fc00df89a4c73d5b98947688b200b79901f
> {code}
> static {
> Configuration conf = new Configuration();
> String algorithm = conf.get(
>
> CommonConfigurationKeysPublic.HADOOP_SECURITY_SECRET_MANAGER_KEY_GENERATOR_ALGORITHM_KEY,
>
> CommonConfigurationKeysPublic.HADOOP_SECURITY_SECRET_MANAGER_KEY_GENERATOR_ALGORITHM_DEFAULT);
> LOG.info("Selected hash algorithm: {}", algorithm);
> SELECTED_ALGORITHM = algorithm;
> int length = conf.getInt(
>
> CommonConfigurationKeysPublic.HADOOP_SECURITY_SECRET_MANAGER_KEY_LENGTH_KEY,
>
> CommonConfigurationKeysPublic.HADOOP_SECURITY_SECRET_MANAGER_KEY_LENGTH_DEFAULT);
> LOG.info("Selected hash key length:{}", length);
> SELECTED_LENGTH = length;
> }
> {code}
> in TezAM, new Configuration() is not suitable especially in static
> initializer time, because the actual configuration values come as a payload
> from the upstream application (like HiveServer2)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
