Martijn Visser created FLINK-41379:
--------------------------------------
Summary: Flink on YARN doesn't report missing Kerberos credentials
with Hadoop 3
Key: FLINK-41379
URL: https://issues.apache.org/jira/browse/FLINK-41379
Project: Flink
Issue Type: Bug
Components: Deployment / YARN
Reporter: Martijn Visser
Assignee: Martijn Visser
YarnClusterDescriptor only checks for Kerberos credentials when the login
user's authentication method is KERBEROS
(HadoopUtils.isKerberosSecurityEnabled). Without a ticket, Hadoop 3 reports
SIMPLE, while Hadoop 2.10.2 reported KERBEROS, so the check is skipped. Instead
of failing with "Hadoop security with Kerberos is enabled but the login user
does not have Kerberos credentials or delegation tokens!", the client keeps
retrying the ResourceManager.
This already affects Hadoop 3 users. With FLINK-41378 raising the minimum to
Hadoop 3.4.3 it affects every secured YARN deployment. Found while moving the
secure YARN e2e test to Hadoop 3.4.3.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
