Sergey Nuyanzin created FLINK-38502:
---------------------------------------
Summary: A number of Hadoop related tests failing with
UnsupportedOperationException: getSubject is not supported
Key: FLINK-38502
URL: https://issues.apache.org/jira/browse/FLINK-38502
Project: Flink
Issue Type: Sub-task
Reporter: Sergey Nuyanzin
for instance
{{MemoryExecutionGraphInfoStoreITCase#testPutSuspendedJobOnClusterShutdown}}
fails as
{noformat}
org.apache.flink.util.FlinkRuntimeException:
java.lang.UnsupportedOperationException: getSubject is not supported
at
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager.lambda$obtainDelegationTokensAndGetNextRenewal$0(DefaultDelegationTokenManager.java:281)
at
java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:214)
at
java.base/java.util.HashMap$ValueSpliterator.forEachRemaining(HashMap.java:1788)
at
java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:570)
at
java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:560)
at
java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:921)
at
java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:265)
at
java.base/java.util.stream.ReferencePipeline.reduce(ReferencePipeline.java:698)
at
java.base/java.util.stream.ReferencePipeline.min(ReferencePipeline.java:744)
at
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager.obtainDelegationTokensAndGetNextRenewal(DefaultDelegationTokenManager.java:286)
at
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager.obtainDelegationTokens(DefaultDelegationTokenManager.java:242)
at
org.apache.flink.runtime.minicluster.MiniCluster.start(MiniCluster.java:432)
at
org.apache.flink.runtime.dispatcher.MemoryExecutionGraphInfoStoreITCase.testPutSuspendedJobOnClusterShutdown(MemoryExecutionGraphInfoStoreITCase.java:57)
at java.base/java.lang.reflect.Method.invoke(Method.java:565)
at
org.apache.flink.util.TestNameProvider$1.evaluate(TestNameProvider.java:45)
Caused by: java.lang.UnsupportedOperationException: getSubject is not supported
at java.base/javax.security.auth.Subject.getSubject(Subject.java:277)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:700)
at
org.apache.flink.runtime.security.token.hadoop.HadoopFSDelegationTokenProvider.delegationTokensRequired(HadoopFSDelegationTokenProvider.java:103)
at
org.apache.flink.runtime.security.token.DefaultDelegationTokenManager.lambda$obtainDelegationTokensAndGetNextRenewal$0(DefaultDelegationTokenManager.java:259)
... 14 more
{noformat}
The reason seems same: Security manager removal
It looks like there is some activity about that in Hadoop
https://github.com/apache/hadoop/pull/7892
and https://issues.apache.org/jira/browse/HADOOP-19574
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
