[
https://issues.apache.org/jira/browse/HDFS-17778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18054721#comment-18054721
]
Yuming Wang commented on HDFS-17778:
------------------------------------
Exception in Spark:
{code:java}
Exception in thread "main" java.lang.UnsupportedOperationException: getSubject
is not supported
at java.base/javax.security.auth.Subject.getSubject(Subject.java:277)
at
org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:577)
at
org.apache.hadoop.conf.Configuration$Resource.getRestrictParserDefault(Configuration.java:291)
at
org.apache.hadoop.conf.Configuration$Resource.<init>(Configuration.java:259)
at
org.apache.hadoop.conf.Configuration$Resource.<init>(Configuration.java:251)
at
org.apache.hadoop.conf.Configuration.addResource(Configuration.java:978)
at org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:4064)
at org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:4021)
at
org.apache.spark.sql.hive.client.HiveClientImpl$.newHiveConf(HiveClientImpl.scala:1577)
at
org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver$.main(SparkSQLCLIDriver.scala:107)
at
org.apache.spark.sql.hive.thriftserver.SparkSQLCLIDriver.main(SparkSQLCLIDriver.scala)
at
java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
at java.base/java.lang.reflect.Method.invoke(Method.java:565)
at
org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at
org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:1105)
at
org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:194)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:217)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:91)
at
org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:1196)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:1205)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) {code}
> java.lang.UnsupportedOperationException: getSubject is not supported
> --------------------------------------------------------------------
>
> Key: HDFS-17778
> URL: https://issues.apache.org/jira/browse/HDFS-17778
> Project: Hadoop HDFS
> Issue Type: Bug
> Affects Versions: 3.4.1
> Reporter: Gary D. Gregory
> Priority: Major
>
> When the Apache Commons VFS' HDFS modules builds, it fails on Java 24:
> {noformat}
> [INFO] Running org.apache.commons.vfs2.provider.hdfs.HdfsFileProviderTest
> WARNING: A restricted method in java.lang.System has been called
> WARNING: java.lang.System::loadLibrary has been called by
> org.apache.hadoop.util.NativeCodeLoader in an unnamed module
> (file:/home/runner/.m2/repository/org/apache/hadoop/hadoop-common/3.4.1/hadoop-common-3.4.1.jar)
> WARNING: Use --enable-native-access=ALL-UNNAMED to avoid a warning for
> callers in this module
> WARNING: Restricted methods will be blocked in a future release unless native
> access is enabled
> 2025-05-01 18:52:30,832 [main] ERROR FSNamesystem initialization failed.
> java.lang.UnsupportedOperationException: getSubject is not supported
> at java.base/javax.security.auth.Subject.getSubject(Subject.java:277)
> ~[?:?]
> at
> org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:588)
> ~[hadoop-common-3.4.1.jar:?]
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:887)
> [hadoop-hdfs-3.4.1.jar:?]
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.<init>(FSNamesystem.java:851)
> [hadoop-hdfs-3.4.1.jar:?]
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:1396)
> [hadoop-hdfs-3.4.1.jar:?]
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.format(NameNode.java:495)
> [hadoop-hdfs-3.4.1.jar:?]
> at
> org.apache.hadoop.hdfs.DFSTestUtil.formatNameNode(DFSTestUtil.java:256)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.configureNameService(MiniDFSCluster.java:1158)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1042)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:974)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:594)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.hadoop.hdfs.MiniDFSCluster$Builder.build(MiniDFSCluster.java:533)
> [hadoop-hdfs-3.4.1-tests.jar:?]
> at
> org.apache.commons.vfs2.provider.hdfs.HdfsFileProviderTest.setUp(HdfsFileProviderTest.java:128)
> [test-classes/:?]
> at
> java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
> ~[?:?]
> at java.base/java.lang.reflect.Method.invoke(Method.java:565) ~[?:?]
> {noformat}
> For example:
> https://github.com/apache/commons-vfs/actions/runs/14781284149/job/41500576968
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
