zhuoshaojian created FLINK-34733: ------------------------------------ Summary: OSS Filesystem throws ClassNotFoundException Key: FLINK-34733 URL: https://issues.apache.org/jira/browse/FLINK-34733 Project: Flink Issue Type: Bug Components: FileSystems Affects Versions: 1.17.2 Environment: Flink >= v1.17 Reporter: zhuoshaojian
The ClassNotFoundException was caused by this commit [[https://github.com/apache/flink/commit/52a2b98bb5af842633df0c051b5da95d437a6b2f]], which removed the relocation configuration from pom.xml.[FLINK-31612|https://issues.apache.org/jira/browse/FLINK-31612]. But in plugin flink-oss-fs-hadoop, the shaded prefix was hardcoded [https://github.com/apache/flink/blob/c0027e5777f9d77970fdb99bcc158d65ea48d514/flink-filesystems/flink-oss-fs-hadoop/src/main/java/org/apache/flink/fs/osshadoop/OSSFileSystemFactory.java#L50] This resulted in the exception: ``` Caused by: java.lang.ClassNotFoundException: org.apache.flink.fs.osshadoop.shaded.com.aliyun.oss.common.auth.EnvironmentVariableCredentialsProvider at java.net.URLClassLoader.findClass(Unknown Source) ~[?:?] at java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?] at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromComponentOnly(ComponentClassLoader.java:150) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.core.classloading.ComponentClassLoader.loadClassFromOwnerFirst(ComponentClassLoader.java:172) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.core.classloading.ComponentClassLoader.loadClass(ComponentClassLoader.java:107) ~[flink-dist-1.17.2.jar:1.17.2] at java.lang.ClassLoader.loadClass(Unknown Source) ~[?:?] at java.lang.Class.forName0(Native Method) ~[?:?] at java.lang.Class.forName(Unknown Source) ~[?:?] at org.apache.hadoop.fs.aliyun.oss.AliyunOSSUtils.getCredentialsProvider(AliyunOSSUtils.java:118) ~[?:?] at org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystemStore.initialize(AliyunOSSFileSystemStore.java:155) ~[?:?] at org.apache.hadoop.fs.aliyun.oss.AliyunOSSFileSystem.initialize(AliyunOSSFileSystem.java:349) ~[?:?] at org.apache.flink.fs.osshadoop.OSSFileSystemFactory.create(OSSFileSystemFactory.java:103) ~[?:?] at org.apache.flink.core.fs.PluginFileSystemFactory.create(PluginFileSystemFactory.java:62) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.core.fs.FileSystem.getUnguardedFileSystem(FileSystem.java:508) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.core.fs.FileSystem.get(FileSystem.java:409) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.core.fs.Path.getFileSystem(Path.java:274) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.blob.BlobUtils.createFileSystemBlobStore(BlobUtils.java:99) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.blob.BlobUtils.createBlobStoreFromConfig(BlobUtils.java:86) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.kubernetes.highavailability.KubernetesHaServicesFactory.createHAServices(KubernetesHaServicesFactory.java:41) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createCustomHAServices(HighAvailabilityServicesUtils.java:296) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.highavailability.HighAvailabilityServicesUtils.createHighAvailabilityServices(HighAvailabilityServicesUtils.java:139) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.createHaServices(ClusterEntrypoint.java:442) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.initializeServices(ClusterEntrypoint.java:391) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.runCluster(ClusterEntrypoint.java:282) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.lambda$startCluster$1(ClusterEntrypoint.java:232) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.security.contexts.NoOpSecurityContext.runSecured(NoOpSecurityContext.java:28) ~[flink-dist-1.17.2.jar:1.17.2] at org.apache.flink.runtime.entrypoint.ClusterEntrypoint.startCluster(ClusterEntrypoint.java:229) ~[flink-dist-1.17.2.jar:1.17.2] ... 2 more ``` -- This message was sent by Atlassian Jira (v8.20.10#820010)