[ https://issues.apache.org/jira/browse/FLINK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501359#comment-16501359 ]
Hai Zhou commented on FLINK-9525: --------------------------------- After adding this missing file in the {{flink-hadoop-fs}} module, and again build flink from source , my flink job will work properly。 > Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module > ---------------------------------------------------------------------- > > Key: FLINK-9525 > URL: https://issues.apache.org/jira/browse/FLINK-9525 > Project: Flink > Issue Type: Bug > Components: FileSystem > Affects Versions: 1.4.0, 1.5.0, 1.6.0 > Reporter: Hai Zhou > Assignee: Hai Zhou > Priority: Blocker > Fix For: 1.6.0, 1.5.1 > > Attachments: wx20180605-142...@2x.png > > > if flink job dependencies includes `hadoop-common` and `hadoop-hdfs`, will > throw runtime error. > like this case: > [https://stackoverflow.com/questions/47890596/java-util-serviceconfigurationerror-org-apache-hadoop-fs-filesystem-provider-o]. > the root cause: > see {{org.apache.flink.core.fs.FileSystem}} > This class will load all available file system factories via > {{ServiceLoader.load(FileSystemFactory.class)}}. > Since {{ META-INF / services / org.apache.flink.core.fs.FileSystemFactory }} > file in the classpath does not have an > `org.apache.flink.runtime.fs.hdfs.HadoopFsFactory`, > and finaly only loaded one available {{LocalFileSystemFactory}} . > more error messages see this screenshot. -- This message was sent by Atlassian JIRA (v7.6.3#76005)