[
https://issues.apache.org/jira/browse/FLINK-9525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16501391#comment-16501391
]
ASF GitHub Bot commented on FLINK-9525:
---------------------------------------
GitHub user yew1eb opened a pull request:
https://github.com/apache/flink/pull/6118
[FLINK-9525][filesystem] Add missing `META-INF/services/*FileSystemFactory`
file for flink-hadoop-fs
## What is the purpose of the change
more details, see JIRA:<https://issues.apache.org/jira/browse/FLINK-9525>
## Brief change log
- *Add missing
`META-INF/services/org.apache.flink.core.fs.FileSystemFactory` file for
flink-hadoop-fs module*
## Verifying this change
add this missing file, and rebuild flink from source, then test my
test-flink-job (includes `hadoop-common` and `hadoop-dfs` dependencies) pass.
## Does this pull request potentially affect one of the following parts:
- Dependencies (does it add or upgrade a dependency): (yes / **no**)
- The public API, i.e., is any changed class annotated with
`@Public(Evolving)`: (yes / **no**)
- The serializers: (yes / **no** / don't know)
- The runtime per-record code paths (performance sensitive): (yes /
**no** / don't know)
- Anything that affects deployment or recovery: JobManager (and its
components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes / **no** / don't know)
- The S3 file system connector: (yes / **no** / don't know)
## Documentation
- Does this pull request introduce a new feature? (yes / **no**)
- If yes, how is the feature documented? (not applicable / docs /
JavaDocs / not documented)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yew1eb/flink FLINK-9525
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/flink/pull/6118.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6118
----
commit 73006996a2d06649cac72a53559c12689fab82b8
Author: yew1eb <yew1eb@...>
Date: 2018-06-05T06:50:41Z
[FLINK-9525][filesystem] Add this missing
META-INF/services/*FileSystemFactory file in flink-hadoop-fs module
----
> Missing META-INF/services/*FileSystemFactory in flink-hadoop-fs module
> ----------------------------------------------------------------------
>
> Key: FLINK-9525
> URL: https://issues.apache.org/jira/browse/FLINK-9525
> Project: Flink
> Issue Type: Bug
> Components: FileSystem
> Affects Versions: 1.4.0, 1.5.0, 1.6.0
> Reporter: Hai Zhou
> Assignee: Hai Zhou
> Priority: Blocker
> Fix For: 1.6.0, 1.5.1
>
> Attachments: [email protected]
>
>
> if flink job dependencies includes `hadoop-common` and `hadoop-hdfs`, will
> throw runtime error.
> like this case:
> [https://stackoverflow.com/questions/47890596/java-util-serviceconfigurationerror-org-apache-hadoop-fs-filesystem-provider-o].
> the root cause:
> see {{org.apache.flink.core.fs.FileSystem}}
> This class will load all available file system factories via
> {{ServiceLoader.load(FileSystemFactory.class)}}.
> Since {{ META-INF / services / org.apache.flink.core.fs.FileSystemFactory }}
> file in the classpath does not have an
> `org.apache.flink.runtime.fs.hdfs.HadoopFsFactory`,
> and finaly only loaded one available {{LocalFileSystemFactory}} .
> more error messages see this screenshot.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
