[
https://issues.apache.org/jira/browse/HADOOP-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095091#comment-13095091
]
Luke Lu commented on HADOOP-7601:
---------------------------------
bq. we'll be bundling FS clients, but we have to test them.
Yes. I need to clarify that the fs implementations I mentioned is hadoop
FileSystem implementations of these fs clients. Typically there are only couple
files per client implementation, which is too small a granularity for separate
modules. Maybe we should call the module hadoop-fs-clients for bundled fs
clients.
In addition, I propose that we adopt a ServiceLoader interface say
FileSystemsProvider:
{code}
interface FileSystemsProvider {
/** @return a list of supported file system schemes */
List<String> getSupportedFileSystems();
/** @return a FileSystemFactory instance */
FileSystemFactory getFileSystemFactory();
}
interface FileSystemFactory {
/** @return a FileSystem for a given scheme */
FileSystem getFileSystem(String scheme, Configuration conf);
}
{code}
The advantage of this approach is that people experimenting with new
filesystems can just drop their new fs jars in the classpath without having to
modify any hadoop code.
> Move common fs implementations to a hadoop-fs module
> ----------------------------------------------------
>
> Key: HADOOP-7601
> URL: https://issues.apache.org/jira/browse/HADOOP-7601
> Project: Hadoop Common
> Issue Type: Improvement
> Components: fs
> Reporter: Luke Lu
> Fix For: 0.23.0
>
>
> Much of the hadoop-common dependencies is from the fs implementations. We
> have more fs implementations on the way (ceph, lafs etc). I propose that we
> move all the fs implementations to a hadoop-fs module under
> hadoop-common-project.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
