[ 
https://issues.apache.org/jira/browse/HADOOP-8545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13512072#comment-13512072
 ] 

Steve Loughran commented on HADOOP-8545:
----------------------------------------

@Dmitry -your patch looks interesting, especially the locality feature. 

in comparison with the rackspace/java-clouds version
# that uses the java-clouds library
# it only has the native swift: filesystem, not any blockstore
# it has tests
# it uses the {{FileSystemContractBaseTest}} class to verify compliance with 
the Hadoop Filesytem required semantics.
# The {{SwiftFileSystemTest}} contains fixes for HADOOP-9118 and HADOOP-9119

items 3 and 4 can be added to your code; the fixes for a stricter contract 
should go into the base class, as they are requirements for all FileSystem 
implementations.

I don't think anyone is committed to the java-clouds library, though I would 
very much prefer to have the maintenance and testing of the swift client API to 
be done by someone other than the Hadoop project. The maintenance cost of a 
module that is not core to Hadoop would mean that it would end up in 
{{contrib/}} and would end up being neglected. With an external library it 
could go into the core; a new POM would trigger incorporation of that library, 
a new RPM would install it.

How do you think we could combine everyone's work? I could host a Google+ 
meetup with everyone who is interested in this so we can discuss it -the 
minutes would go up here to record the discussion.

-steve


                
> Filesystem Implementation for OpenStack Swift
> ---------------------------------------------
>
>                 Key: HADOOP-8545
>                 URL: https://issues.apache.org/jira/browse/HADOOP-8545
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 2.0.3-alpha, 1.1.2
>            Reporter: Tim Miller
>            Priority: Minor
>         Attachments: HADOOP-8545-1.patch, HADOOP-8545-javaclouds-2.patch, 
> HADOOP-8545.patch
>
>
> Add a filesystem implementation for OpenStack Swift object store, similar to 
> the one which exists today for S3.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to