Contributing Hoop to HDFS, replacement for HDFS proxy with read/write 
capabilities
----------------------------------------------------------------------------------

                 Key: HDFS-2178
                 URL: https://issues.apache.org/jira/browse/HDFS-2178
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Alejandro Abdelnur
            Assignee: Alejandro Abdelnur


We'd like to contribute Hoop to Hadoop HDFS as a replacement (an improvement) 
for HDFS Proxy.

Hoop provides access to all Hadoop Distributed File System (HDFS) operations 
(read and write) over HTTP/S.

The Hoop server component is a REST HTTP gateway to HDFS supporting all file 
system operations. It can be accessed using standard HTTP tools (i.e. curl and 
wget), HTTP libraries from different programing languages (i.e. Perl, Java 
Script) as well as using the Hoop client. The Hoop server component is a 
standard Java web-application and it has been implemented using Jersey (JAX-RS).

The Hoop client component is an implementation of Hadoop FileSystem client that 
allows using the familiar Hadoop filesystem API to access HDFS data through a 
Hoop server.


  Repo: https://github.com/cloudera/hoop

  Docs: http://cloudera.github.com/hoop

  Blog: http://www.cloudera.com/blog/2011/07/hoop-hadoop-hdfs-over-http/


Hoop is a Maven based project that depends on Hadoop HDFS and Alfredo (for 
Kerberos HTTP SPNEGO authentication). 

To make the integration easy, HDFS Mavenization (HDFS-2096) would have to be 
done first, as well as the Alfredo contribution (HADOOP-7119).



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to