[ 
https://issues.apache.org/jira/browse/HADOOP-10741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14044028#comment-14044028
 ] 

Tsz Wo Nicholas Sze commented on HADOOP-10741:
----------------------------------------------

Andrew, if you agreed that the new library is useful, why not adding it to 
Hadoop?  This is similar to the new client proposed in HADOOP-10389, would you 
suggest it to live on github or elsewhere?

> A lightweight WebHDFS client library
> ------------------------------------
>
>                 Key: HADOOP-10741
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10741
>             Project: Hadoop Common
>          Issue Type: New Feature
>          Components: tools
>            Reporter: Tsz Wo Nicholas Sze
>            Assignee: Mohammad Kamrul Islam
>
> One of the motivations for creating WebHDFS is for applications connecting to 
> HDFS from outside the cluster.  In order to do so, users have to either
> # install Hadoop and use WebHdfsFileSsytem, or
> # develop their own client using the WebHDFS REST API.
> For #1, it is very difficult to manage and unnecessarily complicated for 
> other applications since Hadoop is not a lightweight library.  For #2, it is 
> not easy to deal with security and handle transient errors.
> Therefore, we propose adding a lightweight WebHDFS client as a separated 
> library which does not depend on Common and HDFS.  The client can be packaged 
> as a standalone jar.  Other applications simply add the jar to their 
> classpath for using it.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to