[ 
https://issues.apache.org/jira/browse/HDFS-6994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123864#comment-14123864
 ] 

Colin Patrick McCabe commented on HDFS-6994:
--------------------------------------------

bq. Haohui wrote: Do you want to separate the patch into sub tasks so that it 
can go through the review process?

I agree.  Why don't you guys separate this into a few subtasks, and use the 
HADOOP-10388 branch as the target?

bq. Personally I think that this is an alternative implementation of libhdfs. I 
don't think we need to get rid of boost for now, but I think the code can be 
put in the contrib directory which is not built by default, but still allow 
other people to check it out if they're interested.

I think we should make this useful to as many people as possible.  That's the 
reason I made my comment about the possible boost dependency issue.  I looked 
at this a little more closely, though, and I see that the purpose of boost is 
to substitute for C\+\+11 features such as {{std::thread}}, in cases where the 
compiler is too old to provide them.  With that in mind, I think that it's ok 
for now.  I do think we should do the Jenkins build without boost, to make sure 
that the C\+\+11 code works.  C\+\+11 is clearly the future for C++ and we 
should be prepared for it.

I want to reiterate that we should have a way to switch between this new 
library and the existing libhdfs.  I'd be happy to work on that (I can 
re-purpose the existing code from HADOOP-10388 to do that) and it will expand 
the user-base big-time.

> libhdfs3 - A native C/C++ HDFS client
> -------------------------------------
>
>                 Key: HDFS-6994
>                 URL: https://issues.apache.org/jira/browse/HDFS-6994
>             Project: Hadoop HDFS
>          Issue Type: Task
>          Components: hdfs-client
>            Reporter: Zhanwei Wang
>         Attachments: HDFS-6994-rpc-8.patch, HDFS-6994.patch
>
>
> Hi All
> I just got the permission to open source libhdfs3, which is a native C/C++ 
> HDFS client based on Hadoop RPC protocol and HDFS Data Transfer Protocol.
> libhdfs3 provide the libhdfs style C interface and a C++ interface. Support 
> both HADOOP RPC version 8 and 9. Support Namenode HA and Kerberos 
> authentication.
> libhdfs3 is currently used by HAWQ of Pivotal
> I'd like to integrate libhdfs3 into HDFS source code to benefit others.
> You can find libhdfs3 code from github
> https://github.com/PivotalRD/libhdfs3



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to