[
https://issues.apache.org/jira/browse/HDFS-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430889#comment-13430889
]
Jing Zhao commented on HDFS-2656:
---------------------------------
Todd and Zhanwei, thanks very much for the feedback! So for the checksum, since
the webhdfs provides the GETFILECHECKSUM operation, I guess we can at least use
it for checksumming after finishing reading the whole file. As you guys pointed
out, the current patch still needs a lot of improvement and measurement in
performance. Also, I agree that the openfile and further corresponding
read/write can have a better implementation to keep consistent with libhdfs.
I'm now working on it and will upload patch for that.
> Implement a pure c client based on webhdfs
> ------------------------------------------
>
> Key: HDFS-2656
> URL: https://issues.apache.org/jira/browse/HDFS-2656
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: webhdfs
> Reporter: Zhanwei.Wang
> Attachments: HDFS-2656.patch, HDFS-2656.unfinished.patch
>
>
> Currently, the implementation of libhdfs is based on JNI. The overhead of JVM
> seems a little big, and libhdfs can also not be used in the environment
> without hdfs.
> It seems a good idea to implement a pure c client by wrapping webhdfs. It
> also can be used to access different version of hdfs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
