[
https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15269766#comment-15269766
]
Andrew Wang commented on HDFS-9924:
-----------------------------------
Hi all, a few notes:
* Can we do this work on a branch? This is a big addition to the HDFS API, so I
think needs some broader buy-in from the community and validation before
merging. Since performance is a stated goal, a performance evaluation seems
like a merge requirement.
* Could someone post a design doc with the motivations, proposed API, and
discussion? It'd help to go over the pros/cons of the different API options.
ListenableFuture for instance has also been brought up. Reviewing some other
async RPC interfaces for comparison would also be helpful. This design doc is
also the place to discuss Colin's question about performance compared to a
thread pool. If that option is available to us, it's preferable since it does
not involve expanding the API.
Thanks!
> [umbrella] Asynchronous HDFS Access
> -----------------------------------
>
> Key: HDFS-9924
> URL: https://issues.apache.org/jira/browse/HDFS-9924
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: fs
> Reporter: Tsz Wo Nicholas Sze
> Assignee: Xiaobing Zhou
>
> This is an umbrella JIRA for supporting Asynchronous HDFS Access.
> Currently, all the API methods are blocking calls -- the caller is blocked
> until the method returns. It is very slow if a client makes a large number
> of independent calls in a single thread since each call has to wait until the
> previous call is finished. It is inefficient if a client needs to create a
> large number of threads to invoke the calls.
> We propose adding a new API to support asynchronous calls, i.e. the caller is
> not blocked. The methods in the new API immediately return a Java Future
> object. The return value can be obtained by the usual Future.get() method.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
