[ https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15278651#comment-15278651 ]
Colin Patrick McCabe commented on HDFS-9924: -------------------------------------------- Hi all, I am +1 for doing this work, based on possible performance improvements we might see, and the need for a convenient asynchronous API for applications. However, I am concerned that there has been no design doc posted, but already code committed to trunk. I am -1 on committing anything more to trunk until we have a design document explaining how the API will work and what changes it will require in HDFS. Just to clarify, I would be fine on committing code to a feature branch without a design document, since we can review it later prior to the merge. However, it is concerning to see such a large feature proceed on trunk without either a branch or a design that the community can review. > [umbrella] Asynchronous HDFS Access > ----------------------------------- > > Key: HDFS-9924 > URL: https://issues.apache.org/jira/browse/HDFS-9924 > Project: Hadoop HDFS > Issue Type: New Feature > Components: fs > Reporter: Tsz Wo Nicholas Sze > Assignee: Xiaobing Zhou > > This is an umbrella JIRA for supporting Asynchronous HDFS Access. > Currently, all the API methods are blocking calls -- the caller is blocked > until the method returns. It is very slow if a client makes a large number > of independent calls in a single thread since each call has to wait until the > previous call is finished. It is inefficient if a client needs to create a > large number of threads to invoke the calls. > We propose adding a new API to support asynchronous calls, i.e. the caller is > not blocked. The methods in the new API immediately return a Java Future > object. The return value can be obtained by the usual Future.get() method. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org