[
https://issues.apache.org/jira/browse/HDFS-9924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332217#comment-15332217
]
Xiaobing Zhou commented on HDFS-9924:
-------------------------------------
bq. You just need renames or you need more than rename?
rename is just an example.
bq. You want to do thousands of concurrent renames this way? Is that even going
to work?
Why is it not working?
bq. Are you going to knock over the NN?
Quoting [~szetszwo] words, _I understand your concern but it is a different
problem. We should not protect NN by making the client slow. We should add
protection in NN instead_
bq. Or, aren't you just have a bunch of outstanding calls blocked on remote NN
locks?
If calls are blocked, they are blocked anyway regardless of async or
multithread approach.
bq. Won't you want to constrict how many ongoing calls there are?
ipc.client.async.calls.max is already there for users to constraint how many is
good to their cases.
Thanks.
> [umbrella] Asynchronous HDFS Access
> -----------------------------------
>
> Key: HDFS-9924
> URL: https://issues.apache.org/jira/browse/HDFS-9924
> Project: Hadoop HDFS
> Issue Type: New Feature
> Components: fs
> Reporter: Tsz Wo Nicholas Sze
> Assignee: Xiaobing Zhou
> Attachments: AsyncHdfs20160510.pdf
>
>
> This is an umbrella JIRA for supporting Asynchronous HDFS Access.
> Currently, all the API methods are blocking calls -- the caller is blocked
> until the method returns. It is very slow if a client makes a large number
> of independent calls in a single thread since each call has to wait until the
> previous call is finished. It is inefficient if a client needs to create a
> large number of threads to invoke the calls.
> We propose adding a new API to support asynchronous calls, i.e. the caller is
> not blocked. The methods in the new API immediately return a Java Future
> object. The return value can be obtained by the usual Future.get() method.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
