[
https://issues.apache.org/jira/browse/HDFS-11580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996507#comment-15996507
]
Yiqun Lin commented on HDFS-11580:
----------------------------------
I took some time to look into the failure test
{{TestContainerSmallFile#testCorrectnessWithMultipleAsyncCalls}}. The test is
not always failed, when I reduced the value {{numRequest}} to a smaller value.
It can pass in my local. I'm not so sure if the running test used out of my
local memory and then leads the failure.
In addition, the existing codes can also ensure the read small file commands
are enqueued in parallel, right? How do you think, [~msingh]? Could you share
your thoughts on this?
{code}
+ // send 20 read small file requests and add response future into a list
+ for (int i = 0; i < numRequest; i++) {
+ returnFuture3 = ContainerProtocolCalls.readSmallFileAsync(client,
+ containerName, "key" + i, traceID + i);
+ futureList.add(returnFuture3);
+ }
+
+ // Invoke future.get() to get the response and check
+ // if the content returned is correct.
+ for (int i = 0; i < numRequest; i++) {
+ returnFuture3 = futureList.get(i);
{code}
> Ozone: Support asynchronus client API for SCM and containers
> ------------------------------------------------------------
>
> Key: HDFS-11580
> URL: https://issues.apache.org/jira/browse/HDFS-11580
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone
> Affects Versions: HDFS-7240
> Reporter: Anu Engineer
> Assignee: Yiqun Lin
> Attachments: HDFS-11580-HDFS-7240.001.patch,
> HDFS-11580-HDFS-7240.002.patch, HDFS-11580-HDFS-7240.003.patch,
> HDFS-11580-HDFS-7240.004.patch, HDFS-11580-HDFS-7240.005.patch,
> HDFS-11580-HDFS-7240.006.patch, HDFS-11580-HDFS-7240.007.patch
>
>
> This is an umbrella JIRA that needs to support a set of APIs in Asynchronous
> form.
> For containers -- or the datanode API currently supports a call
> {{sendCommand}}. we need to build proper programming interface and support an
> async interface.
> There is also a set of SCM API that clients can call, it would be nice to
> support Async interface for those too.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
