[ 
https://issues.apache.org/jira/browse/HDDS-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17416066#comment-17416066
 ] 

Kaijie Chen commented on HDDS-5685:
-----------------------------------

{{I have implemented a new FileRegion API to write the file (HDDS-5752), which 
uses Ratis DataStream.writeAsync(FilePositionCount).}}

My tests shows it have better performance over Async API and 
Streaming(MappedByteBuffer).

For more information about the test, please refer to: 
https://docs.google.com/document/d/14x974xK-vHFqfx7rW8TWjC2ngIbgEdHtkUe4waO_XxA/edit?usp=sharing

 

Writing a single 10GB key from 1 client to a 3-node cluster.
||Test ID||Async||Streaming(MappedByteBuffer)||Streaming(FileRegion)||
|1|87252|78698|66844|
|2|88853|80203|70198|
|3|90292|81529|70343|

 

Writing 24 keys (1GB each) in parallel, from 1 client to a 3-node cluster.
||Test ID||Async||Streaming(MappedByteBuffer)||Streaming(FileRegion)||
|1|54357|50228|39384|
|2|52807|48714|39528|
|3|49238|49603|36618|

> Ozone Streaming Performance test.
> ---------------------------------
>
>                 Key: HDDS-5685
>                 URL: https://issues.apache.org/jira/browse/HDDS-5685
>             Project: Apache Ozone
>          Issue Type: Sub-task
>            Reporter: mingchao zhao
>            Assignee: Kaijie Chen
>            Priority: Major
>         Attachments: image-2021-08-27-11-07-36-526.png, screenshot-1.png, 
> screenshot-2.png
>
>
> We can test and discuss the performance of Ozone Streaming under this JIRA.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to