[
https://issues.apache.org/jira/browse/RATIS-979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247226#comment-17247226
]
runzhiwang commented on RATIS-979:
----------------------------------
bq. please try various buffer sizes such as 1mb, 4mb, 16mb when you run the
benchmarks next time. I suspect DataStreamApi will give a better performance
using smaller buffers.
[~szetszwo] I use DataStreamApi to write 1000 * 128 files in parallel, each
file 128MB, total 128GB, total cost about 26 seconds. The time cost is almost
similar when buffer size is 1mb, 4mb, 16mb.
> Ratis streaming
> ---------------
>
> Key: RATIS-979
> URL: https://issues.apache.org/jira/browse/RATIS-979
> Project: Ratis
> Issue Type: New Feature
> Components: Streaming
> Reporter: Tsz-wo Sze
> Assignee: Tsz-wo Sze
> Priority: Major
> Attachments: RatisStreaming20200929.pdf, screenshot-1.png,
> screenshot-2.png
>
>
> In this JIRA, we design and implement Ratis Streaming with zero buffer
> copying and asynchronous event driven.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
