[
https://issues.apache.org/jira/browse/HDDS-4454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17236563#comment-17236563
]
runzhiwang commented on HDDS-4454:
----------------------------------
[~szetszwo][~shashikant] I'm thinking whether we can change ratis streaming to
support WriteSmallFile. Here we define small file smaller than 4MB. I think
there is user case which write small file frequently. If we use the current
WriteSmallFile API, there will also a lot of copy. If we change ratis
streaming, we can define a new Type STREAM_SMALL_FILE to represent
STREAM_HEADER, STREAM_DATA, STREAM_CLOSE. what do you think ?
> Ozone Streaming Write Pipeline
> ------------------------------
>
> Key: HDDS-4454
> URL: https://issues.apache.org/jira/browse/HDDS-4454
> Project: Hadoop Distributed Data Store
> Issue Type: New Feature
> Components: Ozone Client, Ozone Datanode
> Reporter: Shashikant Banerjee
> Assignee: Shashikant Banerjee
> Priority: Major
> Attachments: Ozone Write Streaming.pdf,
> image-2020-11-17-09-15-58-880.png
>
>
> https://issues.apache.org/jira/browse/RATIS-979 implements streaming
> semantics in Ratis.
> Currently, ozone write pattern is bursty and involves multiple buffers copies
> as well multiple ratis log syncs in a block write. The idea of the Jira is to
> use a zero buffer copy based ratis streaming in ozone write path for better
> performance and resource utilisation.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
