Ivan Andika created HDDS-15134:
----------------------------------
Summary: Support data throttlers for Datanode
Key: HDDS-15134
URL: https://issues.apache.org/jira/browse/HDDS-15134
Project: Apache Ozone
Issue Type: Improvement
Reporter: Ivan Andika
Assignee: Ivan Andika
Unlike HDFS, Ozone does not contain any data throttle which causes high
resource usage (CPU, Memory, Disk). This causes instability issues that causes
a lot of client timeout which causes subtle issues like memory leak, etc. We
should limit the transfer so that the datanode always operates within the
limit. Additionally, during container replications, there do not seem to be any
bandwidth limit in replicating containers. Therefore, the high disk IO for
container replications might cause read & write performance degradation.
We can support DataTransferThrottler for read, write, and transfer similar to
HDFS. This limit can be expressed in bandwidth (e.g. GB/s).
We can also limit the throughput per disk instead of the whole DN. So that the
throughput configuration is the same regardless of the number of disks.
However, for this we need to think about different StorageType (SSD & DISK).
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
