[
https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaoqiao He updated HDFS-15382:
-------------------------------
Release Note: Throughput is one of the core performance evaluation for
DataNode instance. However it does not reach the best performance especially
for Federation deploy all the time although there are different improvement,
because of the global coarse-grain lock. These series issues (include
HDFS-16534, HDFS-16511, HDFS-15382 and HDFS-16429.) try to split the global
coarse-grain lock to fine-grain lock which is double level lock for blockpool
and volume, to improve the throughput and avoid lock impacts between blockpools
and volumes.
> Split one FsDatasetImpl lock to volume grain locks.
> ---------------------------------------------------
>
> Key: HDFS-15382
> URL: https://issues.apache.org/jira/browse/HDFS-15382
> Project: Hadoop HDFS
> Issue Type: Improvement
> Reporter: Mingxiang Li
> Assignee: Mingxiang Li
> Priority: Major
> Labels: pull-request-available
> Fix For: 3.4.0
>
> Attachments: HDFS-15382-sample.patch, image-2020-06-02-1.png,
> image-2020-06-03-1.png
>
> Time Spent: 5h 10m
> Remaining Estimate: 0h
>
> In HDFS-15180 we split lock to blockpool grain size.But when one volume is in
> heavy load and will block other request which in same blockpool but different
> volume.So we split lock to two leval to avoid this happend.And to improve
> datanode performance.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
