[ https://issues.apache.org/jira/browse/HDFS-15180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17059199#comment-17059199 ]
Aiphago commented on HDFS-15180: -------------------------------- Hi [~zhuqi] ,Thanks for your proposal.And we have split dataset lock in our early version about 2.7 ,and gray deploy in our produce cluster for weeks.It looks like a good improvement in our version.But the trunck version looks big different from our version and have many works to do.And our idea is to split lock to blockpool at first, second we try to split each blockpool lock to volume lock, third we try to remove remain IO in lock as HDFS-15000 say.If you are interesting with this we can do this together.And here is the demo patch,and may have some problem. > DataNode FsDatasetImpl Fine-Grained Locking via BlockPool. > ----------------------------------------------------------- > > Key: HDFS-15180 > URL: https://issues.apache.org/jira/browse/HDFS-15180 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode > Affects Versions: 3.2.0 > Reporter: zhuqi > Assignee: zhuqi > Priority: Major > Attachments: image-2020-03-10-17-22-57-391.png, > image-2020-03-10-17-31-58-830.png, image-2020-03-10-17-34-26-368.png > > > Now the FsDatasetImpl datasetLock is heavy, when their are many namespaces in > big cluster. If we can split the FsDatasetImpl datasetLock via blockpool. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org