[
https://issues.apache.org/jira/browse/HDFS-17366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908181#comment-17908181
]
ZanderXu commented on HDFS-17366:
---------------------------------
{quote}I plan to hold a meeting on 2024-06-06 from 3:00 PM - 4:00 PM to share
the FGL's motivations and some concerns in detail in Chinese.
The doc is : [NameNode Fine-Grained Locking Based On Directory Tree
(II)|https://docs.google.com/document/d/1QGLM67u6tWjj00gOWYqgxHqghb43g4dmH8QcUZtSrYE/edit?usp=sharing]
The meeting URL is:
[https://sea.zoom.us/j/94168001269|https://www.google.com/url?q=https://sea.zoom.us/j/94168001269&sa=D&source=calendar&ust=1718006866633954&usg=AOvVaw2Ky07Mb9hDcM0XGOYe6lD4]
You are welcome to this meeting
{quote}
There were many participants in this meeting, and we discussed many issues
together.
I rewrote the design document and described in detail the fundamental reasons
for some designs. [NameNode Fine-Grained Locking Based On Directory Tree
(III)|https://docs.google.com/document/d/1DXkiVxef9wCmICjpZyIQO-yxsgwc4wnf2lTKQ3UXe30/edit?usp=sharing]
I hope everyone can read it in detail and ask more questions.
You are very welcome to discuss with me at any time.
[Slack_channel_hdfs-fgl|https://the-asf.slack.com/archives/C06UDTBQ2SH]
> NameNode Fine-Grained Locking via Namespace Tree
> ------------------------------------------------
>
> Key: HDFS-17366
> URL: https://issues.apache.org/jira/browse/HDFS-17366
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs, namenode
> Reporter: ZanderXu
> Assignee: ZanderXu
> Priority: Major
> Attachments: NameNode Fine-Grained Locking Based On Directory Tree
> (III).pdf, NameNode Fine-Grained Locking Based On Directory Tree.pdf
>
>
> As we all known, the write performance of NameNode is limited by the global
> lock. We target to enable fine-grained locking based on the Namespace tree to
> improve the performance of NameNode write operations.
> There are multiple motivations for creating this ticket:
> * We have implemented this fine-grained locking and gained nearly 7x
> performance improvements in our prod environment
> * Other companies made similar improvements based on their internal branch.
> Internal branches are quite different from the community, so few feedback and
> discussions in the community.
> * The topic of fine-grained locking has been discussed for a very long time,
> but still without any results.
>
> We implemented this fine-gained locking based on the namespace tree to
> maximize the number of concurrency for disjoint or independent operations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
