ZanderXu created HDFS-17366:
-------------------------------
Summary: NameNode Fine-Grained Locking via Namespace Tree
Key: HDFS-17366
URL: https://issues.apache.org/jira/browse/HDFS-17366
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs, namenode
Reporter: ZanderXu
As we all known, the write performance of NameNode is limited by the global
lock. We target to enable fine-grained locking based on the Namespace tree to
improve the performance of NameNode write operations.
There are multiple motivations for creating this ticket:
* We have implemented this fine-grained locking and gained nearly 7x
performance improvements in our prod environment
* Other companies made similar improvements based on their internal branch.
Internal branches are quite different from the community, so few feedback and
discussions in the community.
* The topic off fine-grained locking has been discussed for a very long time
without progress.
We implemented this fine-gained locking based on the namespace tree to maximize
the number of concurrency for disjoint or independent operations.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
