ZanderXu created HDFS-17366: ------------------------------- Summary: NameNode Fine-Grained Locking via Namespace Tree Key: HDFS-17366 URL: https://issues.apache.org/jira/browse/HDFS-17366 Project: Hadoop HDFS Issue Type: Improvement Components: hdfs, namenode Reporter: ZanderXu
As we all known, the write performance of NameNode is limited by the global lock. We target to enable fine-grained locking based on the Namespace tree to improve the performance of NameNode write operations. There are multiple motivations for creating this ticket: * We have implemented this fine-grained locking and gained nearly 7x performance improvements in our prod environment * Other companies made similar improvements based on their internal branch. Internal branches are quite different from the community, so few feedback and discussions in the community. * The topic off fine-grained locking has been discussed for a very long time without progress. We implemented this fine-gained locking based on the namespace tree to maximize the number of concurrency for disjoint or independent operations. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org