[
https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17413087#comment-17413087
]
Renukaprasad C commented on HDFS-14703:
---------------------------------------
Thanks [~jianghuazhu] for your interest & attention on this task.
Yes, we need to make it configurable. Didnt pay much attention to it in the
POC. It will be great if you can trace this issue.
Also, i suggest to make partition count - INodeMap#NUM_RANGES_STATIC
configurable along with DEPTH.
"By the way, in our cluster, there are more than 100 million INodes."
– We have tried upto 10M files/Dirs. Larger the data set, could see the
better results. You can share us reports in case you have done benchmarking
with FGL branch.
> NameNode Fine-Grained Locking via Metadata Partitioning
> -------------------------------------------------------
>
> Key: HDFS-14703
> URL: https://issues.apache.org/jira/browse/HDFS-14703
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs, namenode
> Reporter: Konstantin Shvachko
> Priority: Major
> Attachments: 001-partitioned-inodeMap-POC.tar.gz,
> 002-partitioned-inodeMap-POC.tar.gz, 003-partitioned-inodeMap-POC.tar.gz,
> NameNode Fine-Grained Locking.pdf, NameNode Fine-Grained Locking.pdf
>
>
> We target to enable fine-grained locking by splitting the in-memory namespace
> into multiple partitions each having a separate lock. Intended to improve
> performance of NameNode write operations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
