[
https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17380424#comment-17380424
]
Renukaprasad C commented on HDFS-14703:
---------------------------------------
Thanks [~shv] for review & feedback.
Shall i raise separate Jira for Create and trace the PR? Or is ok to go with
the current PR?
{noformat}
Noticed that you implemented getInode(id) by iterating through all inodes. This
is probably the key part of this effort. We should eventually replace
getInode(id) with getInode(key) to make the inode lookup efficient.{noformat}
I totally agree with you, this is an overhead in finding the iNodes on large
dataset. Just provided work-around to continue, we shall work on it and
eventually optimize it better.
> NameNode Fine-Grained Locking via Metadata Partitioning
> -------------------------------------------------------
>
> Key: HDFS-14703
> URL: https://issues.apache.org/jira/browse/HDFS-14703
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs, namenode
> Reporter: Konstantin Shvachko
> Priority: Major
> Attachments: 001-partitioned-inodeMap-POC.tar.gz,
> 002-partitioned-inodeMap-POC.tar.gz, 003-partitioned-inodeMap-POC.tar.gz,
> NameNode Fine-Grained Locking.pdf, NameNode Fine-Grained Locking.pdf
>
>
> We target to enable fine-grained locking by splitting the in-memory namespace
> into multiple partitions each having a separate lock. Intended to improve
> performance of NameNode write operations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
