[
https://issues.apache.org/jira/browse/HDFS-14703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17388217#comment-17388217
]
Renukaprasad C commented on HDFS-14703:
---------------------------------------
Thanks [Daryn
Sharp|https://issues.apache.org/jira/secure/ViewProfile.jspa?name=daryn] for
the review & comments. Thanks [Xing
Lin|https://issues.apache.org/jira/secure/ViewProfile.jspa?name=xinglin] for
quick update.
# Was the entry point for the calls via the rpc server, fsn, fsdir, etc?
Relevant since end-to-end benchmarking rarely matches microbenchmarks.
We have run the benchmarking took in standalone mode with file:// schema. With
this we would be able to achieve 50k-60k throughput.
# What is “30-40%” improvement? How many ops/sec before and after?
When we test in standalone mode, we found an average of 30% improvement with
mkdir op.
https://issues.apache.org/jira/browse/HDFS-14703?focusedCommentId=17346002&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-17346002
# What impact did it have on gc/min and gc time? These are often hidden
killers of performance when not taken into consideration.
We have noticed that there is no CPU bottleneck with the patch. These metrics
we need to capture yet. We shall check further and publish if any impact on GC
with the patch.
We would like [~shv] to clarify further.
> NameNode Fine-Grained Locking via Metadata Partitioning
> -------------------------------------------------------
>
> Key: HDFS-14703
> URL: https://issues.apache.org/jira/browse/HDFS-14703
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: hdfs, namenode
> Reporter: Konstantin Shvachko
> Priority: Major
> Attachments: 001-partitioned-inodeMap-POC.tar.gz,
> 002-partitioned-inodeMap-POC.tar.gz, 003-partitioned-inodeMap-POC.tar.gz,
> NameNode Fine-Grained Locking.pdf, NameNode Fine-Grained Locking.pdf
>
>
> We target to enable fine-grained locking by splitting the in-memory namespace
> into multiple partitions each having a separate lock. Intended to improve
> performance of NameNode write operations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
