[
https://issues.apache.org/jira/browse/HDFS-9260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15027676#comment-15027676
]
Staffan Friberg commented on HDFS-9260:
---------------------------------------
Added a new benchmark that does IBRs on a blockmap/datastorageinfo that
contains 2M entries and deletes/re-adds 20% of those entries. The updates are
spread out over multiple IBRs and each IBR contains between 50-350 changed
blocks. The IntMapping version is again the patch from HDFS-6658.
{noformat}
Some further benchmarking of Incremental BR.
==> benchmarks_trunkMarch11_intMapping.jar.output <==
Benchmark Mode Cnt Score Error Units
IncrementalBlockReport.receivedAndDeleted avgt 50 3969.207 ± 14.979 ms/op
==> benchmarks_treeset_baseline.jar.output <==
Benchmark Mode Cnt Score Error Units
IncrementalBlockReport.receivedAndDeleted avgt 50 387.936 ± 25.634 ms/op
==> benchmarks_treeset.jar.output <==
Benchmark Mode Cnt Score Error Units
IncrementalBlockReport.receivedAndDeleted avgt 50 1205.779 ± 75.464 ms/op
{noformat}
> Improve performance and GC friendliness of startup and FBRs
> -----------------------------------------------------------
>
> Key: HDFS-9260
> URL: https://issues.apache.org/jira/browse/HDFS-9260
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode, namenode, performance
> Affects Versions: 2.7.1
> Reporter: Staffan Friberg
> Assignee: Staffan Friberg
> Attachments: FBR processing.png, HDFS Block and Replica Management
> 20151013.pdf, HDFS-7435.001.patch, HDFS-7435.002.patch, HDFS-7435.003.patch,
> HDFS-7435.004.patch, HDFS-7435.005.patch, HDFS-7435.006.patch,
> HDFS-7435.007.patch, HDFS-9260.008.patch, HDFS-9260.009.patch,
> HDFSBenchmarks.zip
>
>
> This patch changes the datastructures used for BlockInfos and Replicas to
> keep them sorted. This allows faster and more GC friendly handling of full
> block reports.
> Would like to hear peoples feedback on this change.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
