[
https://issues.apache.org/jira/browse/HDFS-13274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17117248#comment-17117248
]
Janus Chow commented on HDFS-13274:
-----------------------------------
The stats are as follows:
{code:java}
"GetBlockLocationsNumOps" : 233328385,
"GetBlockLocationsAvgTime" : 875.613523270563,
"FileAlreadyExistsExceptionNumOps" : 129,
"FileAlreadyExistsExceptionAvgTime" : 155.0,
"FileNotFoundExceptionNumOps" : 5259,
"FileNotFoundExceptionAvgTime" : 245.0,
"DeleteNumOps" : 749223,
"DeleteAvgTime" : 159.27272727272728,
"GetServerDefaultsNumOps" : 816182,
"GetServerDefaultsAvgTime" : 948.9306930693069,
"SetOwnerNumOps" : 13119,
"SetOwnerAvgTime" : 11.0,
"ReportBadBlocksNumOps" : 8,
"ReportBadBlocksAvgTime" : 1.0,
"FsyncNumOps" : 76351,
"FsyncAvgTime" : 1.0,
"GetAdditionalDatanodeNumOps" : 6,
"GetAdditionalDatanodeAvgTime" : 1.0,
"AddBlockNumOps" : 1472370,
"AddBlockAvgTime" : 521.6969696969697,
"CreateNumOps" : 1490114,
"CreateAvgTime" : 698.925925925926,
"SetPermissionNumOps" : 94423,
"SetPermissionAvgTime" : 140.66666666666666,
"UpdateBlockForPipelineNumOps" : 19,
"UpdateBlockForPipelineAvgTime" : 41.0,
"GetEZForPathNumOps" : 25486,
"GetEZForPathAvgTime" : 93.0,
"AlreadyBeingCreatedExceptionNumOps" : 20,
"AlreadyBeingCreatedExceptionAvgTime" : 1731.0,
"GetContentSummaryNumOps" : 20793,
"GetContentSummaryAvgTime" : 1020.0,
"AccessControlExceptionNumOps" : 107,
"AccessControlExceptionAvgTime" : 23.0,
"GetListingNumOps" : 24382314,
"GetListingAvgTime" : 502.0066225165563,
"IOExceptionNumOps" : 6,
"IOExceptionAvgTime" : 446.0,
"RecoveryInProgressExceptionNumOps" : 3,
"RecoveryInProgressExceptionAvgTime" : 6.0,
"SetReplicationNumOps" : 70334,
"SetReplicationAvgTime" : 97.5,
"CheckAccessNumOps" : 3862975,
"CheckAccessAvgTime" : 37.300970873786405,
"Rename2NumOps" : 7422,
"Rename2AvgTime" : 226.0,
"AbandonBlockNumOps" : 1242,
"AbandonBlockAvgTime" : 143.0,
"StandbyExceptionNumOps" : 25,
"StandbyExceptionAvgTime" : 0.0,
"RenewLeaseNumOps" : 314775,
"RenewLeaseAvgTime" : 657.375,
"RenameNumOps" : 1055746,
"RenameAvgTime" : 191.19230769230768,
"MkdirsNumOps" : 382334,
"MkdirsAvgTime" : 124.33333333333333,
"SetTimesNumOps" : 166,
"SetTimesAvgTime" : 0.0,
"UpdatePipelineNumOps" : 19,
"UpdatePipelineAvgTime" : 49.0,
"CompleteNumOps" : 1498564,
"CompleteAvgTime" : 272.2,
"GetFileInfoNumOps" : 89481205,
"GetFileInfoAvgTime" : 265.0645347162201
{code}
Today's metrics seems not that high for renewLease.
I always think the metrics provided by RBF too fluctuated.
> RBF: Extend RouterRpcClient to use multiple sockets
> ---------------------------------------------------
>
> Key: HDFS-13274
> URL: https://issues.apache.org/jira/browse/HDFS-13274
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Reporter: Íñigo Goiri
> Assignee: Íñigo Goiri
> Priority: Major
>
> HADOOP-13144 introduces the ability to create multiple connections for the
> same user and use different sockets. The RouterRpcClient should use this
> approach to get a better throughput.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
