[ https://issues.apache.org/jira/browse/HDFS-8617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14596430#comment-14596430 ]
Haohui Mai commented on HDFS-8617: ---------------------------------- bq. Andrew and I actually benchmarked setting ioprio in order to implement quality of service on the DataNode. It didn't have very much effect. Can you please share your code and results? Thanks > Throttle DiskChecker#checkDirs() speed. > --------------------------------------- > > Key: HDFS-8617 > URL: https://issues.apache.org/jira/browse/HDFS-8617 > Project: Hadoop HDFS > Issue Type: Improvement > Components: HDFS > Affects Versions: 2.7.0 > Reporter: Lei (Eddy) Xu > Assignee: Lei (Eddy) Xu > Attachments: HDFS-8617.000.patch > > > As described in HDFS-8564, {{DiskChecker.checkDirs(finalizedDir)}} is > causing excessive I/Os because {{finalizedDirs}} might have up to 64K > sub-directories (HDFS-6482). > This patch proposes to limit the rate of IO operations in > {{DiskChecker.checkDirs()}}. -- This message was sent by Atlassian JIRA (v6.3.4#6332)