daimin created HDFS-16543: ----------------------------- Summary: Keep default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec consistent Key: HDFS-16543 URL: https://issues.apache.org/jira/browse/HDFS-16543 Project: Hadoop HDFS Issue Type: Improvement Components: configuration, datanode Affects Versions: 3.3.2 Reporter: daimin Assignee: daimin
"WARN datanode.DirectoryScanner (DirectoryScanner.java:<init>(300)) - dfs.datanode.directoryscan.throttle.limit.ms.per.sec set to value above 1000 ms/sec. Assuming default value of -1" A warning log like above will be printed when datanode is starting. The reason of that is the default value of dfs.datanode.directoryscan.throttle.limit.ms.per.sec is 1000 in hdfs-site.xml, and is -1 in DFS_DATANODE_DIRECTORYSCAN_THROTTLE_LIMIT_MS_PER_SEC_DEFAULT. We should try to keep it consistent, and value -1 looks is better to 1000. The code segment that print the warning log: {{if (throttle >= TimeUnit.SECONDS.toMillis(1)) { LOG.warn( "{} set to value above 1000 ms/sec. Assuming default value of {}", DFSConfigKeys.DFS_DATANODE_DIRECTORYSCAN_THROTTLE_LIMIT_MS_PER_SEC_KEY, DFSConfigKeys.DFS_DATANODE_DIRECTORYSCAN_THROTTLE_LIMIT_MS_PER_SEC_DEFAULT); throttle = DFSConfigKeys.DFS_DATANODE_DIRECTORYSCAN_THROTTLE_LIMIT_MS_PER_SEC_DEFAULT; }}} -- This message was sent by Atlassian Jira (v8.20.1#820001) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org