[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819522#comment-15819522 ]
Manoj Govindassamy edited comment on HDFS-10930 at 1/11/17 11:27 PM: --------------------------------------------------------------------- I did check {{ReplicaOutputStreams}} and {{WrappedFileOutputStream}} before and I saw the latencies getting added to {{DataNodeVolumeMetrics}}. But, I couldn't find the check against datanodeSlowLogThresholdMs(_dfs.datanode.slow.io.warning.threshold.ms_) and the warning logging. May be I am missing something here. Will dig more. was (Author: manojg): I did check ReplicaOutputStreams and WrappedFileOutputStream before and I saw the latencies getting added to DataNodeVolumeMetrics. But, I couldn't find the check against datanodeSlowLogThresholdMs("dfs.datanode.slow.io.warning.threshold.ms") and the warning logging. May be I am missing something here. Will dig more. > Refactor: Wrap Datanode IO related operations > --------------------------------------------- > > Key: HDFS-10930 > URL: https://issues.apache.org/jira/browse/HDFS-10930 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode > Reporter: Xiaoyu Yao > Assignee: Xiaoyu Yao > Fix For: 2.9.0, 3.0.0-alpha2 > > Attachments: HDFS-10930-branch-2.00.patch, > HDFS-10930-branch-2.001.patch, HDFS-10930-branch-2.002.patch, > HDFS-10930.01.patch, HDFS-10930.02.patch, HDFS-10930.03.patch, > HDFS-10930.04.patch, HDFS-10930.05.patch, HDFS-10930.06.patch, > HDFS-10930.07.patch, HDFS-10930.08.patch, HDFS-10930.09.patch, > HDFS-10930.10.patch, HDFS-10930.11.patch, HDFS-10930.barnch-2.00.patch > > > Datanode IO (Disk/Network) related operations and instrumentations are > currently spilled in many classes such as DataNode.java, BlockReceiver.java, > BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, > DirectoryScanner.java, BlockScanner.java, FsDatasetAsyncDiskService.java, > LocalReplica.java, LocalReplicaPipeline.java, Storage.java, etc. > This ticket is opened to consolidate IO related operations for easy > instrumentation, metrics collection, logging and trouble shooting. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org