[
https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819522#comment-15819522
]
Manoj Govindassamy edited comment on HDFS-10930 at 1/11/17 11:27 PM:
---------------------------------------------------------------------
I did check {{ReplicaOutputStreams}} and {{WrappedFileOutputStream}} before and
I saw the latencies getting added to {{DataNodeVolumeMetrics}}. But, I couldn't
find the check against
datanodeSlowLogThresholdMs(_dfs.datanode.slow.io.warning.threshold.ms_) and the
warning logging. May be I am missing something here. Will dig more.
was (Author: manojg):
I did check ReplicaOutputStreams and WrappedFileOutputStream before and I saw
the latencies getting added to DataNodeVolumeMetrics. But, I couldn't find the
check against
datanodeSlowLogThresholdMs("dfs.datanode.slow.io.warning.threshold.ms") and the
warning logging. May be I am missing something here. Will dig more.
> Refactor: Wrap Datanode IO related operations
> ---------------------------------------------
>
> Key: HDFS-10930
> URL: https://issues.apache.org/jira/browse/HDFS-10930
> Project: Hadoop HDFS
> Issue Type: Improvement
> Components: datanode
> Reporter: Xiaoyu Yao
> Assignee: Xiaoyu Yao
> Fix For: 2.9.0, 3.0.0-alpha2
>
> Attachments: HDFS-10930-branch-2.00.patch,
> HDFS-10930-branch-2.001.patch, HDFS-10930-branch-2.002.patch,
> HDFS-10930.01.patch, HDFS-10930.02.patch, HDFS-10930.03.patch,
> HDFS-10930.04.patch, HDFS-10930.05.patch, HDFS-10930.06.patch,
> HDFS-10930.07.patch, HDFS-10930.08.patch, HDFS-10930.09.patch,
> HDFS-10930.10.patch, HDFS-10930.11.patch, HDFS-10930.barnch-2.00.patch
>
>
> Datanode IO (Disk/Network) related operations and instrumentations are
> currently spilled in many classes such as DataNode.java, BlockReceiver.java,
> BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java,
> DirectoryScanner.java, BlockScanner.java, FsDatasetAsyncDiskService.java,
> LocalReplica.java, LocalReplicaPipeline.java, Storage.java, etc.
> This ticket is opened to consolidate IO related operations for easy
> instrumentation, metrics collection, logging and trouble shooting.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
