[ https://issues.apache.org/jira/browse/HDFS-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15819526#comment-15819526 ]
Manoj Govindassamy edited comment on HDFS-10930 at 1/11/17 11:41 PM: --------------------------------------------------------------------- Thanks [~arpitagarwal]. Interestingly, only the "write data to disk" warning message has gone away. BlockReceiver continues to have other slowness logging like below even after these getting added to metrics. Slow flushOrSync took .. Slow BlockReceiver write packet to mirror took .. Slow manageWriterOsCache took .. Slow PacketResponder send ack to upstream took .. was (Author: manojg): Got it. Thanks [~arpitagarwal]. > Refactor: Wrap Datanode IO related operations > --------------------------------------------- > > Key: HDFS-10930 > URL: https://issues.apache.org/jira/browse/HDFS-10930 > Project: Hadoop HDFS > Issue Type: Improvement > Components: datanode > Reporter: Xiaoyu Yao > Assignee: Xiaoyu Yao > Fix For: 2.9.0, 3.0.0-alpha2 > > Attachments: HDFS-10930-branch-2.00.patch, > HDFS-10930-branch-2.001.patch, HDFS-10930-branch-2.002.patch, > HDFS-10930.01.patch, HDFS-10930.02.patch, HDFS-10930.03.patch, > HDFS-10930.04.patch, HDFS-10930.05.patch, HDFS-10930.06.patch, > HDFS-10930.07.patch, HDFS-10930.08.patch, HDFS-10930.09.patch, > HDFS-10930.10.patch, HDFS-10930.11.patch, HDFS-10930.barnch-2.00.patch > > > Datanode IO (Disk/Network) related operations and instrumentations are > currently spilled in many classes such as DataNode.java, BlockReceiver.java, > BlockSender.java, FsDatasetImpl.java, FsVolumeImpl.java, > DirectoryScanner.java, BlockScanner.java, FsDatasetAsyncDiskService.java, > LocalReplica.java, LocalReplicaPipeline.java, Storage.java, etc. > This ticket is opened to consolidate IO related operations for easy > instrumentation, metrics collection, logging and trouble shooting. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org