[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11545: - Fix Version/s: 2.9.0 +1 for the branch-2 patch. I've committed it after running the affected unit tests locally with JDK 7. Thanks [~hanishakoneru]. > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Fix For: 2.9.0, 3.0.0-alpha3 > > Attachments: HDFS-11545.001.patch, HDFS-11545.002.patch, > HDFS-11545.003.patch, HDFS-11545-branch-2.001.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545-branch-2.001.patch > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Fix For: 3.0.0-alpha3 > > Attachments: HDFS-11545.001.patch, HDFS-11545.002.patch, > HDFS-11545.003.patch, HDFS-11545-branch-2.001.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11545: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) The elusive Jenkins +1! Thanks for fixing the checkstyle issues [~hanishakoneru]. I've committed this to trunk. The branch-2 backport hit a few compile issues with type inference. > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Fix For: 3.0.0-alpha3 > > Attachments: HDFS-11545.001.patch, HDFS-11545.002.patch, > HDFS-11545.003.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.003.patch Resolved checkstyle errors in patch v03. > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Attachments: HDFS-11545.001.patch, HDFS-11545.002.patch, > HDFS-11545.003.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.002.patch Thank you [~arpitagarwal] for reviewing the patch. I have updated the patch. I was thinking we can add an end-to-end test case for the slow disk report along with the the NameNode handling of the report (HDFS-11551). > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Attachments: HDFS-11545.001.patch, HDFS-11545.002.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Status: Patch Available (was: Open) > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Attachments: HDFS-11545.001.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Attachment: HDFS-11545.001.patch > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > Attachments: HDFS-11545.001.patch > > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-11545: - Description: DataNode detects the outliers (slow disks) among all its disk. This information can be propagated to the NameNode so that the NameNode gets disk information from all Datanodes. (was: DataNode detects the outliers (slow disks) among all its disk. This information can be propagated to the NameNode so that the NameNode gets disk information from all Datanodes. The NameNode can compare the stats from all the DataNodes together.) > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Updated] (HDFS-11545) Propagate DataNode's slow disks info to the NameNode via Heartbeat
[ https://issues.apache.org/jira/browse/HDFS-11545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hanisha Koneru updated HDFS-11545: -- Description: DataNode detects the outliers (slow disks) among all its disk. This information can be propagated to the NameNode so that the NameNode gets disk information from all Datanodes. The NameNode can compare the stats from all the DataNodes together. (was: HDFS-11461 introduces slow disk detection in datanode. This information can be propagated to the NameNode so that the NameNode gets all DataNodes disk information. The NameNode can compare the stats from all the DataNodes together.) > Propagate DataNode's slow disks info to the NameNode via Heartbeat > -- > > Key: HDFS-11545 > URL: https://issues.apache.org/jira/browse/HDFS-11545 > Project: Hadoop HDFS > Issue Type: Improvement >Reporter: Hanisha Koneru >Assignee: Hanisha Koneru > > DataNode detects the outliers (slow disks) among all its disk. This > information can be propagated to the NameNode so that the NameNode gets disk > information from all Datanodes. The NameNode can compare the stats from all > the DataNodes together. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
