[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I ran the tests locally, only tests failures are those from HDFS-2242. Thanks Todd! DN volume failures on startup are not counted - Key: HDFS-2186 URL: https://issues.apache.org/jira/browse/HDFS-2186 Project: Hadoop HDFS Issue Type: Bug Components: data-node Reporter: Eli Collins Assignee: Eli Collins Fix For: 0.23.0 Attachments: hdfs-2186-1.patch, hdfs-2186-2.patch Volume failures detected on startup are not currently counted/reported as such. Eg if you have configured 4 volumes, 2 tolerated failures, and you start a DN with two failed volumes it will come up and report (to the NN) no failed volumes. The DN will still be able to tolerate 2 additional volume failures (ie it's OK with no valid volumes remaining). The intent of the volume failure toleration config value is that if more than this # of volumes of the total set of configured volumes have failed the DN should shutdown, therefore volume failures detected on startup should count against this quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Status: Patch Available (was: Open) DN volume failures on startup are not counted - Key: HDFS-2186 URL: https://issues.apache.org/jira/browse/HDFS-2186 Project: Hadoop HDFS Issue Type: Bug Components: data-node Reporter: Eli Collins Assignee: Eli Collins Fix For: 0.23.0 Attachments: hdfs-2186-1.patch Volume failures detected on startup are not currently counted/reported as such. Eg if you have configured 4 volumes, 2 tolerated failures, and you start a DN with two failed volumes it will come up and report (to the NN) no failed volumes. The DN will still be able to tolerate 2 additional volume failures (ie it's OK with no valid volumes remaining). The intent of the volume failure toleration config value is that if more than this # of volumes of the total set of configured volumes have failed the DN should shutdown, therefore volume failures detected on startup should count against this quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Attachment: hdfs-2186-2.patch Patch rebased on trunk. DN volume failures on startup are not counted - Key: HDFS-2186 URL: https://issues.apache.org/jira/browse/HDFS-2186 Project: Hadoop HDFS Issue Type: Bug Components: data-node Reporter: Eli Collins Assignee: Eli Collins Fix For: 0.23.0 Attachments: hdfs-2186-1.patch, hdfs-2186-2.patch Volume failures detected on startup are not currently counted/reported as such. Eg if you have configured 4 volumes, 2 tolerated failures, and you start a DN with two failed volumes it will come up and report (to the NN) no failed volumes. The DN will still be able to tolerate 2 additional volume failures (ie it's OK with no valid volumes remaining). The intent of the volume failure toleration config value is that if more than this # of volumes of the total set of configured volumes have failed the DN should shutdown, therefore volume failures detected on startup should count against this quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Attachment: hdfs-2186-1.patch Patch attached. Considers any configured volume that is not a valid storage directory to be a failed volume. The new test asserts that a failed volume on startup is seen as such by the NN. This is visible in the web UI failed volumes field now, ie a DN that starts with 1 failed volume will show 1 failed volume on the web UI. DN volume failures on startup are not counted - Key: HDFS-2186 URL: https://issues.apache.org/jira/browse/HDFS-2186 Project: Hadoop HDFS Issue Type: Bug Components: data-node Reporter: Eli Collins Fix For: 0.23.0 Attachments: hdfs-2186-1.patch Volume failures detected on startup are not currently counted/reported as such. Eg if you have configured 4 volumes, 2 tolerated failures, and you start a DN with two failed volumes it will come up and report (to the NN) no failed volumes. The DN will still be able to tolerate 2 additional volume failures (ie it's OK with no valid volumes remaining). The intent of the volume failure toleration config value is that if more than this # of volumes of the total set of configured volumes have failed the DN should shutdown, therefore volume failures detected on startup should count against this quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira