[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) I ran the tests locally, only tests failures are those from HDFS-2242. Thanks Todd! > DN volume failures on startup are not counted > - > > Key: HDFS-2186 > URL: https://issues.apache.org/jira/browse/HDFS-2186 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node >Reporter: Eli Collins >Assignee: Eli Collins > Fix For: 0.23.0 > > Attachments: hdfs-2186-1.patch, hdfs-2186-2.patch > > > Volume failures detected on startup are not currently counted/reported as > such. Eg if you have configured 4 volumes, 2 tolerated failures, and you > start a DN with two failed volumes it will come up and report (to the NN) no > failed volumes. The DN will still be able to tolerate 2 additional volume > failures (ie it's OK with no valid volumes remaining). The intent of the > volume failure toleration config value is that if more than this # of volumes > of the total set of configured volumes have failed the DN should shutdown, > therefore volume failures detected on startup should count against this > quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Attachment: hdfs-2186-2.patch Patch rebased on trunk. > DN volume failures on startup are not counted > - > > Key: HDFS-2186 > URL: https://issues.apache.org/jira/browse/HDFS-2186 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node >Reporter: Eli Collins >Assignee: Eli Collins > Fix For: 0.23.0 > > Attachments: hdfs-2186-1.patch, hdfs-2186-2.patch > > > Volume failures detected on startup are not currently counted/reported as > such. Eg if you have configured 4 volumes, 2 tolerated failures, and you > start a DN with two failed volumes it will come up and report (to the NN) no > failed volumes. The DN will still be able to tolerate 2 additional volume > failures (ie it's OK with no valid volumes remaining). The intent of the > volume failure toleration config value is that if more than this # of volumes > of the total set of configured volumes have failed the DN should shutdown, > therefore volume failures detected on startup should count against this > quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Status: Patch Available (was: Open) > DN volume failures on startup are not counted > - > > Key: HDFS-2186 > URL: https://issues.apache.org/jira/browse/HDFS-2186 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node >Reporter: Eli Collins >Assignee: Eli Collins > Fix For: 0.23.0 > > Attachments: hdfs-2186-1.patch > > > Volume failures detected on startup are not currently counted/reported as > such. Eg if you have configured 4 volumes, 2 tolerated failures, and you > start a DN with two failed volumes it will come up and report (to the NN) no > failed volumes. The DN will still be able to tolerate 2 additional volume > failures (ie it's OK with no valid volumes remaining). The intent of the > volume failure toleration config value is that if more than this # of volumes > of the total set of configured volumes have failed the DN should shutdown, > therefore volume failures detected on startup should count against this > quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HDFS-2186) DN volume failures on startup are not counted
[ https://issues.apache.org/jira/browse/HDFS-2186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins updated HDFS-2186: -- Attachment: hdfs-2186-1.patch Patch attached. Considers any configured volume that is not a valid storage directory to be a failed volume. The new test asserts that a failed volume on startup is seen as such by the NN. This is visible in the web UI "failed volumes" field now, ie a DN that starts with 1 failed volume will show 1 failed volume on the web UI. > DN volume failures on startup are not counted > - > > Key: HDFS-2186 > URL: https://issues.apache.org/jira/browse/HDFS-2186 > Project: Hadoop HDFS > Issue Type: Bug > Components: data-node >Reporter: Eli Collins > Fix For: 0.23.0 > > Attachments: hdfs-2186-1.patch > > > Volume failures detected on startup are not currently counted/reported as > such. Eg if you have configured 4 volumes, 2 tolerated failures, and you > start a DN with two failed volumes it will come up and report (to the NN) no > failed volumes. The DN will still be able to tolerate 2 additional volume > failures (ie it's OK with no valid volumes remaining). The intent of the > volume failure toleration config value is that if more than this # of volumes > of the total set of configured volumes have failed the DN should shutdown, > therefore volume failures detected on startup should count against this > quota. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
