[
https://issues.apache.org/jira/browse/HDFS-811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eli Collins updated HDFS-811:
-----------------------------
Attachment: hdfs-811-6.patch
Thanks Cos and Jakob. New patch fixes the warning. I'll commit this.
{noformat}
[exec]
[exec] -1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 19 new or
modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning
messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number
of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs
warnings.
[exec]
[exec] -1 release audit. The applied patch generated 103 release
audit warnings (more than the trunk's current 1 warnings).
[exec]
[exec] +1 system test framework. The patch passed system test
framework compile.
[exec]
{noformat}
> Add metrics, failure reporting and additional tests for HDFS-457
> ----------------------------------------------------------------
>
> Key: HDFS-811
> URL: https://issues.apache.org/jira/browse/HDFS-811
> Project: Hadoop HDFS
> Issue Type: Test
> Components: test
> Affects Versions: 0.21.0, 0.22.0
> Reporter: Ravi Phulari
> Assignee: Eli Collins
> Priority: Minor
> Fix For: 0.22.0
>
> Attachments: hdfs-811-1.patch, hdfs-811-2.patch, hdfs-811-3.patch,
> hdfs-811-4.patch, hdfs-811-5.patch, hdfs-811-6.patch
>
>
> HDFS-457 introduced a improvement which allows datanode to continue if a
> volume for replica storage fails. Previously a datanode resigned if any
> volume failed.
> Description of HDFS-457
> {quote}
> Current implementation shuts DataNode down completely when one of the
> configured volumes of the storage fails.
> This is rather wasteful behavior because it decreases utilization (good
> storage becomes unavailable) and imposes extra load on the system
> (replication of the blocks from the good volumes). These problems will become
> even more prominent when we move to mixed (heterogeneous) clusters with many
> more volumes per Data Node.
> {quote}
> I suggest following additional tests for this improvement.
> #1 Test successive volume failures ( Minimum 4 volumes )
> #2 Test if each volume failure reports reduction in available DFS space and
> remaining space.
> #3 Test if failure of all volumes on a data nodes leads to the data node
> failure.
> #4 Test if correcting failed storage disk brings updates and increments
> available DFS space.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
