Supratim Deka created HDDS-1595:
-----------------------------------
Summary: Handling IO Failures on the Datanode
Key: HDDS-1595
URL: https://issues.apache.org/jira/browse/HDDS-1595
Project: Hadoop Distributed Data Store
Issue Type: Improvement
Components: Ozone Datanode
Reporter: Supratim Deka
Attachments: Raft IO v2.svg
This Jira covers all the changes required to handle IO Failures on the
Datanode. Handling an IO failure on the Datanode involves detecting failures as
they happen and propagating the failure to the appropriate component in the
system - possibly the Client and/or the SCM based on the type of failure.
At a high-level, IO Failure handling has the following goals:
1. Prevent Inconsistencies and corruption - due to non-handling or mishandling
of failures.
2. Prevent any data loss - timely detection of failure and propagate correct
error back to the initiator instead of silently dropping the data while the
client assumes the operation is committed.
3. Contain the disruption in the system - if a disk volume fails on a DN,
operations to the other nodes and volumes should not be affected.
Details pertaining to design and changes required are covered in the attached
pdf document.
A sequence diagram used to analyse the Datanode IO Path is also attached, in
svg format.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
