dark_num created HDFS-15552:
-------------------------------

             Summary: Let DeadNode Detector also work for EC cases
                 Key: HDFS-15552
                 URL: https://issues.apache.org/jira/browse/HDFS-15552
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: dfsclient, ec
    Affects Versions: 3.3.0
            Reporter: dark_num
             Fix For: 3.4.0


Currently, the EC stream (`DFSStripedInputStream`) is not handled properly 
while exception occurs.

For example, while reading EC-blocks, if the client timed out when connecting 
to the DataNode, it will throws `SocketTimeoutException` , then add current DN 
to localDeadNode.

However, the local dead nodes will not be removed until the stream is closed, 
which will cause *missing block IOException* to be thrown in the use scenario 
of Hbase.

So we need to use detector to deal with dead nodes under EC to avoid reading 
failures.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Reply via email to