[ 
https://issues.apache.org/jira/browse/HDFS-5891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Haohui Mai updated HDFS-5891:
-----------------------------

    Attachment: HDFS-5891.000.patch

> webhdfs should not try connecting the DN during redirection
> -----------------------------------------------------------
>
>                 Key: HDFS-5891
>                 URL: https://issues.apache.org/jira/browse/HDFS-5891
>             Project: Hadoop HDFS
>          Issue Type: Bug
>            Reporter: Haohui Mai
>            Assignee: Haohui Mai
>         Attachments: HDFS-5891.000.patch
>
>
> When the webhdfs server in NN serves an {{OPEN}} request, the NN will 
> eventually redirect the request to a DN. The current implementation intends 
> to choose the active DNs. The code always connects to the DN in a 
> deterministic order to see whether it is active during redirection.
> Although it reduces the chance of the client from connecting to a failed DN, 
> this is problematic because:
> # It has no guarantees that the client can connect to that DN even if the NN 
> can connect to it.
> # It requires an additional network round-trip for every {{OPEN}} / 
> {{CREATE}} request.
> This jira proposes that the NN should choose the DN based on the information 
> of the data node manager.



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

Reply via email to