[
https://issues.apache.org/jira/browse/HDFS-5122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Haohui Mai updated HDFS-5122:
-----------------------------
Attachment: HDFS-5122.patch
This patch fully implements HDFS-5122 and HDFS-5181.
It reuses the current retry logic of WebHDFS client for fail overs.
The key of the patches are the following:
1. Generalize the resolution of the URL. An URL can now correspond to a lists
of authorities (i.e., the IPs and ports of NN servers).
2. When a failure happens, it maps the URL to the next available authority and
then retries, where the current retry logic bounds the number of retries to
avoid locks.
3. The runner class constructs the URL to the real server on demand so that it
can always pick up the latest server.
> WebHDFS should support logical service names in URIs
> ----------------------------------------------------
>
> Key: HDFS-5122
> URL: https://issues.apache.org/jira/browse/HDFS-5122
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: ha, webhdfs
> Affects Versions: 2.1.0-beta
> Reporter: Arpit Gupta
> Assignee: Haohui Mai
> Attachments: HDFS-5122.patch
>
>
> For example if the dfs.nameservices is set to arpit
> {code}
> hdfs dfs -ls webhdfs://arpit:50070/tmp
> or
> hdfs dfs -ls webhdfs://arpit/tmp
> {code}
> does not work
> You have to provide the exact active namenode hostname. On an HA cluster
> using dfs client one should not need to provide the active nn hostname
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
