[ https://issues.apache.org/jira/browse/HDFS-14118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16755443#comment-16755443 ]
Íñigo Goiri commented on HDFS-14118: ------------------------------------ Thanks for [^HDFS-14118.008.patch]. I think we should also move to commons the following: * {{RESOLVE_SERVICE_KEY}} and the hdfs-default.xml key. * {{MockDomainNameResolver}}; into the test folder and add a small test which checks has those hard coded values and validates those are the return types. We should also: * Avoid the superfluous changes in {{TestConfiguredFailoverProxyProvider}} (e.g., empty lines and lines like 104, 107, etc). * Move the setup of the DNS to a function and just use it for {{testResolveDomainNameUsingDNS()}}. > Use DNS to resolve Namenodes and Routers > ---------------------------------------- > > Key: HDFS-14118 > URL: https://issues.apache.org/jira/browse/HDFS-14118 > Project: Hadoop HDFS > Issue Type: New Feature > Reporter: Fengnan Li > Assignee: Fengnan Li > Priority: Major > Attachments: DNS testing log, HDFS-14118.001.patch, > HDFS-14118.002.patch, HDFS-14118.003.patch, HDFS-14118.004.patch, > HDFS-14118.005.patch, HDFS-14118.006.patch, HDFS-14118.007.patch, > HDFS-14118.008.patch, HDFS-14118.patch > > > Clients will need to know about routers to talk to the HDFS cluster > (obviously), and having routers updating (adding/removing) will have to make > every client change, which is a painful process. > DNS can be used here to resolve the single domain name clients knows to a > list of routers in the current config. However, DNS won't be able to consider > only resolving to the working router based on certain health thresholds. > There are some ways about how this can be solved. One way is to have a > separate script to regularly check the status of the router and update the > DNS records if a router fails the health thresholds. In this way, security > might be carefully considered for this way. Another way is to have the client > do the normal connecting/failover after they get the list of routers, which > requires the change of current failover proxy provider. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org