[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13941631#comment-13941631 ]
Hudson commented on HDFS-6100: ------------------------------ FAILURE: Integrated in Hadoop-Yarn-trunk #515 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/515/]) HDFS-6100. DataNodeWebHdfsMethods does not failover in HA mode. Contributed by Haohui Mai. (jing9: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1579301) * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/web/resources/DatanodeWebHdfsMethods.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/web/resources/NamenodeWebHdfsMethods.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/resources/InetSocketAddressParam.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/resources/NamenodeAddressParam.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/web/resources/NamenodeRpcAddressParam.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/DFSTestUtil.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHDFSForHA.java * /hadoop/common/trunk/hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/TestWebHdfsFileSystemContract.java > DataNodeWebHdfsMethods does not failover in HA mode > --------------------------------------------------- > > Key: HDFS-6100 > URL: https://issues.apache.org/jira/browse/HDFS-6100 > Project: Hadoop HDFS > Issue Type: Bug > Components: ha > Affects Versions: 2.4.0 > Reporter: Arpit Gupta > Assignee: Haohui Mai > Fix For: 2.4.0 > > Attachments: HDFS-6100.000.patch, HDFS-6100.001.patch > > > In {{DataNodeWebHdfsMethods}}, the code creates a {{DFSClient}} to connect to > the NN, so that it can access the files in the cluster. > {{DataNodeWebHdfsMethods}} relies on the address passed in the URL to locate > the NN. This implementation has two problems: > # The {{DFSClient}} only knows about the current active NN, thus it does not > support failover. > # The delegation token is based on the active NN, therefore the {{DFSClient}} > will fail to authenticate of the standby NN in secure HA setup. > Currently the parameter {{namenoderpcaddress}} in the URL stores the host-ip > pair that corresponds to the active NN. To fix this bug, this jira proposes > to store the name service id in the parameter in HA setup (yet the parameter > stays the same in non-HA setup). -- This message was sent by Atlassian JIRA (v6.2#6252)