[
https://issues.apache.org/jira/browse/HADOOP-1256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12488821
]
Hairong Kuang commented on HADOOP-1256:
---------------------------------------
I want to make it clear that HADOOP-971 patch was tested on a 1800-node cluster
before it got committed. But this bug occurs only when fsimage & fsedits
contain multiple add entries for the same storage id. So unfortunately the bug
was not caught.
I understand Konstantin's concern that HADOOP-971 adds complexity to NameNode.
I'd be happy if anybody comes up with an idea that removes the
getDatanodeByHost bottleneck without introducing the host2DatanodeMap.
> Dfs image loading and edits loading creates multiple instances of
> DatanodeDescriptor for the same datanode
> ----------------------------------------------------------------------------------------------------------
>
> Key: HADOOP-1256
> URL: https://issues.apache.org/jira/browse/HADOOP-1256
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.12.3
> Reporter: Hairong Kuang
> Assigned To: Hairong Kuang
> Fix For: 0.13.0
>
> Attachments: nodeMap.patch
>
>
> This leads to multiple instances of DatanodeDescriptors for the same datanode
> stored in Host2DatanodeMap.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
