Siyao Meng created HDFS-18014:
---------------------------------
Summary: Slow peer lookup in DatanodeManager fails for IPv6
DataNodes
Key: HDFS-18014
URL: https://issues.apache.org/jira/browse/HDFS-18014
Project: Hadoop HDFS
Issue Type: Bug
Components: namenode
Reporter: Siyao Meng
Assignee: Siyao Meng
{{DatanodeManager#getDnDescriptorsFromIpAddr}} extracts the host from each slow
peer key with {{node.split(":")[0]}}. The keys are DataNode info addresses
({{DatanodeID#getInfoAddr()}} or {{getInfoSecureAddr()}}) recorded by
{{BlockReceiver}} and stored by {{SlowPeerTracker#addReport}}.
For an IPv6 DataNode the key is {{2001:db8::1:9864}} (or {{[2001:db8::1]:9864}}
once HDFS-18010 brackets IPv6 literals), so the extracted host is {{2001}} (or
{{[2001}}). {{Host2NodesMap#getDatanodeByHost}} never finds the node, so
{{getSlowPeersUuidSet}} and {{getAllSlowDataNodes}} return nothing for IPv6
DataNodes and
{{dfs.namenode.block-placement-policy.exclude-slow-nodes.enabled}} has no
effect on them.
Fix: take the host as everything before the last {{:}} and strip surrounding
brackets. IPv4 and hostname keys parse the same as before.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]