[ https://issues.apache.org/jira/browse/HDFS-15900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17312864#comment-17312864 ]
Takanobu Asanuma commented on HDFS-15900: ----------------------------------------- Reverted from branch-3.2 and branch-3.1. [~hdaikoku] I think we should fix the bug in branch-3.2 and branch-3.1. Would you mind creating another PR for branch-3.2 and branch-3.1? > RBF: empty blockpool id on dfsrouter caused by UNAVAILABLE NameNode > ------------------------------------------------------------------- > > Key: HDFS-15900 > URL: https://issues.apache.org/jira/browse/HDFS-15900 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf > Affects Versions: 3.3.0 > Reporter: Harunobu Daikoku > Assignee: Harunobu Daikoku > Priority: Major > Labels: pull-request-available > Fix For: 3.3.1, 3.4.0, 3.1.5, 3.2.3 > > Attachments: image.png > > Time Spent: 4h > Remaining Estimate: 0h > > We observed that when a NameNode becomes UNAVAILABLE, the corresponding > blockpool id in MembershipStoreImpl#activeNamespaces on dfsrouter > unintentionally sets to empty, its initial value. > !image.png|height=250! > As a result of this, concat operations through dfsrouter fail with the > following error as it cannot resolve the block id in the recognized active > namespaces. > {noformat} > Caused by: > org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.ipc.RemoteException): > Cannot locate a nameservice for block pool BP-... > {noformat} > A possible fix is to ignore UNAVAILABLE NameNode registrations, and set > proper namespace information obtained from available NameNode registrations > when constructing the cache of active namespaces. > > [https://github.com/apache/hadoop/blob/rel/release-3.3.0/hadoop-hdfs-project/hadoop-hdfs-rbf/src/main/java/org/apache/hadoop/hdfs/server/federation/store/impl/MembershipStoreImpl.java#L207-L221] -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org