[ https://issues.apache.org/jira/browse/HDFS-11530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15958352#comment-15958352 ]
Yiqun Lin edited comment on HDFS-11530 at 4/6/17 6:13 AM: ---------------------------------------------------------- Thanks for your analysis, [~vagarychen]! I think there is no need to use {{DFSNetworkTopology}} in {{Dispatcher}}. As I look into the code, the {{NetworkTopology}} that used in class {{Dispatcher}} is completely independent. It will add the nodes into topology in the {{Dispatcher#init}} method. In addition, the method {{NetworkTopology#isNodeGroupAware()}} will also be invoked in {{Dispatcher}}. Attach the new patch to address this and fix checkstyle warning. was (Author: linyiqun): Thanks for your analysis, [~vagarychen]! I think there is no need to use {{DFSNetworkTopology}} in {{Dispatcher}}. As I look into the code, the {{NetworkTopology}} that used in class {{Dispatcher}} is completely independent. It will add the nodes into topology in the {{.Dispatcher#init}} method. In addition, the method {{NetworkTopology#isNodeGroupAware()}} will also be invoked in {{Dispatcher}}. Attach the new patch to address this and fix checkstyle warning. > Use HDFS specific network topology to choose datanode in > BlockPlacementPolicyDefault > ------------------------------------------------------------------------------------ > > Key: HDFS-11530 > URL: https://issues.apache.org/jira/browse/HDFS-11530 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: namenode > Affects Versions: 3.0.0-alpha2 > Reporter: Yiqun Lin > Assignee: Yiqun Lin > Attachments: HDFS-11530.001.patch, HDFS-11530.002.patch, > HDFS-11530.003.patch, HDFS-11530.004.patch, HDFS-11530.005.patch > > > The work for {{chooseRandomWithStorageType}} has been merged in HDFS-11482. > But this method is contained in new topology {{DFSNetworkTopology}} which is > specified for HDFS. We should update this and let > {{BlockPlacementPolicyDefault}} use the new way since the original way is > inefficient. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org