[jira] [Commented] (HDFS-15631) dfsadmin -report with RBF returns multiple capacity and used info
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214364#comment-17214364 ] Shen Yinjie commented on HDFS-15631: Yes,all the datanodes are shared. As I know, mixed cluster with federation and independent cluster is also allowed in RBF. I take a simple fix: when calling getStats() API , remove duplicate FederationNamespaceInfo by clusterId, then invoke and merge in the same way as before. > dfsadmin -report with RBF returns multiple capacity and used info > - > > Key: HDFS-15631 > URL: https://issues.apache.org/jira/browse/HDFS-15631 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.0.1 >Reporter: Shen Yinjie >Assignee: Shen Yinjie >Priority: Major > > When RBF enabled,we execute `hdfs dfsadmin -report` with RBF ns, the return > capacity is a multiple of the number of nss -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-15631) dfsadmin -report with RBF returns multiple capacity and used info
[ https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214197#comment-17214197 ] Ayush Saxena commented on HDFS-15631: - Are the datanodes shared amongst the cluster. I guess the API assumption is like, It doesn't expect the Datanodes to be shared. What is the proposed fix, you can't just explicitly divide by number of namespaces. calling getDatanodeReport and figuring out the stuff, is costly and if some Datanodes are shared and some aren't then that would be a mess. > dfsadmin -report with RBF returns multiple capacity and used info > - > > Key: HDFS-15631 > URL: https://issues.apache.org/jira/browse/HDFS-15631 > Project: Hadoop HDFS > Issue Type: Bug > Components: rbf >Affects Versions: 3.0.1 >Reporter: Shen Yinjie >Assignee: Shen Yinjie >Priority: Major > > When RBF enabled,we execute `hdfs dfsadmin -report` with RBF ns, the return > capacity is a multiple of the number of nss -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org