[jira] [Commented] (HDFS-15631) dfsadmin -report with RBF returns multiple capacity and used info

2020-10-14 Thread Shen Yinjie (Jira)


[ 
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214364#comment-17214364
 ] 

Shen Yinjie commented on HDFS-15631:


Yes,all the datanodes are shared. As I know, mixed cluster with federation and 
independent cluster is also allowed  in RBF. I take a simple fix: when calling 
getStats() API , remove duplicate FederationNamespaceInfo by clusterId, then 
invoke and merge in the same way as before.

> dfsadmin -report with RBF returns multiple capacity and used info
> -
>
> Key: HDFS-15631
> URL: https://issues.apache.org/jira/browse/HDFS-15631
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: rbf
>Affects Versions: 3.0.1
>Reporter: Shen Yinjie
>Assignee: Shen Yinjie
>Priority: Major
>
> When RBF enabled,we execute `hdfs dfsadmin -report` with RBF ns, the return 
> capacity is a multiple of the number of nss 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org



[jira] [Commented] (HDFS-15631) dfsadmin -report with RBF returns multiple capacity and used info

2020-10-14 Thread Ayush Saxena (Jira)


[ 
https://issues.apache.org/jira/browse/HDFS-15631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214197#comment-17214197
 ] 

Ayush Saxena commented on HDFS-15631:
-

Are the datanodes shared amongst the cluster. I guess the API assumption is 
like, It doesn't expect the Datanodes to be shared.
What is the proposed fix, you can't just explicitly divide by number of 
namespaces. calling getDatanodeReport and figuring out the stuff, is costly and 
if some Datanodes are shared and some aren't then that would be a mess.

> dfsadmin -report with RBF returns multiple capacity and used info
> -
>
> Key: HDFS-15631
> URL: https://issues.apache.org/jira/browse/HDFS-15631
> Project: Hadoop HDFS
>  Issue Type: Bug
>  Components: rbf
>Affects Versions: 3.0.1
>Reporter: Shen Yinjie
>Assignee: Shen Yinjie
>Priority: Major
>
> When RBF enabled,we execute `hdfs dfsadmin -report` with RBF ns, the return 
> capacity is a multiple of the number of nss 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org