[ https://issues.apache.org/jira/browse/HDFS-15087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025589#comment-17025589 ]
Brahma Reddy Battula commented on HDFS-15087: --------------------------------------------- {quote}First support DFSAdmin command balance. Then integrate it to Router. Finally support smart balance {quote} Ok.this will be good to have. {quote}When I trying to use snapshot I meet a tricky problem. I envisioned 2 ways: In fun1, we don't do hardlink in the loop. So the final hardlink will cost a lot. From the performance chapter we can see the HardLink part costs 474,701ms(82.22%) for a large path. The larger the path is, the higer the hardlink proportion. So in this way the benefit of snapshot delta is not much(17.78%). {quote} if we use snapshot, I dn't think, we require hardlink. {quote}We need to check the existance of the dst-path. If the dst-path exists then the rpc succeeds. Otherwise the rpc fails. {quote} When dst path have multiplefiles and subfolders, all these existence will be checked. {quote}Hi everyone, any further comments? Please let me know your thoughts, thanks ! {quote} I dn't have further comments. May be, you can update design doc with this improvements/future plan and create the branch start contribute. > RBF: Balance/Rename across federation namespaces > ------------------------------------------------ > > Key: HDFS-15087 > URL: https://issues.apache.org/jira/browse/HDFS-15087 > Project: Hadoop HDFS > Issue Type: Improvement > Reporter: Jinglun > Priority: Major > Attachments: HDFS-15087.initial.patch, HFR_Rename Across Federation > Namespaces.pdf > > > The Xiaomi storage team has developed a new feature called HFR(HDFS > Federation Rename) that enables us to do balance/rename across federation > namespaces. The idea is to first move the meta to the dst NameNode and then > link all the replicas. It has been working in our largest production cluster > for 2 months. We use it to balance the namespaces. It turns out HFR is fast > and flexible. The detail could be found in the design doc. > Looking forward to a lively discussion. -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org