Hi Pifta, Thanks for your reply. That's good news! Does Ozone also support other placement policies like one replica in 3 different racks? That will be super useful from an operational point of view. It will be possible to put in maintenance (for update or other task) an entire rack and be sure that 2 other replicas are in 2 different racks still up and running and not losing 2 replicas.
Does the placement policy is also enforced during the rebalancing like in HDFS? Thanks, Michel Le jeu. 9 juil. 2020 à 13:05, István Fajth <[email protected]> a écrit : > Hi Michel, > > yes, Ozone has topology support (currently 3 levels are supported: root, > rack, node) to specify cluster topology similarly as in HDFS. With > replication factor 3 it works similarly as in HDFS and ensures that > container replicas reside in 2 racks, 2 in one rack, and 1 in another rack. > Also the FileSystem APIs (o3fs:// and ofs://) are implementing the methods > required to provide the locality information to the clients similarly as in > HDFS, so YARN can take advantage of this information, and can bring compute > to the data as with HDFS. > > It is worth noting that there are not too many clusters currently using > these features, but if any issues arise we are there to react, and there > are some plans as well to harden the system further. There are a couple of > items already planned after the soon to be released 0.6.0 you can check > into it in this JIRA (HDDS-3722) > <https://issues.apache.org/jira/browse/HDDS-3722>. > > If you have any questions feel free to ask further :) > Pifta > > Michel Sumbul <[email protected]> ezt írta (időpont: 2020. júl. 9., > Cs, 12:57): > > > Hi guys, > > > > First thanks for your work on this project, it looks really great as the > > next evolution of HDFS (if I can say that :-) ) > > > > I saw in multiple slideshows on the web that Ozone will support data > > locality like HDFS. > > What's the status of that? Is it already implemented? > > > > Thanks, > > Michel > > > > > -- > Pifta >
