Hi Michel, yes, Ozone has topology support (currently 3 levels are supported: root, rack, node) to specify cluster topology similarly as in HDFS. With replication factor 3 it works similarly as in HDFS and ensures that container replicas reside in 2 racks, 2 in one rack, and 1 in another rack. Also the FileSystem APIs (o3fs:// and ofs://) are implementing the methods required to provide the locality information to the clients similarly as in HDFS, so YARN can take advantage of this information, and can bring compute to the data as with HDFS.
It is worth noting that there are not too many clusters currently using these features, but if any issues arise we are there to react, and there are some plans as well to harden the system further. There are a couple of items already planned after the soon to be released 0.6.0 you can check into it in this JIRA (HDDS-3722) <https://issues.apache.org/jira/browse/HDDS-3722>. If you have any questions feel free to ask further :) Pifta Michel Sumbul <[email protected]> ezt írta (időpont: 2020. júl. 9., Cs, 12:57): > Hi guys, > > First thanks for your work on this project, it looks really great as the > next evolution of HDFS (if I can say that :-) ) > > I saw in multiple slideshows on the web that Ozone will support data > locality like HDFS. > What's the status of that? Is it already implemented? > > Thanks, > Michel > -- Pifta
