Hey all, Happy to present the multi-raft feature to ozone community (https://issues.apache.org/jira/browse/HDDS-1564). This feature is to allow every datanode to host more than 1 pipeline based on user config to better utilize every datanode’s disks IO.
All dev work have been done and I’ve conducted performance tests in different scenarios. Based on my testing, multi-raft ozone cluster can help to make writing latency as low as 1/3 of single-raft’s one. Please check the attachment in the above JIRA for test brief and more details as well as the code patch. I would like to use this thread to discuss about this feature and it’s merge back to master. -Li
