[
https://issues.apache.org/jira/browse/HDDS-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ivan Andika updated HDDS-14541:
-------------------------------
Description:
CapacityVolumeChoosingPolicy picks two random volumes and pick the volume with
the lower utilization. This is exactly the Power of Two Random Choices
strategy, which is a well-known distributed load-balancing strategy (used by
AWS S3, NGINX, etc)
*
[https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
*
[https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm]
We can update the Javadoc with this explicit algorithm and attach the related
paper ([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous
explanation and proof.
was:
CapacityVolumeChoosingPolicy picks two random volumes and pick the volume with
the lower utilization. This is exactly the Power of Two Random Choices
strategy, which is a well-known distributed load-balancing strategy (used by
AWS S3, NGINX, etc)
*
[https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
*
https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm
We can update the Javadoc with the concrete strategy and the related paper
([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous explanation and
proof.
> Document Power of Two Random Choices usage in CapacityVolumeChoosingPolicy
> --------------------------------------------------------------------------
>
> Key: HDDS-14541
> URL: https://issues.apache.org/jira/browse/HDDS-14541
> Project: Apache Ozone
> Issue Type: Improvement
> Reporter: Ivan Andika
> Assignee: Ivan Andika
> Priority: Minor
>
> CapacityVolumeChoosingPolicy picks two random volumes and pick the volume
> with the lower utilization. This is exactly the Power of Two Random Choices
> strategy, which is a well-known distributed load-balancing strategy (used by
> AWS S3, NGINX, etc)
> *
> [https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
> *
> [https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm]
> We can update the Javadoc with this explicit algorithm and attach the related
> paper ([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous
> explanation and proof.
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]