[ 
https://issues.apache.org/jira/browse/HDDS-14541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ivan Andika updated HDDS-14541:
-------------------------------
    Description: 
CapacityVolumeChoosingPolicy picks two random volumes and pick the volume with 
the lower utilization. This is exactly the Power of Two Random Choices 
strategy, which is a well-known distributed load-balancing strategy (used by 
AWS S3, NGINX, etc)
 * 
[https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
 * 
[https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm]

We can update the Javadoc with this explicit algorithm and attach the related 
paper ([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous 
explanation and proof.

 

  was:
CapacityVolumeChoosingPolicy picks two random volumes and pick the volume with 
the lower utilization. This is exactly the Power of Two Random Choices 
strategy, which is a well-known distributed load-balancing strategy (used by 
AWS S3, NGINX, etc)
 * 
[https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
 * 
https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm


We can update the Javadoc with the concrete strategy and the related paper 
([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous explanation and 
proof.

 


> Document Power of Two Random Choices usage in CapacityVolumeChoosingPolicy
> --------------------------------------------------------------------------
>
>                 Key: HDDS-14541
>                 URL: https://issues.apache.org/jira/browse/HDDS-14541
>             Project: Apache Ozone
>          Issue Type: Improvement
>            Reporter: Ivan Andika
>            Assignee: Ivan Andika
>            Priority: Minor
>
> CapacityVolumeChoosingPolicy picks two random volumes and pick the volume 
> with the lower utilization. This is exactly the Power of Two Random Choices 
> strategy, which is a well-known distributed load-balancing strategy (used by 
> AWS S3, NGINX, etc)
>  * 
> [https://bigdata.2minutestreaming.com/i/174142024/shuffle-sharding-and-power-of-two]
>  * 
> [https://www.f5.com/company/blog/nginx/nginx-power-of-two-choices-load-balancing-algorithm]
> We can update the Javadoc with this explicit algorithm and attach the related 
> paper ([https://dl.acm.org/doi/10.1109/71.963420]) with more rigorous 
> explanation and proof.
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to