[ 
https://issues.apache.org/jira/browse/HDFS-11564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15939001#comment-15939001
 ] 

Anu Engineer commented on HDFS-11564:
-------------------------------------

The algorithms of choosing 2 random nodes and then placing the container on the 
lower utilization node is discussed in great depth in this survey paper.
https://pdfs.semanticscholar.org/3597/66cb47572028eb70c797115e987ff203e83f.pdf


> Ozone: SCM: Add Comparable Metric Support
> -----------------------------------------
>
>                 Key: HDFS-11564
>                 URL: https://issues.apache.org/jira/browse/HDFS-11564
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ozone
>    Affects Versions: HDFS-7240
>            Reporter: Anu Engineer
>            Assignee: Anu Engineer
>
> While picking the datanode or the pool to place a container, SCM needs to be 
> able to compare pools and datanodes. This jira proposes to add a Comparable 
> Metric interface from which DatanodeCapacity and DatanodeIOLoad metrics can 
> be derived. This will also convert SCM Container Placement Capacity policy to 
> use these metrics.
> Adding these metrics makes all placement policy operate on the basis of these 
> metrics and it makes it easy to simulate cluster imbalances as well as reason 
> about code. All new SCM metrics which have the property of total ordering 
> should be derived from this interface.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to