[jira] [Commented] (YARN-6224) Should consider utilization of each ResourceType on node while scheduling
[ https://issues.apache.org/jira/browse/YARN-6224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17239571#comment-17239571 ] zhuqi commented on YARN-6224: - cc [~wangda] [~bibinchundatt] [~sunilg] It's a good policy to choose node based dominant node resource, when with more and more resource type in our production cluster, such as GPU/FPGA etc. > Should consider utilization of each ResourceType on node while scheduling > - > > Key: YARN-6224 > URL: https://issues.apache.org/jira/browse/YARN-6224 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Tao Jie >Priority: Major > > In situation like YARN-6101, if we consider all type of resource(vcore, > memory) utilization on node rather than just answer we can allocate or not, > we are more likely to have better resource utilization as a whole. > It is possible that we have a set of candidate nodes, then find the most > promising node to assign to one request considering node resource utilization > with global scheduling. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6224) Should consider utilization of each ResourceType on node while scheduling
[ https://issues.apache.org/jira/browse/YARN-6224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880024#comment-15880024 ] Sunil G commented on YARN-6224: --- If I understood correctly, we could have certain policies to selected better candidate nodes and seems its pluggable. cc/ [~leftnoteasy] > Should consider utilization of each ResourceType on node while scheduling > - > > Key: YARN-6224 > URL: https://issues.apache.org/jira/browse/YARN-6224 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Tao Jie > > In situation like YARN-6101, if we consider all type of resource(vcore, > memory) utilization on node rather than just answer we can allocate or not, > we are more likely to have better resource utilization as a whole. > It is possible that we have a set of candidate nodes, then find the most > promising node to assign to one request considering node resource utilization > with global scheduling. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
