[jira] [Commented] (YUNIKORN-2) Support Gang Scheduling
[ https://issues.apache.org/jira/browse/YUNIKORN-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17268422#comment-17268422 ] Weiwei Yang commented on YUNIKORN-2: The major changes in the shim side now has been merged into the master, and branch-0.10. I've updated the fixed version for every fixed issue. The buck review PR is https://github.com/apache/incubator-yunikorn-k8shim/pull/219, thanks [~kmarton] for the review. >From this point on, all the new changes must go to master and branch-0.10. > Support Gang Scheduling > --- > > Key: YUNIKORN-2 > URL: https://issues.apache.org/jira/browse/YUNIKORN-2 > Project: Apache YuniKorn > Issue Type: New Feature > Components: core - scheduler >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Major > Labels: pull-request-available > > Gang scheduling is one of the most important features for schedulers, it is > very useful for machine learning workloads such as tensorflow, pytorch, etc. > Since yunikorn has notion of the application, it is not very hard for us to > support gang scheduling context. > This umbrella tracks the efforts to support gang scheduling feature in > yunikorn. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@yunikorn.apache.org For additional commands, e-mail: issues-h...@yunikorn.apache.org
[jira] [Commented] (YUNIKORN-2) Support Gang Scheduling
[ https://issues.apache.org/jira/browse/YUNIKORN-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17247978#comment-17247978 ] Wilfred Spiegelenburg commented on YUNIKORN-2: -- Document describing the scheduler and interface changes for gang scheduling. > Support Gang Scheduling > --- > > Key: YUNIKORN-2 > URL: https://issues.apache.org/jira/browse/YUNIKORN-2 > Project: Apache YuniKorn > Issue Type: New Feature > Components: core - scheduler >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Major > > Gang scheduling is one of the most important features for schedulers, it is > very useful for machine learning workloads such as tensorflow, pytorch, etc. > Since yunikorn has notion of the application, it is not very hard for us to > support gang scheduling context. > This umbrella tracks the efforts to support gang scheduling feature in > yunikorn. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@yunikorn.apache.org For additional commands, e-mail: issues-h...@yunikorn.apache.org
[jira] [Commented] (YUNIKORN-2) Support Gang Scheduling
[ https://issues.apache.org/jira/browse/YUNIKORN-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210604#comment-17210604 ] Weiwei Yang commented on YUNIKORN-2: We had a lot of discussions in the community, thanks for contributing your ideas [~wangda], [~sunilg], [~wilfreds], [~adam.antal], [~kmarton], [~Huang Ting Yao]. As discussed, we will use the solution documented in the doc attached to implement this feature. I will break down the tasks and start to work on this. The targeting release is 0.10. Thanks all. > Support Gang Scheduling > --- > > Key: YUNIKORN-2 > URL: https://issues.apache.org/jira/browse/YUNIKORN-2 > Project: Apache YuniKorn > Issue Type: New Feature > Components: core - scheduler >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Major > > Gang scheduling is one of the most important features for schedulers, it is > very useful for machine learning workloads such as tensorflow, pytorch, etc. > Since yunikorn has notion of the application, it is not very hard for us to > support gang scheduling context. > This umbrella tracks the efforts to support gang scheduling feature in > yunikorn. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@yunikorn.apache.org For additional commands, e-mail: issues-h...@yunikorn.apache.org
[jira] [Commented] (YUNIKORN-2) Support Gang Scheduling
[ https://issues.apache.org/jira/browse/YUNIKORN-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17108784#comment-17108784 ] Wangda Tan commented on YUNIKORN-2: --- Added design doc, still largely WIP. [~wwei], [~wilfreds], [~Tao Yang], [~sunil.gov...@gmail.com] please review and give some feedbacks when you get chance. > Support Gang Scheduling > --- > > Key: YUNIKORN-2 > URL: https://issues.apache.org/jira/browse/YUNIKORN-2 > Project: Apache YuniKorn > Issue Type: New Feature > Components: core - scheduler >Reporter: Weiwei Yang >Assignee: Weiwei Yang >Priority: Major > > Gang scheduling is one of the most important features for schedulers, it is > very useful for machine learning workloads such as tensorflow, pytorch, etc. > Since yunikorn has notion of the application, it is not very hard for us to > support gang scheduling context. > This umbrella tracks the efforts to support gang scheduling feature in > yunikorn. -- This message was sent by Atlassian Jira (v8.3.4#803005) - To unsubscribe, e-mail: issues-unsubscr...@yunikorn.apache.org For additional commands, e-mail: issues-h...@yunikorn.apache.org
