Sounds like a good idea to me. This has been tested on branch-2 in production for some time and benchmarks look good.
Thanks, --Konstantin On Fri, Mar 29, 2019 at 12:14 PM Jonathan Hung <jyhung2...@gmail.com> wrote: > Hello devs, > > Starting a discuss thread to merge resource types/native GPU scheduling > support to branch-3.0 and branch-2. The resource types work was done in > trunk~branch-3.0 and GPU support done in trunk~branch-3.1, so the proposal > is to merge GPU support into branch-3.0 and both resource types/GPU support > to branch-2. > > Internally we've been running resource types/GPU support off a fork of > branch-2.9.0 in a > 300 node GPU cluster for a few months which has worked > well. Also for completeness we verified that everything going into branch-2 > also exists in branch-3.0. > > The specific list of patches to merge is in feature branch > YARN-8200.branch3 (for branch-3.0) and feature branch YARN-8200 (for > branch-2). Full patches containing the YARN-8200.branch3 -> branch-3.0 diff > and YARN-8200 -> branch-2 diff have been posted to YARN-8200 jira. > > If there's no issues from the community I'll start a merge vote next week. > Thanks. > > Jonathan Hung >
