Hi Jonathan, I'm okay with putting this into branch-3.0 for GA if it can be merged within the next two weeks. Even though beta1 has slipped by a month, I want to stick to the targeted GA data of Nov 1st as much as possible. Of course, let's not sacrifice quality or stability for speed; if something's not ready, let's defer it to 3.1.0.
Subru, have you been able to review this feature from the 2.9.0 perspective? It'd add confidence if you think it's immediately ready for merging to branch-2 for 2.9.0. Thanks, Andrew On Thu, Sep 28, 2017 at 11:32 AM, Jonathan Hung <jyhung2...@gmail.com> wrote: > Hi everyone, > > Starting this thread to discuss merging API-based scheduler configuration > to trunk/branch-2. The feature adds the framework for allowing users to > modify scheduler configuration via REST or CLI using a configurable backend > (leveldb/zk are currently supported), and adds capacity scheduler support > for this. The umbrella JIRA is YARN-5734. All the required work for this > feature is done and committed to branch YARN-5734, and a full diff has been > generated at YARN-7241. > > Regarding compatibility, this feature is configurable and turned off by > default. > > The feature has been tested locally on a couple RMs (since it is an RM > only change), with queue addition/removal/updates tested on single RM > (leveldb) and two RMs (zk). Also we verified the original configuration > update mechanism (via refreshQueues) is unaffected when the feature is > off/not configured. > > Our original plan was to merge this to trunk (which is what the YARN-7241 > diff is based on), and port to branch-2 before the 2.9 release. @Andrew, > what are your thoughts on also merging this to branch-3.0? > > Thanks! > > Jonathan Hung >
