Re: Yarn queue add command failing

2021-06-15 Thread Sunil Govindan
Hi Ankur, You may need to add *yarn.scheduler.configuration.store.class* as *zk* for this. Thanks Sunil On Tue, Jun 15, 2021 at 3:13 PM Ankur Khanna wrote: > Hi folks, > > I’m trying to add a queue in my cluster using yarn schedulerconf command, > and it’s failing with the following error : >

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread Sunil Govindan
+1 Thanks Sunil On Thu, Aug 27, 2020 at 3:49 PM Xiaoqiao He wrote: > +1 for putting 2.9 release lines to EOL. > > Thanks, > Hexiaoqiao > > On Thu, Aug 27, 2020 at 3:14 PM Mingliang Liu wrote: > >> +1 for putting 2.9 lines to EOL. >> >> Let's focus on 2.10 releases for Hadoop 2. Also is there

Re: CapacityScheduler questions - (AM) preemption

2019-10-09 Thread Sunil Govindan
Hi, Expectation of the scenario explained is more or less correct. Few informations are needed to get more clear picture. 1. hadoop version 2. capacity scheduler xml (to be precise, all preemption related configs which are added) - Sunil On Wed, Oct 9, 2019 at 6:23 PM Lars Francke wrote: >

Re: [ANNOUNCE] Apache Hadoop 3.2.1 release

2019-09-25 Thread Sunil Govindan
Here the link of Overview URL is old. We should ideally use https://hadoop.apache.org/release/3.2.1.html Thanks Sunil On Wed, Sep 25, 2019 at 2:10 PM Rohith Sharma K S wrote: > Can someone help to post this in twitter account? > > Apache Hadoop 3.2.1 is released: https://s.apache.org/mzdb6 >

Re: new to hadoop, jobs never leaving accepted

2019-07-10 Thread Sunil Govindan
Hi Jason Default value of yarn.scheduler.capacity..maximum-am-resource-percent is 0.1 (which is 10% of resource of the queue). If you want to run more apps in that queue, you need to increase this limit to run Application Master's for the apps. Please make sure this is not configured to a higher

Re: Can start two RM in one cluster

2019-06-08 Thread Sunil Govindan
Hi Kevin Yes, its possible. Please refer to https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html This explain how to configure RM in HA mode when one can be standby if that what you are looking for. Each NM sends a heartbeat like in every second to RM, and