Can start two RM in one cluster

2019-06-07 Thread kevin su
Hi all, There is a way to start two Namenode, and request for both of them So can we start two RM as well ? Another question is every times if we want to allocate resource from RM, it will find which node manager has resources. Is RM send every request to all node manager, and get all NM report

Re: Can start two RM in one cluster

2019-06-08 Thread Sunil Govindan
Hi Kevin Yes, its possible. Please refer to https://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/ResourceManagerHA.html This explain how to configure RM in HA mode when one can be standby if that what you are looking for. Each NM sends a heartbeat like in every second to RM, and RM

Re: Can start two RM in one cluster

2019-06-09 Thread Ayush Saxena
Hi Kevin, It is possible to have multiple Namenodes in a HA setup. One Active Namenode and multiple Standby Namenodes. The Active Namenodes serves all the requests. In case of failure of Active Namenode, one of the standby takes up its place and acts as Active to serve the requests there after.