consistency of yarn exclude file

2023-01-03 Thread Dong Ye
Hi, All: For resource manager, can we set yarn.resourcemanager.nodes.exclude-path to a s3 file, so all 3 resource managers can access it. The benefit is that there is no need to sync the exclude.xml file. If not, how to sync the file on different HA resource managers? Thanks. Ref : https

Re: stale_status_of_NM_from_standby_RM

2023-01-03 Thread Chris Nauroth
You can only run "yarn rmadmin -refreshNodes" against the active ResourceManager instance. In an HA deployment, a standby instance would return a "not active" error if it received this call, and then the client would failover to the other instance to retry. The ResourceManagers do not synchronize