zuston commented on PR #208: URL: https://github.com/apache/incubator-uniffle/pull/208#issuecomment-1244868508
The conf of `rss.coordinator.shuffle.nodes.max` in coordinator is a soft limitation. It means when available nodes number is lower than this value, it will not throw exception and reassign the number of all available nodes. But in current implementation of `AccessClusterLoadChecker`, it will reject the app when available nodes number < `rss.coordinator.shuffle.nodes.max`. ### For example available shuffle nodes number = 20 job required shuffle nodes number = 10 `rss.coordinator.shuffle.nodes.max` = 30 The `AccessClusterLoadChecker` will reject this job. I think this is unreasonable. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
