Garry,
Thanks for the reply. My test wasn't very scientific. I scheduled 16
tasks at once on a test cluster of two nodes and when I looked at the ones
running, one machine was maxed out (memory-wise) with 10 containers while
the other had only 3 and was adding the remaining 3 tasks. It seemed t
Hi Roger,
I've seen unbalanced container assignment across hosts but never one being
maxed out before any others get any containers. So I'd look to the YARN config
to start with.
I believe though there will be a risk of this type of thing until YARN
implements anti-affinity:
https://issues.a
