I have specified the following:
tezConfiguration.setBoolean(TEZ_AM_SESSION_MODE, true);
tezConfiguration.setLong(TEZ_SESSION_AM_DAG_SUBMIT_TIMEOUT_SECS, 30 *
60);
tezConfiguration.setLong(TEZ_AM_SESSION_MIN_HELD_CONTAINERS, 3);
tezConfiguration.setLong(TEZ_AM_CONTAINER_IDLE_RELEASE_TIMEOUT_MIN_MILLIS,
10 * 60 * 1000);
tezConfiguration.setLong(TEZ_AM_CONTAINER_IDLE_RELEASE_TIMEOUT_MAX_MILLIS, 15
* 60 * 1000);
For my session. On a cluster with 220 containers when I launch a Tez job
that uses all 220 containers it holds onto all 220 containers after it's
done. Is there a way to specify max held containers? I want to retain
maybe like 10% of those used.
- Thad