This is an automated email from the ASF dual-hosted git repository.
Hexiaoqiao pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new c3566f95d3a YARN-11967. Addendum: don't enable pmem/vmem checks in
DistributedShellBaseTest (#8595). Contributed by yanbin.zhang.
c3566f95d3a is described below
commit c3566f95d3aee0471e10e1507567b318484f598e
Author: singer-bin <[email protected]>
AuthorDate: Tue Jul 14 12:22:36 2026 +0800
YARN-11967. Addendum: don't enable pmem/vmem checks in
DistributedShellBaseTest (#8595). Contributed by yanbin.zhang.
Signed-off-by: Cheng Pan <[email protected]>
Signed-off-by: He Xiaoqiao <[email protected]>
---
.../distributedshell/DistributedShellBaseTest.java | 14 +++++++++++---
1 file changed, 11 insertions(+), 3 deletions(-)
diff --git
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/DistributedShellBaseTest.java
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/DistributedShellBaseTest.java
index 607a4c90d7e..72b04f64ae3 100644
---
a/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/DistributedShellBaseTest.java
+++
b/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-applications/hadoop-yarn-applications-distributedshell/src/test/java/org/apache/hadoop/yarn/applications/distributedshell/DistributedShellBaseTest.java
@@ -524,13 +524,21 @@ protected void setupInternal(int numNodeManagers,
conf.setBoolean(YarnConfiguration.NODE_LABELS_ENABLED, true);
conf.set("mapreduce.jobhistory.address",
"0.0.0.0:" + ServerSocketUtil.getPort(10021, 10));
- // Enable ContainersMonitorImpl
+ // Enable ContainersMonitorImpl so that resource utilization is tracked
+ // (needed by opportunistic container allocation below). Do NOT enable the
+ // polling-based pmem/vmem checks: these tests are not exercising memory
+ // enforcement, and their containers can legitimately exceed the tiny
+ // MIN_ALLOCATION_MB limit. Before YARN-11967 these checks were silently
+ // skipped because strictMemoryEnforcement defaulted to true; now that
+ // strictMemoryEnforcement requires
yarn.nodemanager.resource.memory.enabled
+ // as well (default false), the polling check would actually run and kill
+ // the containers, breaking these tests. Keep the checks disabled here.
conf.set(YarnConfiguration.NM_CONTAINER_MON_RESOURCE_CALCULATOR,
LinuxResourceCalculatorPlugin.class.getName());
conf.set(YarnConfiguration.NM_CONTAINER_MON_PROCESS_TREE,
ProcfsBasedProcessTree.class.getName());
- conf.setBoolean(YarnConfiguration.NM_PMEM_CHECK_ENABLED, true);
- conf.setBoolean(YarnConfiguration.NM_VMEM_CHECK_ENABLED, true);
+ conf.setBoolean(YarnConfiguration.NM_PMEM_CHECK_ENABLED, false);
+ conf.setBoolean(YarnConfiguration.NM_VMEM_CHECK_ENABLED, false);
conf.setBoolean(
YarnConfiguration.YARN_MINICLUSTER_CONTROL_RESOURCE_MONITORING, true);
conf.setBoolean(YarnConfiguration.RM_SYSTEM_METRICS_PUBLISHER_ENABLED,
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
