ruiliang created YARN-11789:
-------------------------------
Summary: CGroupsResourceCalculator doc Description error
Key: YARN-11789
URL: https://issues.apache.org/jira/browse/YARN-11789
Project: Hadoop YARN
Issue Type: Improvement
Affects Versions: 3.3.0
Reporter: ruiliang
1：CGroupsResourceCalculator doc Description error
[NodeManagerCGroupsMemory|[https://hadoop.apache.org/docs/r3.3.0/hadoop-yarn/hadoop-yarn-site/NodeManagerCGroupsMemory.html#:~:text=In%20order%20to%20enable%20cgroups%20based%20resource%20calculation%20set%20yarn.nodemanager.resource%2Dcalculator.class%20to%20org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsResourceCalculator.]]
It should be
yarn.nodemanager.container-monitor.process-tree.class
to
{{{}org.apache.hadoop.yarn.server.nodemanager.containermanager.linux.resources.CGroupsResourceCalculator{}}}.
2：I have a question. I enabled Elastic Memory Control through cgroups based on
the [NodeManagerCGroupsMemory documentation|
https://hadoop.apache.org/docs/r3.3.0/hadoop-yarn/hadoop-yarn-site/NodeManagerCGroupsMemory.html#:~:text=%E9%99%90%E5%88%B6%E6%98%AF%E5%88%86%E9%85%8D%E7%BB%99%E8%8A%82%E7%82%B9%E4%B8%8A%E6%89%80%E6%9C%89%E5%AE%B9%E5%99%A8%E7%9A%84%E5%86%85%E5%AD%98%E9%87%8F%E3%80%82%E9%99%90%E5%88%B6%E7%94%B1yarn.nodemanager.resource.memory%2Dmb%E5%92%8Cyarn.nodemanager.vmem%2Dpmem%2Dratio%E6%8C%87%E5%AE%9A%E3%80%82%E5%A6%82%E6%9E%9C%E6%9C%AA%E8%AE%BE%E7%BD%AE%E8%BF%99%E4%BA%9B%EF%BC%8C%E5%88%99%E6%A0%B9%E6%8D%AE%E5%8F%AF%E7%94%A8%E8%B5%84%E6%BA%90%E8%AE%BE%E7%BD%AE%E9%99%90%E5%88%B6%E3%80%82%E6%9C%89%E5%85%B3%E8%AF%A6%E7%BB%86%E4%BF%A1%E6%81%AF%EF%BC%8C%E8%AF%B7%E5%8F%82%E9%98%85yarn.nodemanager.resource.detect%2Dhardware%2Dcapabilities%E3%80%82].
When I have a container jvm process of -Xmx 10G,
{code:java}
exec /bin/bash -c "$JAVA_HOME/bin/java -server -Xmx10240m
'-XX:OnOutOfMemoryError=echo OnOutOfMemory' xx --user-class-path
file:$PWD/__app__.jar 1>/xx_1_000004/stdout 2>/xx_01_000004/stderr"
{code}
container code
{code:java}
....
val gb1= new obj5G()
print(gb1.dataa)
val gb2= new obj5G()
print(gb2.dataa.mkString("Array(", ", ", ")"))
...
class obj5G{var dataa= new Array[Byte](1024 * 1024 * 1024*5) //5gb}
... {code}
But the container is always get Java. Lang. OutOfMemoryError: Java heap space
Did I misunderstand? Under what conditions does the container use Elastic
Memory beyond 10GB+?
This question has puzzled me for a long time, please help me to answer or have
any case for reference, thank you very much
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
