Aggarwal-Raghav commented on PR #456: URL: https://github.com/apache/tez/pull/456#issuecomment-4016261977
In YARN the AM was started using these opts in my env. ``` echo "Launching container" exec /bin/bash -c "$JAVA_HOME/bin/java -Xmx819m -Djava.io.tmpdir=$PWD/tmp -server -Djava.net.preferIPv4Stack=true -Xlog:gc*=info,class+load=info::time,uptime,level,tags -XX:+UseNUMA --add-opens=java.base/java.net=ALL-UNNAMED --add-opens=java.base/java.util=ALL-UNNAMED --add-opens=java.base/java.util.concurrent=ALL-UNNAMED --add-opens=java.base/java.util.concurrent.atomic=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.io=ALL-UNNAMED --add-opens=java.base/java.lang=ALL-UNNAMED --add-opens=java.base/java.lang.invoke=ALL-UNNAMED --add-opens=java.base/java.lang.reflect=ALL-UNNAMED --add-opens=java.base/java.math=ALL-UNNAMED --add-opens=java.base/java.nio=ALL-UNNAMED --add-opens=java.base/java.text=ALL-UNNAMED --add-opens=java.base/java.time=ALL-UNNAMED --add-opens=java.base/jdk.internal.ref=ALL-UNNAMED --add-opens=java.base/jdk.internal.reflect=ALL-UNNAMED --add-opens=java.sql/java.sql=ALL-UNNAMED --add-opens=java.base/sun.nio.ch=ALL-UNNAMED --add-o pens=java.base/sun.nio.cs=ALL-UNNAMED --add-opens=java.base/java.util.regex=ALL-UNNAMED --add-opens=java.base/java.security=ALL-UNNAMED --add-opens=java.base/sun.security.provider=ALL-UNNAMED --add-opens java.base/java.lang=ALL-UNNAMED -Dlog4j.configuratorClass=org.apache.tez.common.TezLog4jConfigurator -Dlog4j.configuration=tez-container-log4j.properties -Dyarn.app.container.log.dir=/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001 -Dtez.root.logger=INFO,CLA -Dsun.nio.ch.bugLevel='' org.apache.tez.dag.app.DAGAppMaster --session 1>/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001/stdout 2>/Users/raghav/Desktop/setup/hadoop/logs/userlogs/application_1772650638101_0002/container_1772650638101_0002_01_000001/stderr " ``` Based on this I have update the java opts to use `TezLog4jConfigurator` and `tez-container-log4j.properties`. NOTE: 1. `yarn.app.container.log.dir` was added as it is used in `tez-container-log4j.properties`. 2. `tez-container-log4j.properties` exists in tez-dag.jar so no need for explicit log4j2 file. Filed TEZ-4690 for moving to log4j2 in long run. 3. Added console appender in `tez-container-log4j.properties` to simulate same behaviour of logs on console as it was with hadoop tarballl. 4. Added gc parameters but they are creating noise in logs. Hence commented it out. On need basis developer can uncomment and re-build image -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
