[
https://issues.apache.org/jira/browse/YARN-11565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
zhengchenyu updated YARN-11565:
-------------------------------
Description:
Since HADOOP-18649, in container-log4j.properties,
log4j.appender.\{APPENDER}.MaxFileSize is set to
${yarn.app.container.log.filesize}, but yarn.app.container.log.filesize is 0 in
default. So log is missing. This log is always rolling and only show the latest
log.
This is the running log like below:
{code:java}
Log Type: syslog
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 0
Log Type: syslog.1
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 1792023-09-08 11:31:34,494 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Got an error when resolve hostNames.
Falling back to /default-rack for all. {code}
Note: log4j.appender.\{APPENDER}.MaxFileSize is not set before, then use
default value 10M, so no problem before HADOOP-18649
was:
Since HADOOP-18649, in container-log4j.properties,
log4j.appender.\{APPENDER}.MaxFileSize is set to
${yarn.app.container.log.filesize}, but yarn.app.container.log.filesize is 0 in
default. So log is missing. This log is always rolling and only show the latest
log.
This is the running log like below:
{code:java}
Log Type: syslog
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 0
Log Type: syslog.1
Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
Log Length: 1792023-09-08 11:31:34,494 INFO [AsyncDispatcher event handler]
org.apache.hadoop.yarn.util.RackResolver: Got an error when resolve hostNames.
Falling back to /default-rack for all. {code}
Why yarn.app.container.log.filesize is 0?
MAPREDUCE-5773 want to retain all log for debug, but not roll the am log. But
since HADOOP-18649, 0 does not means that retain all log.
Note: log4j.appender.\{APPENDER}.MaxFileSize is not set before, then use
default value 10M, so no problem before HADOOP-18649
> Container logs are missing when yarn.app.container.log.filesize is set to
> default value 0.
> ------------------------------------------------------------------------------------------
>
> Key: YARN-11565
> URL: https://issues.apache.org/jira/browse/YARN-11565
> Project: Hadoop YARN
> Issue Type: Improvement
> Affects Versions: 3.3.6
> Reporter: zhengchenyu
> Assignee: zhengchenyu
> Priority: Major
> Labels: pull-request-available
>
> Since HADOOP-18649, in container-log4j.properties,
> log4j.appender.\{APPENDER}.MaxFileSize is set to
> ${yarn.app.container.log.filesize}, but yarn.app.container.log.filesize is 0
> in default. So log is missing. This log is always rolling and only show the
> latest log.
> This is the running log like below:
> {code:java}
> Log Type: syslog
> Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
> Log Length: 0
> Log Type: syslog.1
> Log Upload Time: Fri Sep 08 11:36:09 +0800 2023
> Log Length: 1792023-09-08 11:31:34,494 INFO [AsyncDispatcher event handler]
> org.apache.hadoop.yarn.util.RackResolver: Got an error when resolve
> hostNames. Falling back to /default-rack for all. {code}
> Note: log4j.appender.\{APPENDER}.MaxFileSize is not set before, then use
> default value 10M, so no problem before HADOOP-18649
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
