[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885389#comment-16885389 ]
Prabhu Joseph commented on YARN-8199: ------------------------------------- Thanks [~adam.antal] for the review. Have addressed 1, 2 & 4 in [^YARN-8199-004.patch] . Regarding 3 - the file path is container log directory which has both appId and containerId. {code} 2019-07-15 16:16:09,490 INFO org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl: Log File /hadoop/yarn/log/application_1559302665385_0012/container_e01_1559302665385_0012_01_000001/syslog size is 105906176 bytes {code} bq. Just out of curiosity: how did you end up with 100Mb as the limit? Have considered 100Mb when debugging a customer case but no strong reason behind this. This will vary for each user. > Logging fileSize of log files under NM Local Dir > ------------------------------------------------ > > Key: YARN-8199 > URL: https://issues.apache.org/jira/browse/YARN-8199 > Project: Hadoop YARN > Issue Type: Improvement > Components: log-aggregation > Affects Versions: 2.7.3 > Reporter: Prabhu Joseph > Assignee: Prabhu Joseph > Priority: Major > Labels: supportability > Attachments: 0001-YARN-8199.patch, 0002-YARN-8199.patch, > YARN-8199-003.patch, YARN-8199-004.patch > > > Logging fileSize of log files like syslog, stderr, stdout under NM Local Dir > by NodeManager before the cleanup will help to find the application which has > written too verbose. -- This message was sent by Atlassian JIRA (v7.6.14#76016) --------------------------------------------------------------------- To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org