[ 
https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885389#comment-16885389
 ] 

Prabhu Joseph commented on YARN-8199:
-------------------------------------

Thanks [~adam.antal] for the review. Have addressed 1, 2 & 4 in  
[^YARN-8199-004.patch] .

Regarding 3 - the file path is container log directory which has both appId and 
containerId.

{code}
2019-07-15 16:16:09,490 INFO 
org.apache.hadoop.yarn.server.nodemanager.containermanager.logaggregation.AppLogAggregatorImpl:
 Log File 
/hadoop/yarn/log/application_1559302665385_0012/container_e01_1559302665385_0012_01_000001/syslog
 size is 105906176
 bytes
{code}

bq. Just out of curiosity: how did you end up with 100Mb as the limit?

Have considered 100Mb when debugging a customer case but no strong reason 
behind this. This will vary for each user.

> Logging fileSize of log files under NM Local Dir
> ------------------------------------------------
>
>                 Key: YARN-8199
>                 URL: https://issues.apache.org/jira/browse/YARN-8199
>             Project: Hadoop YARN
>          Issue Type: Improvement
>          Components: log-aggregation
>    Affects Versions: 2.7.3
>            Reporter: Prabhu Joseph
>            Assignee: Prabhu Joseph
>            Priority: Major
>              Labels: supportability
>         Attachments: 0001-YARN-8199.patch, 0002-YARN-8199.patch, 
> YARN-8199-003.patch, YARN-8199-004.patch
>
>
> Logging fileSize of log files like syslog, stderr, stdout under NM Local Dir 
> by NodeManager before the cleanup will help to find the application which has 
> written too verbose.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org

Reply via email to