[ 
https://issues.apache.org/jira/browse/TEZ-2744?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14735299#comment-14735299
 ] 

Siddharth Seth commented on TEZ-2744:
-------------------------------------

In terms of the history events - they provide a good amount of information 
about which attempt succeeded, which task is completed etc. That allows for 
some of the other messages to be removed, and access to information in the same 
logs. So I think it's better to keep these in the main log file.

For yarn related logs, and hadoop related logs - yes they should be at a 
different level. See previous comment about handling RackResolver. Users need 
to be able to set these to whatever level they want; the custom handling of the 
log level which exists today should provide this.

> Logging cleanup and enhancements
> --------------------------------
>
>                 Key: TEZ-2744
>                 URL: https://issues.apache.org/jira/browse/TEZ-2744
>             Project: Apache Tez
>          Issue Type: Improvement
>    Affects Versions: 0.5.0
>            Reporter: Siddharth Seth
>
> There's far too much logging, some of which is redundant information - which 
> leads to large log files for jobs.
> Also, some logging can be enhanced to include additional context.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to