Wei-Chiu Chuang created HDDS-4442:
-------------------------------------

             Summary: Disable the location information of audit logger to 
reduce overhead
                 Key: HDDS-4442
                 URL: https://issues.apache.org/jira/browse/HDDS-4442
             Project: Hadoop Distributed Data Store
          Issue Type: Improvement
          Components: OM
    Affects Versions: 1.0.0
            Reporter: Wei-Chiu Chuang


Log4j2 has substantial overhead with the default configuration. We found more 
than 20%~30% OM overhead in a microbenchmark (in which clients sends lookupFile 
calls)  was spent on audit logging, even though we use async audit logger.

Note that while the log4j2 documentation states the location information is 
disabled by default, we found that explicitly disabling location information 
has visible performance improvement.

Solution:
 add {{rootLogger.includeLocation=false}} to OM's audit logger property 
(om-audit-log4j2.properties file)

After this change, the audit logger overhead reduced to 7%

According to LOG4J2-2644, log4j2 2.12.1 and above improved this. So Ozone 1.1 
should be in much better shape. File this Jira for future reference.

Credit: [~adoroszlai] for identifying the solution.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@ozone.apache.org
For additional commands, e-mail: issues-h...@ozone.apache.org

Reply via email to