Caleb Cushing created LOG4J2-2372:
-------------------------------------

             Summary: Deduplication of messages
                 Key: LOG4J2-2372
                 URL: https://issues.apache.org/jira/browse/LOG4J2-2372
             Project: Log4j 2
          Issue Type: Improvement
            Reporter: Caleb Cushing


So I personally think this probably belongs in the burst filter... Sometimes 
components log messages that are are duplicated (they don't always start at the 
same parameter though, for example these from hibernate are different classes 
but the logging is so poor you aren't getting any extra info)


{code:java}
12:19:23,842 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,865 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,870 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,874 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,878 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,908 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,911 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,928 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,938 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,943 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,955 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,958 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,960 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,963 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,966 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,969 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,976 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,979 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,982 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,985 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,987 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,990 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,993 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:23,996 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,024 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,036 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,039 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,042 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,045 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,048 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,061 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,064 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,076 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,081 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,085 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,097 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,112 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,122 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,128 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,133 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,136 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,143 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,149 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:)
12:19:24,157 [WARN ] HHH000069: Duplicate generator name id_seq 
[localhost-startStop-1] 
org.hibernate.boot.internal.InFlightMetadataCollectorImpl.addIdentifierGenerator(InFlightMetadataCollectorImpl.java:454)
 (:){code}
that repeats for a while longer, reality is that only seeing this once is 
useful. I looked at the burst filter, but I realized i don't want to drop 
messages after burst, but rather drop duplicate messages on burst. In addition 
to that I'd like to be able log how many duplicates there were.

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to