https://bz.apache.org/bugzilla/show_bug.cgi?id=69264

--- Comment #2 from Guido Jäkel <[email protected]> ---
Additional information:

To make it usable for us, the output of the forensic logger is piped though a
(pyhton) script that prepends a timestamp to every line:

    ForensicLog     "|/bin/sh -c \"/opt/apache/bin/timestamp-forensic |
/usr/sbin/rotatelogs2 -l /usr/lib/apache2/logs/forensic.log.%Y%m%d 86400\""

In core, this script will just prepend every line with the current timestamp
and the delimiter '|':

    [...]
    timestamp = f'{now:%Y%m%d-%H%M%S.%f}' # YYYYmmdd-HHMMSS.mmmuuu
    line = timestamp + '|' + line
    [...]


Therefore, all example logs will contain this timestamp. Please notice, that
this timestamp *is* recorded in the logfile. This means IMHO, that the piped
input to the script -- i.e. the output of mod_log_forensic -- is broken in the
described matter.

Example:

Because of the size of the forensic log, I used a pre-sliced part (one second,
selected by timestamp) for the following:

root@prodchi0 ~ # cat forensic.log.20240814-003715.log | grep '^.\{22\}|[+-].*'
-v | while read line; do printf "%4d  %s\n\n" "$(echo -n "${line:23}" | wc -c)"
"$line"; done
4095 
20240814-003715.504800|%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044G%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E013D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E021A%25239%253E033%255BAD%255D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E02%255B89%255DA%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E02%25288C%257C9F%2529%2528%252F09%2529?%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E033%255BAD%255D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E039B%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039E%25239%253E021A%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044G%25239&l=044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044P%2528%252F0%255B1-9%255D%2529?%25239%253E%2528029%257C030%257C065%2529R%25239&l=045P%25239&l=07%255B01%255D%255BBDNP%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239
HTTP/1.1|Host:etc.dnb.de|Connection:Keep-Alive|User-Agent:Apache-HttpClient/4.5.13
(Java/17.0.12)

 821 
20240814-003715.504989|89%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044G%25239&l=044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044P%2528%252F0%255B1-9%255D%2529?%25239%253E%2528029%257C030%257C065%2529R%25239&l=045P%25239&l=07%255B01%255D%255BBDNP%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239
HTTP/1.1|Host:etc.dnb.de|Connection:Keep-Alive|User-Agent:Apache-HttpClient/4.5.13
(Java/17.0.12)

4095 
20240814-003715.505030|%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044G%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E021A%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E013D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E021A%25239%253E033%255BAD%255D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E02%255B89%255DA%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E02%25288C%257C9F%2529%2528%252F09%2529?%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E033%255BAD%255D%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E039B%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039%255BBCDHISTUXYZ%255D%25239%253E039B%25239%253E044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=039E%25239%253E021A%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=041A%2528%252F%255B0-9%255D%255B0-5%255D%2529?%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044G%25239&l=044%255BHK%255D%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044%255BHK%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529R%25239%253E%252802%255B289%255D%257C030%257C041%257C065%2529P%25239&l=044P%2528%252F0%255B1-9%255D%2529?%25239%253E%2528029%257C030%257C065%2529R%25239&l=045P%25239&l=07%255B01%255D%255BBDNP%255D%25239%253E%252802%255B89%255D%257C030%257C065%2529R%25239
HTTP/1.1|Host:etc.dnb.de|Connection:Keep-Alive|User-Agent:Apache-HttpClient/4.5.13
(Java/17.0.12)


Occurrences are searched by

root@prodchi0 ~ # bzcat ~apache/logs/forensic.log.20240814.prodchi0.bz2 | grep
'^.\{22\}|[+-]' -v -o

-- 
You are receiving this mail because:
You are the assignee for the bug.
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to