I need to find a program to scrape log files and send them to a syslog server.

Similar to what logger will do, but I would like to find something that can deal somewhat sanely with multi-line (java) logfiles, trying to combine the multi-line dumps into one log entry. Since this can create very long log messages, it would need to have some way of dealing with them (splitting into multiple smaller messages ideally)

I also have the problem that some of the programs create logfiles that have timestamps in the filename, so I need to tell the program to scrape all logs it finds that match a pattern (and have it find new logs that match that pattern over time)

I worked on writing a perl program to do this, but after doing a bunch of work on it I had it go into a cpu burning loop and so now management wants an 'off the shelf' solution instead of something that I've written :-/

Any suggestions?

logger doesn't handle multi-line messages or wildcarded filenames

rsyslog doesn't handle wildcarded filenames or splitting long messages (it does handle combining the lines, but it will then truncate them to the max log size)

Unfortunantly the engineering team doesn't want to take the 'risk' of reconfiguring the Java logging to send directly to a syslog server so just reconfiguring log4j and equivalent are not an option.

David Lang
_______________________________________________
Tech mailing list
[email protected]
https://lists.lopsa.org/cgi-bin/mailman/listinfo/tech
This list provided by the League of Professional System Administrators
http://lopsa.org/

Reply via email to