On Wed, 25 Apr 2018, sophie.loewenthal--- via rsyslog wrote:

From a rsyslog view what sort of acknowledgement should it receive to know the 
destination servers are filling up?  The destinations run Logstash.

when you are delivering messages via TCP (as you are in this case), your only indication is that the TCP buffers fill up, and the output then gets suspended. But if all your logs run through the same flow, the logs showing that the output is suspended are stuck behind the messages waiting to be delivered :-/


what I do is to define impstats to use a different ruleset (with it's own queue, so it doesn't get stuck in the main queue)

something like:


module(load="impstats" interval="60" format="json" ruleset="high-p")
ruleset(name="high-p" queue.type="array" queue.size="1000" queue.fileiname="high-p" 
queue.saveonshutdown="on" ){
    action(name="high-p-parse" type="mmnormalize" 
rule=["version=2","rule=stats:%.:json%","rule=stats:%-:whitespace%%.:json%"])
    @destination;format
    /var/log/pstats
}

This will process your stats data to a file and (if not too busy) a remote system so that you can then alert on queues filling up
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of 
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE 
THAT.

Reply via email to