On Mon, 4 Aug 2014, Doug McClure wrote:
I've read, re-read and read again everything I can find out there on
queues, options, etc. and still feel I don't really know what I'm doing
other than haphazardly changing one or more settings hoping to get more
data through/out of rsyslog.
I'm growing about one 1GB DA cache file every 10 min or so and I can't seem
to increase the processing to clear them up. I probably clear one for
every 2-4 new ones that are created.
What's the best setting to focus on to increase DA queue file processing?
I've taken dequeuebatchsize from as low as 100 or 1000 (which everything
seems to talk about) to as high as 100,000 or more and I can't seem to hit
a sweet spot. I have varied threads up to 200. Queue size up to 1G or 500M
or 200K.
What are the rules of thumb here - change X watch Y until you get to some
ceiling and you need to add more system resources or other upstream?
well, rather than focusing on the DA queue handling, let's try and figure out
what's slow and causing things to queue
have you configured impstats? configure it to log to a file, and log fairly
frequently and we should be able to see what action is holding things up. Once
we know that we can work to figure out how to solve that bottlneck.
David Lang
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE
THAT.
