I appreciate it - I desire an objective approach this challenge! Attached is a fresh impstats file. Appreciate any interpretation advice and tuning actions.
Doug On Mon, Aug 4, 2014 at 1:05 PM, David Lang <[email protected]> wrote: > On Mon, 4 Aug 2014, Doug McClure wrote: > > I've read, re-read and read again everything I can find out there on >> queues, options, etc. and still feel I don't really know what I'm doing >> other than haphazardly changing one or more settings hoping to get more >> data through/out of rsyslog. >> >> I'm growing about one 1GB DA cache file every 10 min or so and I can't >> seem >> to increase the processing to clear them up. I probably clear one for >> every 2-4 new ones that are created. >> >> What's the best setting to focus on to increase DA queue file processing? >> I've taken dequeuebatchsize from as low as 100 or 1000 (which everything >> seems to talk about) to as high as 100,000 or more and I can't seem to hit >> a sweet spot. I have varied threads up to 200. Queue size up to 1G or >> 500M >> or 200K. >> >> What are the rules of thumb here - change X watch Y until you get to some >> ceiling and you need to add more system resources or other upstream? >> > > well, rather than focusing on the DA queue handling, let's try and figure > out what's slow and causing things to queue > > have you configured impstats? configure it to log to a file, and log > fairly frequently and we should be able to see what action is holding > things up. Once we know that we can work to figure out how to solve that > bottlneck. > > David Lang > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > DON'T LIKE THAT. >
rsyslog-stats.log
Description: application/force-download
_______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.

