I appreciate it - I desire an objective approach this challenge!

Attached is a fresh impstats file.  Appreciate any interpretation advice
and tuning actions.

Doug


On Mon, Aug 4, 2014 at 1:05 PM, David Lang <[email protected]> wrote:

> On Mon, 4 Aug 2014, Doug McClure wrote:
>
>  I've read, re-read and read again everything I can find out there on
>> queues, options, etc. and still feel I don't really know what I'm doing
>> other than haphazardly changing one or more settings hoping to get more
>> data through/out of rsyslog.
>>
>> I'm growing about one 1GB DA cache file every 10 min or so and I can't
>> seem
>> to increase the processing to clear them up.  I probably clear one for
>> every 2-4 new ones that are created.
>>
>> What's the best setting to focus on to increase DA queue file processing?
>> I've taken dequeuebatchsize from as low as 100 or 1000 (which everything
>> seems to talk about) to as high as 100,000 or more and I can't seem to hit
>> a sweet spot.  I have varied threads up to 200. Queue size up to 1G or
>> 500M
>> or 200K.
>>
>> What are the rules of thumb here - change X watch Y until you get to some
>> ceiling and you need to add more system resources or other upstream?
>>
>
> well, rather than focusing on the DA queue handling, let's try and figure
> out what's slow and causing things to queue
>
> have you configured impstats? configure it to log to a file, and log
> fairly frequently and we should be able to see what action is holding
> things up. Once we know that we can work to figure out how to solve that
> bottlneck.
>
> David Lang
> _______________________________________________
> rsyslog mailing list
> http://lists.adiscon.net/mailman/listinfo/rsyslog
> http://www.rsyslog.com/professional-services/
> What's up with rsyslog? Follow https://twitter.com/rgerhards
> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad
> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you
> DON'T LIKE THAT.
>

Attachment: rsyslog-stats.log
Description: application/force-download

_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com/professional-services/
What's up with rsyslog? Follow https://twitter.com/rgerhards
NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of 
sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE 
THAT.

Reply via email to