sounds good, I will download and try it. Robert
On Wed, Oct 16, 2013 at 4:26 PM, David Lang <[email protected]> wrote: > Robert, since 7.5.5 added the ability for imudp to use multiple threads, > could you please give it a try with 2 threads on the input? > > I expect that you will see rsyslog receiving all 395K messages each second > with this change. > > Then we can go back to tuning the output and applying your filters. > > David Lang > > On Thu, 10 Oct 2013, David Lang wrote: > >> Date: Thu, 10 Oct 2013 13:25:01 -0700 (PDT) >> From: David Lang <[email protected]> >> Reply-To: rsyslog-users <[email protected]> >> To: Robert <[email protected]> >> Cc: rsyslog-users <[email protected]> >> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd) >> >> Ok, this looks like it's giving good information >> One more test I would like to try is to comment out the action, so there >> is no output, only the input and pstats. >> >> Also, do you have a different mail client you can use? the one you are >> using has two problems >> >> 1. every time you reply to a message it starts a new thread (it's not >> maintaining the right headers) >> >> 2. when you reply to a message, your mail client eliminates all formatting >> of the message, putting it all in one big lump of text >> >> This makes it very hard to help you. >> >> David Lang >> >> On Thu, 10 Oct 2013, Robert wrote: >> >>> Date: Thu, 10 Oct 2013 15:40:06 -0400 >>> From: Robert <[email protected]> >>> To: David Lang <[email protected]> >>> Cc: rsyslog-users <[email protected]>, rmkml <[email protected]> >>> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd) >>> >>> David, >>> >>> Attached are the results when resetCounters are enabled: >>> >>> >>> module(load="imuxsock") # needs to be done just once Roberto 8-9-13 >>> module(load="imklog") >>> module(load="impstats" >>> interval="10" >>> log.syslog="off" >>> log.file="/var/log/pstats" >>> resetCounters="on") >>> ----- Original Message ----- >>> From: David Lang >>> Sent: 10/10/13 12:55 PM >>> To: Rainer Gerhards >>> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd) >>> >>> Ok, let's do one test to check for overhead of resetcounters and then use >>> them, it makes it much easier for me to see what's going on. David Lang On >>> Thu, 10 Oct 2013, Rainer Gerhards wrote: > David, > > FYI: the delta stats >>> summed up. It was me mis-reading the values -- > actually I got the size >>> wrong by one magnitude ;) > > Rainer > > > On Thu, Oct 10, 2013 at 6:14 PM, >>> David Lang <[email protected]> wrote: > >> by the way, the following command >>> line may help you see what's happeing >> (with relative stats) >> >> grep >>> imudp pstats |grep -v "=0" >> >> grep imudp pstats |grep -v "=0" >> >> Also, >>> when we are writing out to /dev/null, let's make a run with ziplevel >> and >>> asyncwrite removed (since they only benefit us by saving I/O and moving >> >>> it to a different thread) >> >> >> David Lang >> >> On Thu, 10 Oct 2013, >>> Robert wrote: >> >> Date: Thu, 10 Oct 2013 09:46:38 -0400 >>> From: Robert >>> <[email protected]> >>> To: Rainer Gerhards <[email protected]> >>> Cc: >>> David Lang <dav! >> >> [email protected]>, rsyslog-users <[email protected] >>>> , >>> rmkml >> <[email protected]> >>> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking >> (fwd) >>> >>> These are the results with 1000 for both timeREquery and >> batchsize, >>> writing out to /dev/null >>> >>> ----- Original Message ----- >>>>> >>>>> From: Rainer Gerhards >>> Sent: 10/10/13 08:48 AM >>> To: Robert >>> >> >> Subject: Re: [rsyslog] Tr : Re: perfomance tweaking (fwd) >>> >>> umm.. >> again the ML thread is broken :-( >>> >>> On Thu, Oct 10, 2013 at 2:43 PM, >> Robert < [email protected] > wrote:From >>> the documentation does that mean >> that I should lessen my timeRequery and >>> batchSize? to something lower ? >> >>> >>> A relatively large batch size is a good thing. I would be >> conservative >>> with timeRequery in a large batch environment. As I wrote >> in the doc, I'd >>> recommend not to go higer than 10. >>> >>> Rainer >>> >> >>> Robert. >>> >>> >>> >>>>> >>>>> >>> >>> Robert. >>> >> > >>> >>> >>> >>> >>> >>> Robert. > > > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T > LIKE THAT. > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T > LIKE THAT. _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
