Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
ot; queue.saveonshutdown="on" >> >> >> >> >>> >> > > queue.type="linkedlist" >> >> >> >> >>> >> > > resumeretrycount="-1" queue.dequeueslowdown="1000") >> >> &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
hermes rsyslogd[2539]: >> >> >> >> > rsyslogd[internal_messages]: 1779 messages lost due to >> >> >> >> > rate-limiting (500 allowed within 5 seconds) >> >> >> >> > 2022-12-13T02:23:56.001273-06:00 hermes rsyslogd[2539]: >>

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread helices via rsyslog
see overnight if that does the trick. > >> >> >> >> > >> >> >> >> > >> >> >> >> # date; grep -v "^\(#\|\s*$\)" /etc/rsyslog.conf ;date > >> >> >> >&g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-14 Thread Rainer Gerhards via rsyslog
nf ;date >> >> >> >> Mon Dec 12 13:56:12 CST 2022 >> >> >> >> module(load="imjournal" Ratelimit.Burst="3" >> >> >> >> Ratelimit.Interval="1000" StateFile="imjournal.state") &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
t;> >> >>> >> > > you would do > >> >> >>> >> > > > >> >> >>> >> > > action(type="omfwd" target="10.0.0.1" port="514" > protocol="tcp") > >> >> >>> &

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
/var/log/secure >> >> >> cron.* /var/log/cron >> >> >> *.emerg :omusrmsg:* >> >> >> ftp.* /var/log/vsftpd.log >&

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
on # Save messages to disk on shutdown > >> >> $ActionQueueType LinkedList # Use asynchronous processing > >> >> $ActionResumeRetryCount -1# Infinite retries on insert > failure > >> >> ftp.* > :ommysql:10.199.5.177,vsftpl

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
t; >> $ActionQueueSaveOnShutdown on # Save messages to disk on shutdown >> >> $ActionQueueType LinkedList# Use asynchronous processing >> >> $ActionResumeRetryCount -1 # Infinite retries on insert failure >> >> authpriv.*

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
e retries on insert failure > >> authpriv.* > :ommysql:10.199.5.177,sftplogDB,hermesvsftplog,_ > >> $ActionName Admin > >> $ActionQueueFileName ZenossQueue # Set file name, also enables disk > mode > >> $ActionQueueSaveOnShutdown on # Save mes

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread Rainer Gerhards via rsyslog
disk on shutdown >> $ActionQueueType LinkedList # Use asynchronous processing >> $ActionResumeRetryCount -1 # Infinite retries on insert failure >> *.* @@10.199.1.160 >> Mon Dec 12 13:56:12 CST 2022 >> >> On Mon, Dec

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-13 Thread helices via rsyslog
seful info >> >> > > >> >> > > > [4] How to modify imjournal rate limits? >> >> > > >> >> > > see >> >> > > >> >> >> https://www.rsyslog.com/doc/v8-stable/configuration/modules/imjournal.h

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
hronous processing > > $ActionResumeRetryCount -1# Infinite retries on insert failure > > *.* @@10.199.1.160 > > Mon Dec 12 13:56:12 CST 2022 > > > > On Mon, Dec 12, 2022 at 1:34 PM David Lang wrote: > > > >> did you do

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
ind that I always need to drastically increase the limits. writing logs using the RSYSLOG_DebugFormat is adding the template to the file ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add template="RSYSLOG_DebugFormat" to that action() format) the debug format is large,

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
; >> > > > >> > > as I said below > >> > > > >> > > >> ftp.* /var/log/ftp;RSYSLOG_DebugFormat (legacy format, add > >> > > template="RSYSLOG_DebugFormat" to that action() format) > >> > > > >&g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread David Lang via rsyslog
rsyslog To: Rainer Gerhards Cc: helices , rsyslog-users Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently We're still missing something: module(load="imjournal" Ratelimit.Burst="3" Ratelimit.Interval="1000" StateFile="imjournal.s

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-12 Thread helices via rsyslog
gt; > > > > > feel free to keep asking questions. > > > > > > David Lang > > > > > > > > > > ~ Mike > > > > > > > > > > > > > > > > On Thu, Dec 1, 2022 at 1:33 PM David Lang wrote: >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread Rainer Gerhards via rsyslog
nName Sftp > > >>> $ActionQueueDequeueSlowdown 1000 # How long (in microseconds) > > >> dequeueing > > >>> should be delayed > > >>> $ActionQueueFileName dbSftpQueue # Set file name, also enables disk > > >> mode > > >

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-09 Thread helices via rsyslog
vid Lang wrote: >> > >> >> it would be useful to convert to the action() syntax as it makes it >> >> clearer >> >> what's happening. >> >> >> >> Why are you pausing between writing logs? (this could be why you are >> >> dropping >> >&g

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-06 Thread helices via rsyslog
processed, etc. > >> > >> imjournal defaults to some fairly aggressive rate limiting, I find that > I > >> always > >> need to drastically increase the limits. > >> > >> writing logs using the RSYSLOG_DebugFormat is adding the template to

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
sing so many messages? ~ Mike On Thu, Dec 1, 2022 at 1:05 PM David Lang wrote: please post your full config. It would also help to log the message with the template RSYSLOG_DebugFormat to a file and find the log entry that is failing to insert. my guess is that the quotes in the message are confusi

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
ncommon. How > > can we avoid losing so many messages? > > > > ~ Mike > > > > > > On Thu, Dec 1, 2022 at 1:05 PM David Lang wrote: > > > >> please post your full config. > >> > >> It would also help to log the message with the

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
ec 2022 13:26:47 -0600 From: helices To: David Lang Cc: helices via rsyslog Subject: Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently Thank you. [1] rsyslog.conf # date; grep -v "^\(#\|\s*$\)" /etc/rsyslog.conf ;date Thu Dec 1 13:19:34 CST 2022 module(load=&

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
; David Lang > > On Thu, 1 Dec 2022, helices via rsyslog wrote: > > > Date: Thu, 1 Dec 2022 10:08:01 -0600 > > From: helices via rsyslog > > To: rsyslog-users > > Cc: helices > > Subject: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittent

Re: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread David Lang via rsyslog
are trying to process them too fast. David Lang On Thu, 1 Dec 2022, helices via rsyslog wrote: Date: Thu, 1 Dec 2022 10:08:01 -0600 From: helices via rsyslog To: rsyslog-users Cc: helices Subject: [rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently # date; /bin/yum list rsyslog

[rsyslog] Rsyslogd/ommysql.so: Not writing to DB intermittently

2022-12-01 Thread helices via rsyslog
# date; /bin/yum list rsyslog rsyslog-mysql ;date Thu Dec 1 09:47:18 CST 2022 Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: download.cf.centos.org * epel: mirror.genesisadaptive.com * extras: download.cf.centos.org * remi-php56: mirror.pit.teraswitch.com *