Ok, ok, I'm an idiot.  There, I said it, but I still have questions.

As it turns out, the system rebuilds the database at 00:15, 5:15am,
AND 8:15pm.  So now we know where the load is coming from.

There were outages at midnight and 5am consistently too, I just wasn't
getting text alerts overnight for outages < 15 minutes.

So, new question: Any idea what could be causing the rebuild to kill
the server while it processes, and why does my rebuilt seem to take
about 40 minutes each time.

I keep 15,000 files, subject logging on.  No databases in use.

Thanks.

Here's a recent log:


Apr-18-10 20:15:01 RebuildSpamDB-thread rebuildspamdb-version 2.20
started in ASSP version 2.0.2(1.0.02)

Apr-18-10 20:15:01 ---ASSP Settings---
Apr-18-10 20:15:01 Do Not Collect Messages with RedListed address: Enabled
**Messages with RedListed addresses will be removed from the corpus!**

Apr-18-10 20:15:01 Do Not Collect RedRe Messages: Enabled
**Messages matching the RedRe will be removed from the corpus!**

Apr-18-10 20:15:01 Use Subject as Maillog Names: True
Apr-18-10 20:15:01 Maxbytes: 8000

Apr-18-10 20:15:01 remove
c:/assp/messages/spam/Happy_Easter--339069.txt TrashlistApr-18-10
20:15:01 Trashlist cleaning finished, 1 of 113 files deleted

Apr-18-10 20:15:01 c:/assp/messages/errors-spam
Apr-18-10 20:15:01 File Count:  610
Apr-18-10 20:15:01 Processing... messages/errors-spam with 610 files
Apr-18-10 20:15:43 Imported Files:      610
Apr-18-10 20:15:43 Finished in 42 second(s)

Apr-18-10 20:15:43 c:/assp/messages/errors-notspam
Apr-18-10 20:15:44 File Count:  857
Apr-18-10 20:15:44 Processing... messages/errors-notspam with 857 files
Apr-18-10 20:16:45 Imported Files:      857
Apr-18-10 20:16:45 Finished in 62 second(s)

Apr-18-10 20:16:45 c:/assp/messages/spam
Apr-18-10 20:16:51 File Count:  15,201
Apr-18-10 20:16:51 Processing... messages/spam with 15201 files
Apr-18-10 20:24:30 remove c:/assp/messages/spam/New_member--1858.txt
WhiteList: '[email protected]'
Apr-18-10 20:26:03 remove c:/assp/messages/spam/a_side--1848.txt
WhiteList: '[email protected]'
Apr-18-10 20:29:37 Removed White:       2
Apr-18-10 20:29:37 Imported Files:      15,199
Apr-18-10 20:29:37 Folder contents exceeded `MaxFiles`(15000).
Apr-18-10 20:29:37 Finished in 772 second(s)

Apr-18-10 20:29:37 c:/assp/messages/notspam
Apr-18-10 20:29:41 File Count:  16,539
Apr-18-10 20:29:41 Processing... messages/notspam with 16539 files
Apr-18-10 20:49:30 Imported Files:      16,539
Apr-18-10 20:49:30 Folder contents exceeded `MaxFiles`(15000).
Apr-18-10 20:49:30 Finished in 1193 second(s)

Apr-18-10 20:49:30 Generating weighted Bayesian tuplets
Apr-18-10 20:49:55 done - Generating weighted Bayesian tuplets

Apr-18-10 20:49:55 Resulting file 'c:/assp/spamdb.rb.tmp' is 6,078,796 bytes
Apr-18-10 20:53:35 Bayesian Pairs: 253,820 in new mail, 1,750,470 now in list

Apr-18-10 20:53:41 HELO Blacklist: 0 in new mail, 2272 now in list

Apr-18-10 20:53:41 Spam Weight:    6,248,983
Apr-18-10 20:53:41 Not-Spam Weight:   8,143,972

Apr-18-10 20:53:41 Corpus norm: 0.7673 - (ok - slighly ham heavy)
Apr-18-10 20:53:41 Recommendation: RebuildSpamDB will limit the number
of used messages in your corpus. Excess files will be ingored.

Apr-18-10 20:53:41 Total processing time: 2320 second(s)

Apr-18-10 20:53:41 building new GripList records and bounce report
Apr-18-10 20:53:41 processing Logfile c:/assp/logs/maillog.txt
Apr-18-10 20:53:47 processing Logfile c:/assp/logs/Copy of maillog.txt
Apr-18-10 20:53:50 processing Logfile c:/assp/logs/10-04-16.maillog.txt
Apr-18-10 20:53:50 processing Logfile c:/assp/logs/10-04-15.maillog.txt
Apr-18-10 20:53:54 processing Logfile c:/assp/logs/10-04-14.maillog.txt

Apr-18-10 20:53:55 bounce report for the last two days: no bounces received

Apr-18-10 20:53:55 Uploading Griplist via Direct Connection
Apr-18-10 20:53:15 Submitted 7511 bytes: 1952 IPv4 addresses

Apr-18-10 20:53:15 RebuildSpamDB version 2.20 ended

------------------------------------------------------------------------------
Download Intel&#174; Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test

Reply via email to