Is there any other task at this time (eg. Backup, Virusscan) which eats up memory & performance?
Matti > Ok, ok, I'm an idiot. There, I said it, but I still have questions. > As it turns out, the system rebuilds the database at 00:15, 5:15am, > AND 8:15pm. So now we know where the load is coming from. > There were outages at midnight and 5am consistently too, I just wasn't > getting text alerts overnight for outages < 15 minutes. > So, new question: Any idea what could be causing the rebuild to kill > the server while it processes, and why does my rebuilt seem to take > about 40 minutes each time. > I keep 15,000 files, subject logging on. No databases in use. > Thanks. > Here's a recent log: > Apr-18-10 20:15:01 RebuildSpamDB-thread rebuildspamdb-version 2.20 > started in ASSP version 2.0.2(1.0.02) > Apr-18-10 20:15:01 ---ASSP Settings--- > Apr-18-10 20:15:01 Do Not Collect Messages with RedListed address: Enabled > **Messages with RedListed addresses will be removed from the corpus!** > Apr-18-10 20:15:01 Do Not Collect RedRe Messages: Enabled > **Messages matching the RedRe will be removed from the corpus!** > Apr-18-10 20:15:01 Use Subject as Maillog Names: True > Apr-18-10 20:15:01 Maxbytes: 8000 > Apr-18-10 20:15:01 remove > c:/assp/messages/spam/Happy_Easter--339069.txt TrashlistApr-18-10 > 20:15:01 Trashlist cleaning finished, 1 of 113 files deleted > Apr-18-10 20:15:01 c:/assp/messages/errors-spam > Apr-18-10 20:15:01 File Count: 610 > Apr-18-10 20:15:01 Processing... messages/errors-spam with 610 files > Apr-18-10 20:15:43 Imported Files: 610 > Apr-18-10 20:15:43 Finished in 42 second(s) > Apr-18-10 20:15:43 c:/assp/messages/errors-notspam > Apr-18-10 20:15:44 File Count: 857 > Apr-18-10 20:15:44 Processing... messages/errors-notspam with 857 files > Apr-18-10 20:16:45 Imported Files: 857 > Apr-18-10 20:16:45 Finished in 62 second(s) > Apr-18-10 20:16:45 c:/assp/messages/spam > Apr-18-10 20:16:51 File Count: 15,201 > Apr-18-10 20:16:51 Processing... messages/spam with 15201 files > Apr-18-10 20:24:30 remove c:/assp/messages/spam/New_member--1858.txt > WhiteList: '[email protected]' > Apr-18-10 20:26:03 remove c:/assp/messages/spam/a_side--1848.txt > WhiteList: '[email protected]' > Apr-18-10 20:29:37 Removed White: 2 > Apr-18-10 20:29:37 Imported Files: 15,199 > Apr-18-10 20:29:37 Folder contents exceeded `MaxFiles`(15000). > Apr-18-10 20:29:37 Finished in 772 second(s) > Apr-18-10 20:29:37 c:/assp/messages/notspam > Apr-18-10 20:29:41 File Count: 16,539 > Apr-18-10 20:29:41 Processing... messages/notspam with 16539 files > Apr-18-10 20:49:30 Imported Files: 16,539 > Apr-18-10 20:49:30 Folder contents exceeded `MaxFiles`(15000). > Apr-18-10 20:49:30 Finished in 1193 second(s) > Apr-18-10 20:49:30 Generating weighted Bayesian tuplets > Apr-18-10 20:49:55 done - Generating weighted Bayesian tuplets > Apr-18-10 20:49:55 Resulting file 'c:/assp/spamdb.rb.tmp' is 6,078,796 bytes > Apr-18-10 20:53:35 Bayesian Pairs: 253,820 in new mail, 1,750,470 now in list > Apr-18-10 20:53:41 HELO Blacklist: 0 in new mail, 2272 now in list > Apr-18-10 20:53:41 Spam Weight: 6,248,983 > Apr-18-10 20:53:41 Not-Spam Weight: 8,143,972 > Apr-18-10 20:53:41 Corpus norm: 0.7673 - (ok - slighly ham heavy) > Apr-18-10 20:53:41 Recommendation: RebuildSpamDB will limit the number > of used messages in your corpus. Excess files will be ingored. > Apr-18-10 20:53:41 Total processing time: 2320 second(s) > Apr-18-10 20:53:41 building new GripList records and bounce report > Apr-18-10 20:53:41 processing Logfile c:/assp/logs/maillog.txt > Apr-18-10 20:53:47 processing Logfile c:/assp/logs/Copy of maillog.txt > Apr-18-10 20:53:50 processing Logfile c:/assp/logs/10-04-16.maillog.txt > Apr-18-10 20:53:50 processing Logfile c:/assp/logs/10-04-15.maillog.txt > Apr-18-10 20:53:54 processing Logfile c:/assp/logs/10-04-14.maillog.txt > Apr-18-10 20:53:55 bounce report for the last two days: no bounces received > Apr-18-10 20:53:55 Uploading Griplist via Direct Connection > Apr-18-10 20:53:15 Submitted 7511 bytes: 1952 IPv4 addresses > Apr-18-10 20:53:15 RebuildSpamDB version 2.20 ended > ------------------------------------------------------------------------------ > Download Intel® Parallel Studio Eval > Try the new software tools for yourself. Speed compiling, find bugs > proactively, and fine-tune applications for parallel performance. > See why Intel Parallel Studio got high marks during beta. > http://p.sf.net/sfu/intel-sw-dev > _______________________________________________ > Assp-test mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/assp-test -- Matti Haack - Hit Haack IT Service Gmbh Poltlbauer Weg 4, D-94036 Passau Geschäftsführer: Henry Haack HRB Passau Nr. 5678 +49 851 50477-22 Fax: +49 851 50477-29 http://www.haack-it.de ------------------------------------------------------------------------------ _______________________________________________ Assp-test mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/assp-test
