As requested. This is last nights...... Steve
-----Original Message----- From: assp@assp.local [mailto:assp@assp.local] Sent: Wednesday, September 12, 2012 12:20 AM To: Steve Moffat Subject: RebuildSpamDB - report from assp.isp.bm File rebuildrun.txt follows: Sep-12-12 00:00:02 RebuildSpamDB-thread rebuildspamdb-version 6.01 started in ASSP version 2.2.2(12255) Sep-12-12 00:00:02 RebuildSpamDB will create a Hidden Markov Model! Sep-12-12 00:00:02 RebuildSpamDB will include attachment-database-entries in to spamdb! Sep-12-12 00:00:02 RebuildSpamDB will create unicode enabled databases. Sep-12-12 00:00:02 RebuildSpamDB process all words as Sequence of UAX #29 Grapheme Clusters. Sep-12-12 00:00:02 RebuildSpamDB will use the ASSP_WordStem engine. Sep-12-12 00:00:02 ---ASSP Settings--- Sep-12-12 00:00:02 Do Not Collect RedRe Messages: Enabled **Messages matching the RedRe will be removed from the corpus!** Sep-12-12 00:00:02 Use Subject as Maillog Names: True Sep-12-12 00:00:02 Maxbytes: 4000 Sep-12-12 00:00:02 RebuildFileTimeLimit: 1 5 Sep-12-12 00:00:02 RebuildFileTimeLimit: files will be moved away from the corpus, if there processing takes longer than 5 second(s) Sep-12-12 00:00:02 C:/assp/errors/spam Sep-12-12 00:00:02 File Count: 318 Sep-12-12 00:00:02 Processing... errors/spam with 318 files Sep-12-12 00:00:02 ignore and remove files older than Dec-16-09 23:00:02 in folder errors/spam Sep-12-12 00:00:11 1 attachment/image entries processed Sep-12-12 00:00:11 Imported Files: 316 Sep-12-12 00:00:11 Finished in 9 second(s) Sep-12-12 00:00:11 C:/assp/errors/notspam Sep-12-12 00:00:11 File Count: 113 Sep-12-12 00:00:11 Processing... errors/notspam with 113 files Sep-12-12 00:00:11 ignore and remove files older than Dec-16-09 23:00:11 in folder errors/notspam Sep-12-12 00:00:25 26 attachment/image entries processed Sep-12-12 00:00:25 Imported Files: 111 Sep-12-12 00:00:25 Finished in 14 second(s) Sep-12-12 00:00:25 info: corpusnorm after processing errors/spam and errors/notspam is spamwords 124138/ hamwords 271248 => 0.457654987317879 Sep-12-12 00:00:26 info: require 7230 files from folder spam to get a fine corpusnorm (1) Sep-12-12 00:00:26 C:/assp/spam Sep-12-12 00:00:26 File Count: 7,230 Sep-12-12 00:00:26 Processing... spam with 7,230 files Sep-12-12 00:03:58 remove C:/assp/spam/Catherine_West_Hidden_in_the_H--172884.eml WhiteList: 'cathw...@logic.bm' Sep-12-12 00:08:18 Removed White: 1 Sep-12-12 00:08:18 707 attachment/image entries processed Sep-12-12 00:08:18 Imported Files: 7,227 Sep-12-12 00:08:18 Finished in 472 second(s) Sep-12-12 00:08:18 info: require 3384 files from folder notspam to get a fine corpusnorm (1) Sep-12-12 00:08:18 C:/assp/notspam Sep-12-12 00:08:18 File Count: 13,161 Sep-12-12 00:08:18 Processing... notspam with 3,384 files Sep-12-12 00:11:29 2,395 attachment/image entries processed Sep-12-12 00:11:29 Imported Files: 3,385 Sep-12-12 00:11:29 Folder contents exceeded 'MaxFiles'(12000). Sep-12-12 00:11:29 Finished in 191 second(s) Sep-12-12 00:11:29 Rebuild processed 12.92 files per second. Sep-12-12 00:11:29 Generating weighted Bayesian tuplets Sep-12-12 00:11:41 start populating Spamdb with 115,501 records - Bayesian check is now disabled! Sep-12-12 00:12:11 Finished populating Spamdb with 115,501 records - Bayesian check is now enabled! Sep-12-12 00:12:11 done - Generating weighted Bayesian tuplets Sep-12-12 00:12:11 Bayesian Pairs: 115,501 now in list Sep-12-12 00:12:11 Generating consolidated Hidden-Markov-Model database from 1,416,031 record model Sep-12-12 00:13:26 HMM sequences: 697,084 now in list Sep-12-12 00:13:26 generating Spamdb.helo records from 4,107 collected HELO's Sep-12-12 00:13:27 cleaning old Spamdb.helo records Sep-12-12 00:13:29 done - cleaning old Spamdb.helo records Sep-12-12 00:13:29 HELO Blacklist: 4 new, 142 now in list Sep-12-12 00:13:29 Spam Weight: 2,442,496 Sep-12-12 00:13:29 Not-Spam Weight: 1,218,995 Sep-12-12 00:13:29 Corpus norm: 2.0037 - (warning: extremely spam heavy) Sep-12-12 00:13:29 Corpus confidence: 0.06204007 Sep-12-12 00:13:29 Recommendation: RebuildSpamDB will limit the number of used messages in your corpus. Excess files will be ingored. Sep-12-12 00:13:29 Corpus norm should be between 0.6 and 1.4 Sep-12-12 00:13:29 Recommendation: You need more not-spam messages in the corpus. Sep-12-12 00:13:29 starting auto correction for corpus - delete old spam files from spam Sep-12-12 00:13:33 info: starting cleanup for to much (old) files in folder C:/assp/spam - will try to remove 40% of the files - will keep at least 4000 files - will keep files younger than 14 days info: deleted 2890 old files from folder C:/assp/spam Sep-12-12 00:13:33 Recommendation: You should increase now MaxBytes to 6000! Sep-12-12 00:13:38 Start populating Hidden Markov Model. HMM-check is disabled for this time! Sep-12-12 00:13:38 start populating Hidden Markov Model with 697,084 records! Sep-12-12 00:19:47 Finished populating Hidden Markov Model with 697,084 records! Sep-12-12 00:19:47 Finished populating Hidden Markov Model. HMM-check is now enabled again! Sep-12-12 00:19:47 Total processing time: 1,185 second(s) Sep-12-12 00:19:47 Total processing data: 369.94 MByte Sep-12-12 00:19:47 building new GripList records and bounce report Sep-12-12 00:19:47 processing Logfile C:/assp/logs/maillog.txt Sep-12-12 00:19:52 skipping bounce report because 'DoNotCollectBounces' is switched ON Sep-12-12 00:19:53 Uploading Griplist via Direct Connection Sep-12-12 00:19:54 Submitted 3,207 bytes: 0 IPv6 addresses, 355 IPv4 addresses Sep-12-12 00:19:54 Trashlist was saved to C:/assp/trashlist.db ------------------------------------------------------------------------------ Live Security Virtual Conference Exclusive live event will cover all the ways today's security and threat landscape has changed and how IT managers can respond. Discussions will include endpoint security, mobile security and the latest in malware threats. http://www.accelacomm.com/jaw/sfrnl04242012/114/50122263/ _______________________________________________ Assp-test mailing list Assp-test@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/assp-test
