forgot my speed results
Sep-13-12 04:15:43 Generating weighted Bayesian tuplets
Sep-13-12 04:15:59 start populating Spamdb with 172,557 records - Bayesian
check is now disabled!
Sep-13-12 04:16:43 Finished populating Spamdb with 172,557 records -
Bayesian check is now enabled!
44 seconds for 1
Hi all,
fixed in assp 2.2.2 build 12257:
- The rebuild task has possibly tried to correct the corpus by deleting
files, even this was not required or
useless
Thomas
DISCLAIMER:
***
This email and any files transmitted with it may be confid
>SELECT COUNT(*) FROM hmmdb takes 22 seconds.
Looks like you don't use INNODB for the tables or your INNODB cache is too
small.
hmm use 100MB and apmdb 15MB on my system
the relevant settings for mysql and INNODB are
max_allowed_packet=128M
net_buffer_length=32M
sql-mode=STRICT_ALL_TABLES,STR
Thanks for the tips, I have turned on the slow query logging and it only
shows two queries. DELETE FROM hmmdb takes just under two minutes and
SELECT COUNT(*) FROM hmmdb takes 22 seconds.
Nothing else is logged.
I'll investigate mysqltuner further tomorrow - it thinks that mysql is
requiring 1
2012-09-12 22:57:41 generating Spamdb.helo records from 7,207 collected HELO's
2012-09-12 22:57:59 cleaning old Spamdb.helo records
2012-09-12 22:57:59 done - cleaning old Spamdb.helo records
2012-09-12 22:57:59 HELO Blacklist: 1 new, 427 now in list
I can't see any issues with HELO records/black
On 9/12/2012 12:15 PM, Colin wrote:
> I'm not sure there is a need to go to old backups.
>
> Run the steps that were suggested:
>
> Upgrade
> Enable Test Mode
> Run rebuildspamdb
> Disable Test Mdoe
> Rerun rebuildspamdb
>
> I have done this and am now getting:
>
> 2012-09-12 20:09:44 Corpus norm:
Here's some generic mysql tuning info:
Turn on logging of slow queries and figure out which queries are taking
a while. Run them through an analyzer to see if any indexes are
missing. mysqltuner and mysqlfragfinder are two scripts you can run to
help tune the database.
(If I am telling you
I think this came up a long time ago, but the "populating Hidden Markov
Model" part of rebuildspamdb takes a very long time on my system (over
an hour).
This time I have been keeping an eye on it and I have no idea why.
For the majority of that hour, there is no CPU activity, no network
activi
I'm not sure there is a need to go to old backups.
Run the steps that were suggested:
Upgrade
Enable Test Mode
Run rebuildspamdb
Disable Test Mdoe
Rerun rebuildspamdb
I have done this and am now getting:
2012-09-12 20:09:44 Corpus norm: 1. - (very good - balanced)
2012-09-12 20:09:44 Corpus
I have a vm from last month. I'll just restore it that way.
Steve Moffat
Operations Director
Optimum IT Solutions
Tel 441-292-8849
On Sep 12, 2012, at 2:50 PM, "Hill, Brett" wrote:
> I learned that a long time ago when my corpus was massacred due to some bad
> code in rebuildspamdb. Been bac
After upgrading I turned on test mode and ran a rebuild which produced
the following so back to normal.
2012-09-12 18:53:19 Corpus norm:0.9942 - (very good - balanced)
2012-09-12 18:53:19 Corpus confidence: 1.
2012-09-12 18:53:19 Recommendation: RebuildSpamDB will limit the numbe
I learned that a long time ago when my corpus was massacred due to some bad
code in rebuildspamdb. Been backing up ever since. I've just got a batch file
that backs it up into .7z and keeps a rolling history.
> -Original Message-
> From: Steve Moffat [mailto:st...@optimum.bm]
> Sent: W
- restore the corpus
- remove the file 'normfile'
- set 'RebuildTestMode' to on
- run a rebuild
- run a rebuild
Thomas
Von:Steve Moffat
An: "'assp-test@lists.sourceforge.net'"
,
Datum: 12.09.2012 18:51
Betreff:[Assp-test] FW: RebuildSpamDB - report from assp.isp.bm
Hi, J
>Sep-12-12 13:18:40 warning: missing information for automatic corpus
correction in file C:/assp/normfile - rerun the rebuild, if you see this
warning the first time!
changelog:
...
- The automatic corpus correction in the rebuildspamdb task was not
working as expected in every case.
There
Nope. 😄 but I will be from now on.
Steve Moffat
Operations Director
Optimum IT Solutions
Tel 441-292-8849
On Sep 12, 2012, at 1:56 PM, "Hill, Brett" wrote:
> Hopefully you keep backups of your corpse to restore it back to near
> perfect...
>
>> -Original Message-
>> From: Steve Moffat
Hopefully you keep backups of your corpse to restore it back to near
perfect...
> -Original Message-
> From: Steve Moffat [mailto:st...@optimum.bm]
> Sent: Wednesday, September 12, 2012 12:51 PM
> To: 'assp-test@lists.sourceforge.net'
> Subject: [Assp-test] FW: RebuildSpamDB - report from
Hi, Just ran rebuildspamdb with the new release. The results are even
worse.before this I had a perfect corpus
Steve
-Original Message-
From: assp@assp.local [mailto:assp@assp.local]
Sent: Wednesday, September 12, 2012 1:50 PM
To: Steve Moffat
Subject: RebuildSpamDB - report fro
Hi all,
fixed in assp 2.2.2 build 12256:
- The automatic corpus correction in the rebuildspamdb task was not
working as expected in every case.
There is one rebuild task required to enable this feature in future.
You may use the 'RebuildTestMode' to speed up this single task.
added:
'Reb
ASSP development mailing list schrei
bt:
>is it a good/bad idea to show in ASSP log the From: value in case of t
>he envelope sender is not specified/empty ?
empty means bounce
--
Live Security Virtual Conference
Exclus
Here's mine:
Sep-12-12 01:57:25 RebuildSpamDB-thread rebuildspamdb-version 6.01
started in ASSP version 2.2.2(12255)
Sep-12-12 01:57:25 RebuildSpamDB will create a Hidden Markov Model!
Sep-12-12 01:57:25 RebuildSpamDB will create unicode enabled databases.
Sep-12-12 01:57:25 RebuildSpamDB pr
I'm seeing the same behavior.
Before:
Sep-11-12 06:29:32 Corpus norm: 0.7039 - (ok - slighly ham heavy)
Sep-11-12 06:29:32 Corpus confidence: 0.59527529
After new version installed:
Sep-11-12 18:29:13 Corpus norm: 0.4919 - (warning: extremely ham heavy)
Sep-11-12 18:29:13 Corpus confidence: 0.1
As requested. This is last nights..
Steve
-Original Message-
From: assp@assp.local [mailto:assp@assp.local]
Sent: Wednesday, September 12, 2012 12:20 AM
To: Steve Moffat
Subject: RebuildSpamDB - report from assp.isp.bm
File rebuildrun.txt follows:
Sep-12-12 00:00:02 RebuildSpamDB
Apologies,
I had the right bits copy/pasted into a notepad window but for some
reason ended up with only half of it in the message. Full log below
minus any lines containing filenames with subjects in them. Both my spam
and notspam folders currently have just short of 15,000 messages in them.
Same to you Colin,
to verify how the new code is working I need at least all the output about
all the folders and the the resulting corpusnorm.
Thomas
Von:Colin
An: assp-test@lists.sourceforge.net,
Datum: 12.09.2012 10:28
Betreff:Re: [Assp-test] New version
I am seeing
I am seeing the same although not quite as bad. It seems to be related
to the notspam folder and less than half of the files in it being
processed.
Yesterday I had:
2012-09-10 23:15:39 Corpus norm:0.9749 - (very good - balanced)
2012-09-10 23:15:39 Corpus confidence: 1.
Now I
indeed X-Assp-Envelope-From: is empty
is it a good/bad idea to show in ASSP log the From: value in case of the
envelope sender is not specified/empty ?
Graziano
> ASSP development mailing list schrei
> bt:
>> From: "Email Marketing"
>
>
> ASSP shows the envelope sender in the logfile not the
Steve, please post the complete rebuild log.
Thomas
Von:Steve Moffat
An: "'assp-test@lists.sourceforge.net'"
,
Datum: 11.09.2012 21:50
Betreff:[Assp-test] New version
Hi
I updated to the new release today and rebuildspamdb has ruined my corpus
confidence. Not too happy w
27 matches
Mail list logo
