Alright never mind I found out why the report comes up with the HMM as
empty. So here's what I found, HMMusesBDB is ON by default. We are using
MYSQL as our DB backend. Looking through the documentation under
Bayesian/HMM options is where I found this option. We have spamdb set to
DB: and DBdriver set to mysql. So this is the case where the default
setting is working against me. I have a suggestion, if you have spamdb
set to DB: and DBdriver is not set to use the BerkleyDB as the driver,
then the setting HMMusesBDB should really be logged somewhere either in
the rebuild log or maillog indicating a conflict. I really think this
would help people out in the future.
Anyways, disregard my previous posts.
On 10/28/2015 11:29 AM, Jay wrote:
Another bit of information I found, looking at the ASSP folder, the
last time a copy of the HMMdb file has a date/time stamp on it was
10/26/2015. Which is the day I turned the BerkleyDB back on for the
spamdb rebuild after mentioning our rebuild would die in the middle of
the process. Looking at my revision history on our server I turned the
BerkleyDB for rebuild back to ON per Thomas' suggestion after the last
date/time stamp of the HMMdb. So there is definitely something really
weird here. A copy of the spamdb is in the ASSP folder from the
rebuild from this morning but not the HMMdb. Any clue as to why?
On 10/28/2015 10:59 AM, Jay wrote:
Alright this is kind of puzzling to me. We are using ASSP version
2.4.5(15162) and also using MYSQL for our database backend. When I
send a request to ASSP for analyzing an email I get a weird response
back in the email. I get the Bayesian analysis back just fine, but
the HMM is blank. DoBayesian and DoHMM are both set to score in my
config. Under the section for Hidden-Markov-Model Spam probabilities
the results come back as follows:
*combined HMM spam probability*: got no result because the HMM
database is empty
*HMM confidence*: 0.00000000
*corpus confidence*: 1.00000000
Which is really odd, here's the last section of my rebuild from this
morning:
Oct-28-15 07:15:58 Spam Weight: 8,312,860
Oct-28-15 07:15:58 Not-Spam Weight: 8,314,034
Oct-28-15 07:15:58 Corpus norm: 0.9999 - (very good - balanced)
Oct-28-15 07:15:58 Corpus confidence: 1.00000000
Oct-28-15 07:16:03 Start populating Hidden Markov Model. HMM-check is
disabled for this time!
Oct-28-15 07:16:03 start populating Hidden Markov Model with
4,282,658 records!
Oct-28-15 07:16:46 Finished populating Hidden Markov Model with
4,282,658 records!
Oct-28-15 07:16:46 Finished populating Hidden Markov Model. HMM-check
is now enabled again!
We recently switched our rebuild to use the BerkleyDB for rebuilding
the spamdb. Here's a snippet from the top of my rebuilddebug.txt file:
Oct-28-15 06:00:00 rebuild debug output is enabled to
c:/assp/rebuilddebug.txt
Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB for temporary hashes
Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB-ENV with 50.00 MByte
Oct-28-15 06:00:00 RebuildSpamDB-thread rebuildspamdb-version 7.11
started in ASSP version 2.4.5(15162)
Oct-28-15 06:00:00 RebuildSpamDB will create a Hidden Markov Model
So is there something I am missing here? I seem to remember that
before we switched to the BerkleyDB for rebuild the HMM section
populated information just fine. Now the report claims the HMMdb is
blank. Is there something wrong with the BerkleyDB rebuild?
Here's the version we are using for the BerkleyDB: (Directly from the
ASSP email interface)
BerkeleyDB 0.51 / 0.42 enabled
BerkeleyDB_DBEngine 5.3 / 4.5 enabled
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4455/10903 - Release Date:
10/28/15
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user
-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4455/10903 - Release Date: 10/28/15
------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user