Another bit of information I found, looking at the ASSP folder, the last time a copy of the HMMdb file has a date/time stamp on it was 10/26/2015. Which is the day I turned the BerkleyDB back on for the spamdb rebuild after mentioning our rebuild would die in the middle of the process. Looking at my revision history on our server I turned the BerkleyDB for rebuild back to ON per Thomas' suggestion after the last date/time stamp of the HMMdb. So there is definitely something really weird here. A copy of the spamdb is in the ASSP folder from the rebuild from this morning but not the HMMdb. Any clue as to why?

On 10/28/2015 10:59 AM, Jay wrote:
Alright this is kind of puzzling to me. We are using ASSP version 2.4.5(15162) and also using MYSQL for our database backend. When I send a request to ASSP for analyzing an email I get a weird response back in the email. I get the Bayesian analysis back just fine, but the HMM is blank. DoBayesian and DoHMM are both set to score in my config. Under the section for Hidden-Markov-Model Spam probabilities the results come back as follows:

*combined HMM spam probability*: got no result because the HMM database is empty
*HMM confidence*:     0.00000000
*corpus confidence*:     1.00000000


Which is really odd, here's the last section of my rebuild from this morning:

Oct-28-15 07:15:58 Spam Weight:       8,312,860
Oct-28-15 07:15:58 Not-Spam Weight:   8,314,034

Oct-28-15 07:15:58 Corpus norm:    0.9999 - (very good - balanced)
Oct-28-15 07:15:58 Corpus confidence:    1.00000000

Oct-28-15 07:16:03 Start populating Hidden Markov Model. HMM-check is disabled for this time! Oct-28-15 07:16:03 start populating Hidden Markov Model with 4,282,658 records! Oct-28-15 07:16:46 Finished populating Hidden Markov Model with 4,282,658 records! Oct-28-15 07:16:46 Finished populating Hidden Markov Model. HMM-check is now enabled again!

We recently switched our rebuild to use the BerkleyDB for rebuilding the spamdb. Here's a snippet from the top of my rebuilddebug.txt file:

Oct-28-15 06:00:00 rebuild debug output is enabled to c:/assp/rebuilddebug.txt
Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB for temporary hashes
Oct-28-15 06:00:00 RebuildSpamDB uses BerkeleyDB-ENV with 50.00 MByte
Oct-28-15 06:00:00 RebuildSpamDB-thread rebuildspamdb-version 7.11 started in ASSP version 2.4.5(15162)
Oct-28-15 06:00:00 RebuildSpamDB will create a Hidden Markov Model

So is there something I am missing here? I seem to remember that before we switched to the BerkleyDB for rebuild the HMM section populated information just fine. Now the report claims the HMMdb is blank. Is there something wrong with the BerkleyDB rebuild?

Here's the version we are using for the BerkleyDB: (Directly from the ASSP email interface)
BerkeleyDB     0.51 / 0.42     enabled
BerkeleyDB_DBEngine     5.3 / 4.5     enabled



------------------------------------------------------------------------------


_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user


-----
No virus found in this message.
Checked by AVG - www.avg.com
Version: 2015.0.6173 / Virus Database: 4455/10903 - Release Date: 10/28/15

------------------------------------------------------------------------------
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user

Reply via email to