>Okt-29-13 23:39:36 [Worker_10000] Backup: 3948 records of database 
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb

3948 records for HMMdb is simply much too less to get good HMM-results.

Oct-31-13 04:00:11 Maxbytes: 8000 

Oct-31-13 04:00:11 C:/assp/errors/spam
Oct-31-13 04:00:11 File Count:           1,765

Oct-31-13 04:06:20 C:/assp/errors/notspam
Oct-31-13 04:06:20 File Count:           847

Oct-31-13 04:09:15 C:/assp/spam
Oct-31-13 04:09:15 File Count:           1,959

Oct-31-13 04:13:21 C:/assp/notspam
Oct-31-13 04:13:21 File Count:           583

Oct-31-13 04:15:13 start populating Spamdb with 259,569 records - Bayesian 
check is now disabled!
Oct-31-13 04:15:49 Finished populating Spamdb with 259,569 records - 
Bayesian check is now enabled!

Oct-31-13 04:15:50 Generating consolidated Hidden-Markov-Model database 
from 1,748,314 record model
Oct-31-13 04:17:48 HMM sequences: 859,419 now in list

You need more files in the corpus.

Thomas.




Von:    Michael <[email protected]>
An:     assp-test <[email protected]>, 
Datum:  30.10.2013 12:26
Betreff:        [Assp-test] HMMdb not working after backup



Hello @all,

I have noticed since several versions of ASSP that my HMMdb gave no 
results AFTER a database backup and it is reproducable after a 
logfile-check (see example below).
In addition to that my whitelist is always empty if I use DB. After 
changing to file it works again as expected.
Rebuildspam does not show any errors. tmpDB is a directory on RAM-disk 
with 5 GB of space, current usage: 501 MB. All rights are set to 777
Does anybody have similar problems or tips where to start searching?

Thanks you in advance!

Michael

My config for HMM and DB:
DoBayesian:=1
DoHMM:=1
ignoreDBVersionMissMatch:=0
HMMusesBDB:=
DoPrivatSpamdb:=0
BayesMaxProcessTime:=15
BayesWL:=
BayesNP:=
noBayesian:=
noBayesian_local:=
Bayesian_localOnly:=
maxBayesValues:=60
baysProbability:=0.6
baysConf:=0
baysConfidenceHalfScore:=1
NoTagInTestmode:=
AddSpamProbHeader:=1
AddConfidenceHeader:=1

DBdriver:=BerkeleyDB

importDBDir:=mysql/dbbackup
preventBulkImport:=
fillUpImportDBDir:=
ImportMysqlDB:=
exportDBDir:=mysql/dbexport
ExportMysqlDB:=
backupDBDir:=mysql/dbbackup
backupDBInterval:=2

RebuildSchedule:=0 6 * * *
useDB4Rebuild:=1
ReplaceOldSpamdb:=
doMove2Num:=
newReportedInterval:=10 5
MaxKeepDeleted:=7
autoCorrectCorpus:=0.6-1.4-4000-14
RebuildFileTimeLimit:=1 5
RebuildNotify:[email protected]
RebuildTestMode:=




Okt-29-13 19:59:00 [Main_Thread] MainThread started
Okt-29-13 19:59:00 [Main_Thread] Admin connection from user root on 
host 192.169.210.6:47382; page:/analyze; 
session-ID:c76031876186ed5f6464f72cb3e1a1c0;
Okt-29-13 19:59:01 [Main_Thread] Info: HMM-Check has taken 0 seconds 
and has given 423 results
Okt-29-13 19:59:01 [Main_Thread] HMM Check  - Prob: 1.00000 => spam


Okt-29-13 20:40:08 [Main_Thread] Info: HMM-Check has taken 0 seconds 
and has given 268 results
Okt-29-13 20:40:08 [Main_Thread] HMM Check  - Prob: 1.00000 => spam


Okt-29-13 21:39:18 [Worker_10000] Backup: starting backup database 
table PersBlack to file /usr/share/assp/mysql/dbbackup/persblack
...
Okt-29-13 21:39:26 [Worker_10000] Backup: starting backup database 
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
Okt-29-13 21:39:26 [Worker_10000] Backup: 3948 records of database 
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb


Okt-29-13 21:45:34 id-79533-02470 [Worker_1] 212.227.17.22 
<[email protected]> to: [email protected] HMM-Check has given less than 21 results 
- using soring mode only
Okt-29-13 21:45:34 id-79533-02470 [Worker_1] [HMM][scoring] 
212.227.17.22 <[email protected]> to: [email protected] HMM-Check has given less 
than 6 results - using monitoring mode only
Okt-29-13 21:45:34 id-79533-02470 [Worker_1] [HMM][monitoring] 
212.227.17.22 <[email protected]> to: [email protected] info: HMM-Check has taken 0 
seconds and has given 0 results


Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][scoring] 
199.187.172.79 <[email protected]> to: [email protected] HMM-Check has 
given less than 6 results - using monitoring mode only
Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][monitoring] 
199.187.172.79 <[email protected]> to: [email protected] info: HMM-Check 
has taken 0 seconds and has given 0 results
Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][monitoring] 
199.187.172.79 <[email protected]> to: [email protected] info: 
Bayesian-Check has taken 0 seconds

*** ASSP RESTART ***

Okt-29-13 22:06:29 [Main_Thread] MainThread started
Okt-29-13 22:06:29 [Main_Thread] Admin connection from user root on 
host 192.169.210.6:49984; page:/analyze; 
session-ID:c76031876186ed5f6464f72cb3e1a1c0;
Okt-29-13 22:06:29 [Main_Thread] [scoring] SPF: none (cache) 
ip=109.170.242.23 [email protected] 
helo=mx-relay-03.vmx.sdc.uk.murphx.net
Okt-29-13 22:06:29 [Main_Thread] Info: HMM-Check has taken 0 seconds 
and has given 266 results
Okt-29-13 22:06:29 [Main_Thread] HMM Check  - Prob: 1.00000 => spam


Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29 
<[email protected]> to: [email protected] info: HMM-Check has taken 0 
seconds and has given 43 results
Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29 
<[email protected]> to: [email protected] HMM Check  - Prob: 1.00000 => spam
Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29 
<[email protected]> to: [email protected] Message-Score: added 49 for HMM 
Probability: 1.0000, total score for this message is now 64

Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196 
<[email protected]> to: [email protected] info: 
HMM-Check has taken 0 seconds and has given 138 results
Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196 
<[email protected]> to: [email protected] HMM Check  - 
Prob: 1.00000 => spam
Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196 
<[email protected]> to: [email protected] Message-Score: 
added 49 for HMM Probability: 1.0000, total score for this message is 
now 69


Okt-29-13 23:39:28 [Worker_10000] Backup: starting backup database 
table PersBlack to file /usr/share/assp/mysql/dbbackup/persblack
...
Okt-29-13 23:39:36 [Worker_10000] Backup: starting backup database 
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
Okt-29-13 23:39:36 [Worker_10000] Backup: 3948 records of database 
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb

------------------------------------------------------------------------------
Android is increasing in popularity, but the open development platform 
that
developers love is also attractive to malware creators. Download this 
white
paper to learn more about secure code signing practices that can help keep
Android apps secure.
http://pubads.g.doubleclick.net/gampad/clk?id=65839951&iu=/4140/ostg.clktrk

_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test




DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally 
privileged and protected in law and are intended solely for the use of the 

individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no 
known virus in this email!
*******************************************************


------------------------------------------------------------------------------
Android is increasing in popularity, but the open development platform that
developers love is also attractive to malware creators. Download this white
paper to learn more about secure code signing practices that can help keep
Android apps secure.
http://pubads.g.doubleclick.net/gampad/clk?id=65839951&iu=/4140/ostg.clktrk
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test

Reply via email to