>Okt-29-13 23:39:36 [Worker_10000] Backup: 3948 records of database
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
3948 records for HMMdb is simply much too less to get good HMM-results.
Oct-31-13 04:00:11 Maxbytes: 8000
Oct-31-13 04:00:11 C:/assp/errors/spam
Oct-31-13 04:00:11 File Count: 1,765
Oct-31-13 04:06:20 C:/assp/errors/notspam
Oct-31-13 04:06:20 File Count: 847
Oct-31-13 04:09:15 C:/assp/spam
Oct-31-13 04:09:15 File Count: 1,959
Oct-31-13 04:13:21 C:/assp/notspam
Oct-31-13 04:13:21 File Count: 583
Oct-31-13 04:15:13 start populating Spamdb with 259,569 records - Bayesian
check is now disabled!
Oct-31-13 04:15:49 Finished populating Spamdb with 259,569 records -
Bayesian check is now enabled!
Oct-31-13 04:15:50 Generating consolidated Hidden-Markov-Model database
from 1,748,314 record model
Oct-31-13 04:17:48 HMM sequences: 859,419 now in list
You need more files in the corpus.
Thomas.
Von: Michael <[email protected]>
An: assp-test <[email protected]>,
Datum: 30.10.2013 12:26
Betreff: [Assp-test] HMMdb not working after backup
Hello @all,
I have noticed since several versions of ASSP that my HMMdb gave no
results AFTER a database backup and it is reproducable after a
logfile-check (see example below).
In addition to that my whitelist is always empty if I use DB. After
changing to file it works again as expected.
Rebuildspam does not show any errors. tmpDB is a directory on RAM-disk
with 5 GB of space, current usage: 501 MB. All rights are set to 777
Does anybody have similar problems or tips where to start searching?
Thanks you in advance!
Michael
My config for HMM and DB:
DoBayesian:=1
DoHMM:=1
ignoreDBVersionMissMatch:=0
HMMusesBDB:=
DoPrivatSpamdb:=0
BayesMaxProcessTime:=15
BayesWL:=
BayesNP:=
noBayesian:=
noBayesian_local:=
Bayesian_localOnly:=
maxBayesValues:=60
baysProbability:=0.6
baysConf:=0
baysConfidenceHalfScore:=1
NoTagInTestmode:=
AddSpamProbHeader:=1
AddConfidenceHeader:=1
DBdriver:=BerkeleyDB
importDBDir:=mysql/dbbackup
preventBulkImport:=
fillUpImportDBDir:=
ImportMysqlDB:=
exportDBDir:=mysql/dbexport
ExportMysqlDB:=
backupDBDir:=mysql/dbbackup
backupDBInterval:=2
RebuildSchedule:=0 6 * * *
useDB4Rebuild:=1
ReplaceOldSpamdb:=
doMove2Num:=
newReportedInterval:=10 5
MaxKeepDeleted:=7
autoCorrectCorpus:=0.6-1.4-4000-14
RebuildFileTimeLimit:=1 5
RebuildNotify:[email protected]
RebuildTestMode:=
Okt-29-13 19:59:00 [Main_Thread] MainThread started
Okt-29-13 19:59:00 [Main_Thread] Admin connection from user root on
host 192.169.210.6:47382; page:/analyze;
session-ID:c76031876186ed5f6464f72cb3e1a1c0;
Okt-29-13 19:59:01 [Main_Thread] Info: HMM-Check has taken 0 seconds
and has given 423 results
Okt-29-13 19:59:01 [Main_Thread] HMM Check - Prob: 1.00000 => spam
Okt-29-13 20:40:08 [Main_Thread] Info: HMM-Check has taken 0 seconds
and has given 268 results
Okt-29-13 20:40:08 [Main_Thread] HMM Check - Prob: 1.00000 => spam
Okt-29-13 21:39:18 [Worker_10000] Backup: starting backup database
table PersBlack to file /usr/share/assp/mysql/dbbackup/persblack
...
Okt-29-13 21:39:26 [Worker_10000] Backup: starting backup database
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
Okt-29-13 21:39:26 [Worker_10000] Backup: 3948 records of database
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
Okt-29-13 21:45:34 id-79533-02470 [Worker_1] 212.227.17.22
<[email protected]> to: [email protected] HMM-Check has given less than 21 results
- using soring mode only
Okt-29-13 21:45:34 id-79533-02470 [Worker_1] [HMM][scoring]
212.227.17.22 <[email protected]> to: [email protected] HMM-Check has given less
than 6 results - using monitoring mode only
Okt-29-13 21:45:34 id-79533-02470 [Worker_1] [HMM][monitoring]
212.227.17.22 <[email protected]> to: [email protected] info: HMM-Check has taken 0
seconds and has given 0 results
Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][scoring]
199.187.172.79 <[email protected]> to: [email protected] HMM-Check has
given less than 6 results - using monitoring mode only
Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][monitoring]
199.187.172.79 <[email protected]> to: [email protected] info: HMM-Check
has taken 0 seconds and has given 0 results
Okt-29-13 22:04:15 id-80654-02390 [Worker_1] [HMM][monitoring]
199.187.172.79 <[email protected]> to: [email protected] info:
Bayesian-Check has taken 0 seconds
*** ASSP RESTART ***
Okt-29-13 22:06:29 [Main_Thread] MainThread started
Okt-29-13 22:06:29 [Main_Thread] Admin connection from user root on
host 192.169.210.6:49984; page:/analyze;
session-ID:c76031876186ed5f6464f72cb3e1a1c0;
Okt-29-13 22:06:29 [Main_Thread] [scoring] SPF: none (cache)
ip=109.170.242.23 [email protected]
helo=mx-relay-03.vmx.sdc.uk.murphx.net
Okt-29-13 22:06:29 [Main_Thread] Info: HMM-Check has taken 0 seconds
and has given 266 results
Okt-29-13 22:06:29 [Main_Thread] HMM Check - Prob: 1.00000 => spam
Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29
<[email protected]> to: [email protected] info: HMM-Check has taken 0
seconds and has given 43 results
Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29
<[email protected]> to: [email protected] HMM Check - Prob: 1.00000 => spam
Okt-29-13 22:57:51 id-83869-12808 [Worker_1] 103.14.120.29
<[email protected]> to: [email protected] Message-Score: added 49 for HMM
Probability: 1.0000, total score for this message is now 64
Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196
<[email protected]> to: [email protected] info:
HMM-Check has taken 0 seconds and has given 138 results
Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196
<[email protected]> to: [email protected] HMM Check -
Prob: 1.00000 => spam
Okt-29-13 23:37:16 id-86235-03435 [Worker_1] 74.114.9.196
<[email protected]> to: [email protected] Message-Score:
added 49 for HMM Probability: 1.0000, total score for this message is
now 69
Okt-29-13 23:39:28 [Worker_10000] Backup: starting backup database
table PersBlack to file /usr/share/assp/mysql/dbbackup/persblack
...
Okt-29-13 23:39:36 [Worker_10000] Backup: starting backup database
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
Okt-29-13 23:39:36 [Worker_10000] Backup: 3948 records of database
table HMMdb to file /usr/share/assp/mysql/dbbackup/HMMdb
------------------------------------------------------------------------------
Android is increasing in popularity, but the open development platform
that
developers love is also attractive to malware creators. Download this
white
paper to learn more about secure code signing practices that can help keep
Android apps secure.
http://pubads.g.doubleclick.net/gampad/clk?id=65839951&iu=/4140/ostg.clktrk
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test
DISCLAIMER:
*******************************************************
This email and any files transmitted with it may be confidential, legally
privileged and protected in law and are intended solely for the use of the
individual to whom it is addressed.
This email was multiple times scanned for viruses. There should be no
known virus in this email!
*******************************************************
------------------------------------------------------------------------------
Android is increasing in popularity, but the open development platform that
developers love is also attractive to malware creators. Download this white
paper to learn more about secure code signing practices that can help keep
Android apps secure.
http://pubads.g.doubleclick.net/gampad/clk?id=65839951&iu=/4140/ostg.clktrk
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test