Sorry to disturb the Mailinglist again, But does anybody have any clue about my problem?
Many thanks -----Message d'origine----- De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Olivier Wulveryck Envoyé : mardi 26 février 2008 09:57 À : [email protected] Objet : RE: [dspam-users] Dspam doesn't see spam or learn... misconfigured? > # dspam_train [EMAIL PROTECTED] spam/ easy_ham/ > > every single spam was failed and detected as innocent e.g: > [test: spam ] 00013.d3f0b591a65f116ea5d9d4ad91 result: FAIL > (Innocent) [fn] Subject: Get the Child Support You Deserve 11.180 Umm, this is the output from what ? [OW] This is the output of the dspam_train for one of the spam treated. > Retraining didn't help, and dspam_stats gave me the following results: > > [EMAIL PROTECTED]: > TP True Positives: 0 > TN True Negatives: 65 > FP False Positives: 0 > FN False Negatives: 14 > SC Spam Corpusfed: 0 > NC Nonspam Corpusfed: 0 > TL Training Left: 2435 > SHR Spam Hit Rate 0.00% > HSR Ham Strike Rate: 0.00% > OCA Overall Accuracy: 82.28% What I don't see here is the corpus training. I see 65 non-spam mails correctly identified as ham and 14 identified wrong. [OW] I agree... There must be a problem, dspam_train is supposed to do the job, doesn't it? [OW] Here are the results: (I'm running a FreeBSD RC, but this may not be the problem) FreeBSD dspam.localdomain 7.0-RC2 FreeBSD 7.0-RC2 #0: Fri Feb 8 00:09:57 UTC 2008 [EMAIL PROTECTED]:/usr/obj/usr/src/sys/GENERIC i386 DSPAM Anti-Spam Suite 3.6.8 (agent/library) Copyright (c) 2002-2006 Jonathan A. Zdziarski http://dspam.nuclearelephant.com DSPAM may be copied only under the terms of the GNU General Public License, a copy of which can be found with the DSPAM distribution kit. Configuration parameters: --sysconfdir=/usr/local/etc --with-logdir=/var/log/dspam --with-dspam-home=/var/db/dspam --with-dspam-home-owner=root --with-dspam-home-group=mail --with-dspam-home-mode=0770 --with-dspam-owner=root --with-dspam-group=mail --enable-syslog --enable-debug --enable-preferences-extension --enable-daemon --with-mysql-includes=/usr/local/include/mysql --with-mysql-libraries=/usr/local/lib/mysql --with-storage-driver=hash_drv,mysql_drv --enable-virtual-users --enable-long-usernames --enable-domain-scale --with-delivery-agent=/usr/local/cyrus/bin/deliver --with-dspam-mode=4510 --prefix=/usr/local --mandir=/usr/local/man --infodir=/usr/local/info/ --build=i386-portbld-freebsd7.0 # This file is auto-generated by 'make config'. # No user-servicable parts inside! # Options for dspam-3.6.8_1 _OPTIONS_READ=dspam-3.6.8_1 WITH_SYSLOG=true WITH_DEBUG=true WITHOUT_VERBOSE_DEBUG=true WITHOUT_BNR_DEBUG=true WITH_PREF_EXT=true WITH_DAEMON=true WITHOUT_CLAMAV=true WITHOUT_CLAMAV_DEVEL=true WITHOUT_CLAMAV_LOCAL=true WITHOUT_MYSQL40=true WITHOUT_MYSQL41=true WITH_MYSQL50=true WITHOUT_MYSQL51=true WITHOUT_MYSQL_COMPRESS=true WITHOUT_MYSQL_LOCAL=true WITHOUT_POSTGRESQL=true WITHOUT_POSTGRESQL_LOCAL=true WITHOUT_ORACLE=true WITHOUT_SQLITE2=true WITHOUT_SQLITE3=true WITH_HASH=true WITHOUT_LDAP=true WITHOUT_USER_HOMEDIR=true WITHOUT_TRUSTED_USERS=true WITH_VIRT_USERS=true WITH_LONG_USERNAMES=true WITHOUT_LARGE_SCALE=true WITH_DOMAIN_SCALE=true WITH_CYRUS21_LDA=true WITHOUT_CYRUS22_LDA=true WITHOUT_CYRUS23_LDA=true WITHOUT_EXIM_LDA=true WITHOUT_MAILDROP_LDA=true WITHOUT_PROCMAIL_LDA=true WITHOUT_SAFECAT_LDA=true WITHOUT_SENDMAIL_LDA=true WITHOUT_SENDMAIL=true WITHOUT_POSTFIX_MBC=true WITHOUT_QMAIL=true WITHOUT_CGI=true WITHOUT_LIGHTTPD=true And here is a test: [root]# cat SPAM | dspam --user [EMAIL PROTECTED] --class=spam --source=corpus --mode=teft [root]# dspam_stats -H [EMAIL PROTECTED]: TP True Positives: 0 TN True Negatives: 0 FP False Positives: 0 FN False Negatives: 0 SC Spam Corpusfed: 1 NC Nonspam Corpusfed: 0 TL Training Left: 2500 SHR Spam Hit Rate 100.00% HSR Ham Strike Rate: 100.00% OCA Overall Accuracy: 100.00% [root]# cat SPAM | dspam --user [EMAIL PROTECTED] [root]# dspam_stats -H [EMAIL PROTECTED]: TP True Positives: 0 TN True Negatives: 1 FP False Positives: 0 FN False Negatives: 0 SC Spam Corpusfed: 1 NC Nonspam Corpusfed: 0 TL Training Left: 2499 SHR Spam Hit Rate 100.00% HSR Ham Strike Rate: 0.00% OCA Overall Accuracy: 100.00% And the debug that comes with it: 83191: [02/26/2008 09:42:53] DSPAM Instance Startup 83191: [02/26/2008 09:42:53] input args: dspam --user [EMAIL PROTECTED] --class=spam --source=corpus --mode=teft 83191: [02/26/2008 09:42:53] pass-thru args: 83191: [02/26/2008 09:42:53] processing user [EMAIL PROTECTED] 83191: [02/26/2008 09:42:53] uid = 0, euid = 0, gid = 0, egid = 0 83191: [02/26/2008 09:42:53] loading preferences for user [EMAIL PROTECTED] 83191: [02/26/2008 09:42:53] Loading preferences for uid 67 83191: [02/26/2008 09:42:53] _ds_pref_load: unable to _mysql_drv_getpwnam(@mailsystem.com) 83191: [02/26/2008 09:42:53] Loading preferences for uid 0 83191: [02/26/2008 09:42:53] Loading preferences for uid 0 83191: [02/26/2008 09:42:53] default preferences empty. reverting to dspam.conf preferences. 83191: [02/26/2008 09:42:53] Loading preferences from dspam.conf 83191: [02/26/2008 09:42:53] using /var/db/dspam/opt-in/mailsystem.com/toto.dspam as path 83191: [02/26/2008 09:42:53] using /var/db/dspam/opt-out/mailsystem.com/toto.nodspam as path 83191: [02/26/2008 09:42:53] sedation level set to: 5 83191: [02/26/2008 09:42:53] Result Confidence: 1.00 83191: [02/26/2008 09:42:53] Control: [10 10] [11 10] Delta: [1 0] 83191: [02/26/2008 09:42:53] libdspam returned probability of 1.000000 83191: [02/26/2008 09:42:53] message result: SPAM 83191: [02/26/2008 09:42:53] DSPAM Instance Shutdown. Exit Code: 0 83195: [02/26/2008 09:43:15] DSPAM Instance Startup 83195: [02/26/2008 09:43:15] input args: dspam --user [EMAIL PROTECTED] 83195: [02/26/2008 09:43:15] pass-thru args: 83195: [02/26/2008 09:43:15] processing user [EMAIL PROTECTED] 83195: [02/26/2008 09:43:15] uid = 0, euid = 0, gid = 0, egid = 0 83195: [02/26/2008 09:43:15] loading preferences for user [EMAIL PROTECTED] 83195: [02/26/2008 09:43:15] Loading preferences for uid 67 83195: [02/26/2008 09:43:15] _ds_pref_load: unable to _mysql_drv_getpwnam(@mailsystem.com) 83195: [02/26/2008 09:43:15] Loading preferences for uid 0 83195: [02/26/2008 09:43:15] Loading preferences for uid 0 83195: [02/26/2008 09:43:15] default preferences empty. reverting to dspam.conf preferences. 83195: [02/26/2008 09:43:15] Loading preferences from dspam.conf 83195: [02/26/2008 09:43:15] using /var/db/dspam/opt-in/mailsystem.com/toto.dspam as path 83195: [02/26/2008 09:43:15] using /var/db/dspam/opt-out/mailsystem.com/toto.nodspam as path 83195: [02/26/2008 09:43:15] sedation level set to: 5 83195: [02/26/2008 09:43:16] no factors specified; using default 83195: [02/26/2008 09:43:16] Result Confidence: 1.00 83195: [02/26/2008 09:43:16] Control: [10 10] [10 11] Delta: [0 1] 83195: [02/26/2008 09:43:16] saving signature as 67,47c3df34831955368818224 83195: [02/26/2008 09:43:16] libdspam returned probability of -1.000000 83195: [02/26/2008 09:43:16] message result: NOT SPAM 83195: [02/26/2008 09:43:16] DSPAM Instance Shutdown. Exit Code: 0 And Here is my dspam.conf Home /var/db/dspam StorageDriver /usr/local/lib/libmysql_drv.so ServerQueueSize 32 ServerPID /var/run/dspam.pid ServerParameters "--debug --deliver=innocent,spam" ServerIdent "dspam.localdomain" ServerPort 10027 ParseToHeaders on ChangeUserOnParse user ChangeModeOnParse on ServerMode auto ProcessorBias on DeliveryHost 10.1.30.62 DeliveryPort 10026 DeliveryIdent DSPAM DeliveryProto SMTP Preference "showFactors=on" Preference "spamAction=tag" Preference "spamSubject=[DSPAM]" FallbackDomains on SystemLog on UserLog on TrainingMode teft MySQLServer /tmp/mysql.sock MySQLUser dspam MySQLPass PASS MySQLDb dspam MySQLVirtualTable dspam_virtual_uids MySQLVirtualUIDField uid MySQLVirtualUsernameField username MySQLUIDInSignature on Feature tb=5 Debug * Trust root Trust mail Thank you for your help
