Bayes database problem

["Rogers, Zo� A."]

Something is wrong with our bayesian database.  The same spam email is getting through even though I am feeding them manually into the learner.  Its matching on BAYES_50 only.

 

I tried running sa-learn --dump data | sort > bayes_dump.txt which should show every token in the database in ascending order of spam probability.  After terminating the process, the text file contains nothing.  When I run sa-learn --dump magic it shows over 1000000 tokens but it hangs on sa-learn --dump data.  Does anyone know what could be wrong here?  Is there a maximum database size? 

 

When I run with the debug option on it hangs at Initialising learner.

 

debug: Failed to parse line in SpamAssassin configuration, skipping: A=TCP $h
debug: Failed to parse line in SpamAssassin configuration, skipping: Mdsmtp,   P=[IPC], F=mDFMuXa%k5, S=EnvFromSMTP/HdrFromSMTP, R=EnvToSMTP, E=\r\n, L=990,
debug: Failed to parse line in SpamAssassin configuration, skipping: T=DNS/RFC822/SMTP,
debug: Failed to parse line in SpamAssassin configuration, skipping: A=TCP $h
debug: Failed to parse line in SpamAssassin configuration, skipping: Mrelay,   P=[IPC], F=mDFMuXa8k, S=EnvFromSMTP/HdrFromSMTP, R=MasqSMTP, E=\r\n, L=2040,
debug: Failed to parse line in SpamAssassin configuration, skipping: T=DNS/RFC822/SMTP,
debug: Failed to parse line in SpamAssassin configuration, skipping: A=TCP $h
debug: Failed to parse line in SpamAssassin configuration, skipping: use_razor1 0
debug: bayes: 8301 tie-ing to DB file R/O /usr/local/share/spamassassin/run/bayes_toks
debug: bayes: 8301 tie-ing to DB file R/O /usr/local/share/spamassassin/run/bayes_seen
debug: bayes: found bayes db version 2
debug: Score set 2 chosen.
debug: Initialising learner

 

sa-learn --force-expire -D

 

debug: Failed to parse line in SpamAssassin configuration, skipping: A=TCP $h
debug: Failed to parse line in SpamAssassin configuration, skipping: Mrelay,   P=[IPC], F=mDFMuXa8k, S=EnvFromSMTP/HdrFromSMTP, R=MasqSMTP, E=\r\n, L=2040,
debug: Failed to parse line in SpamAssassin configuration, skipping: T=DNS/RFC822/SMTP,
debug: Failed to parse line in SpamAssassin configuration, skipping: A=TCP $h
debug: Failed to parse line in SpamAssassin configuration, skipping: use_razor1 0
debug: bayes: 8213 tie-ing to DB file R/O /usr/local/share/spamassassin/run/bayes_toks
debug: bayes: 8213 tie-ing to DB file R/O /usr/local/share/spamassassin/run/bayes_seen
debug: bayes: found bayes db version 2
debug: Score set 2 chosen.
debug: Initialising learner
debug: Initialising learner
debug: Syncing Bayes journal and expiring old tokens...
debug: lock: 8213 created /usr/local/share/spamassassin/run/bayes.lock.mss-mail-in-5.dnsmss.net.8213
debug: lock: 8213 trying to get lock on /usr/local/share/spamassassin/run/bayes with 0 retries
debug: lock: 8213 breaking stale /usr/local/share/spamassassin/run/bayes.lock: age=1090317256 now=1090317973
debug: lock: 8213 trying to get lock on /usr/local/share/spamassassin/run/bayes with 1 retries
debug: lock: 8213 link to /usr/local/share/spamassassin/run/bayes.lock: link ok
debug: bayes: 8213 tie-ing to DB file R/W /usr/local/share/spamassassin/run/bayes_toks
debug: bayes: 8213 tie-ing to DB file R/W /usr/local/share/spamassassin/run/bayes_seen
debug: bayes: found bayes db version 2

synced Bayes databases from journal in 0 seconds: 685 unique entries (887 total entries)
debug: bayes: expiry check keep size, 75% of max: 112500
debug: bayes: token count: 2273369, final goal reduction size: 2160869
debug: bayes: First pass?  Current: 1090317975, Last: 1090299462, atime: 736899888, count: 0, newdelta: 0, ratio: 0
debug: bayes: something fishy, calculating atime (first pass)

 

Then it hangs for ages until I have to terminate. 

 

Thanks,

Zoe



---------------------------------------------------
This email from dns has been validated by dnsMSS Managed Email Security and is free from all known viruses.

For further information contact [EMAIL PROTECTED]