Re: sa-learn: have i seen this before?

2007-04-22 Thread Faisal N Jawdat
On Apr 21, 2007, at 11:49 PM, Matt Kettler wrote: Try adding a -D to sa-learn.. if it's lock contention, you should see a bunch of messages about it waiting for the lock. i did this earlier (after some mucking about with file tracing tools) and found that most of the wait seems to be in two

Re: sa-learn: have i seen this before?

2007-04-22 Thread Matt Kettler
Faisal N Jawdat wrote: On Apr 21, 2007, at 11:49 PM, Matt Kettler wrote: Try adding a -D to sa-learn.. if it's lock contention, you should see a bunch of messages about it waiting for the lock. i did this earlier (after some mucking about with file tracing tools) and found that most of the

Re: sa-learn: have i seen this before?

2007-04-22 Thread Faisal N Jawdat
On Apr 22, 2007, at 9:05 AM, Matt Kettler wrote: You don't have sa-blacklist, do you? no, but i had a whitelist with almost 5,000 entries -faisal

Re: sa-learn: have i seen this before?

2007-04-21 Thread Faisal N Jawdat
On Apr 21, 2007, at 1:30 AM, Matt Kettler wrote: 2. which way do i learn it. Erm, if it's spam, learn it as spam.. if it's nonspam, learn it as nonspam. What's the problem here? i have a program looking through for untrained messages and deciding what to train them as. alternatively, i

Re: sa-learn: have i seen this before?

2007-04-21 Thread Matt Kettler
Faisal N Jawdat wrote: On Apr 21, 2007, at 1:30 AM, Matt Kettler wrote: 2. which way do i learn it. Erm, if it's spam, learn it as spam.. if it's nonspam, learn it as nonspam. What's the problem here? i have a program looking through for untrained messages and deciding what to train them

Re: sa-learn: have i seen this before?

2007-04-21 Thread Faisal N Jawdat
On Apr 21, 2007, at 11:23 AM, Matt Kettler wrote: Ok, but how does knowing what SA learned it as help? It doesn't. Figure out what to train as, and train. it helps in that i can automatically iterate over some or all of my mail folders on a regular basis, selectively retraining *if*: a)

Re: sa-learn: have i seen this before?

2007-04-21 Thread Matt Kettler
Faisal N Jawdat wrote: On Apr 21, 2007, at 11:23 AM, Matt Kettler wrote: Ok, but how does knowing what SA learned it as help? It doesn't. Figure out what to train as, and train. it helps in that i can automatically iterate over some or all of my mail folders on a regular basis, selectively

Re: sa-learn: have i seen this before?

2007-04-21 Thread Matt Kettler
Faisal N Jawdat wrote: if sa-learn already does this internally then it's doing it rather inefficiently. 20 seconds to pull a message id and compare it against the db (berkeleydb, fwiw)? Ok, I just did some testing. Something is *VERY* wrong with your system.. Are you running out of ram and

Re: sa-learn: have i seen this before?

2007-04-21 Thread Faisal N Jawdat
On Apr 21, 2007, at 1:34 PM, Matt Kettler wrote: time sa-learn on it, and feed it the WHOLE DIRECTORY at once. Do not iterate messages, do not specify filenames, just give sa-learn the name of the directory. Doing this on a directory with 6 messages takes about a second more than doing it

Re: sa-learn: have i seen this before?

2007-04-21 Thread Faisal N Jawdat
On Apr 21, 2007, at 2:11 PM, Matt Kettler wrote: Ok, I just did some testing. Something is *VERY* wrong with your system.. Are you running out of ram and swapping? Hrm. top currently reports 123mb free (out of 2g physical, with some swapping. sa-learn has a 62M RSS. This is a shared

Re: sa-learn: have i seen this before?

2007-04-21 Thread Matt Kettler
Faisal N Jawdat wrote: On Apr 21, 2007, at 2:11 PM, Matt Kettler wrote: Ok, I just did some testing. Something is *VERY* wrong with your system.. Are you running out of ram and swapping? Hrm. top currently reports 123mb free (out of 2g physical, with some swapping. sa-learn has a 62M RSS.

Re: sa-learn: have i seen this before?

2007-04-20 Thread Matt Kettler
Faisal N Jawdat wrote: On Apr 16, 2007, at 9:34 PM, Matt Kettler wrote: Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed 1.. then it's already been learned. First, sorry for taking so long to get back to you.. I've been absurdly busy at work

Re: sa-learn: have i seen this before?

2007-04-17 Thread Phil Barnett
On Tuesday 17 April 2007 00:17, Faisal N Jawdat wrote: On Apr 16, 2007, at 9:34 PM, Matt Kettler wrote: Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed 1.. then it's already been learned. this seems to be the common suggestion. it

Re: sa-learn: have i seen this before?

2007-04-17 Thread Phil Dibowitz
Phil Barnett wrote: On Tuesday 17 April 2007 00:17, Faisal N Jawdat wrote: On Apr 16, 2007, at 9:34 PM, Matt Kettler wrote: Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed 1.. then it's already been learned. this seems to be the common

Re: sa-learn: have i seen this before?

2007-04-17 Thread Justin Mason
Faisal -- could you open an enhancement request on the SpamAssassin bugzilla? This would be a useful feature. --j. Faisal N Jawdat writes: On Apr 16, 2007, at 9:34 PM, Matt Kettler wrote: Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed

sa-learn: have i seen this before?

2007-04-16 Thread Faisal N Jawdat
Is there an easy way to tell if sa-learn has learned a given message before? -faisal

Re: sa-learn: have i seen this before?

2007-04-16 Thread Matt Kettler
Faisal N Jawdat wrote: Is there an easy way to tell if sa-learn has learned a given message before? Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed 1.. then it's already been learned.

Re: sa-learn: have i seen this before?

2007-04-16 Thread Faisal N Jawdat
On Apr 16, 2007, at 9:34 PM, Matt Kettler wrote: Try to learn it, if it comes back with something to the affect of: learned from 0 messages, processed 1.. then it's already been learned. this seems to be the common suggestion. it has a couple drawbacks, as i see it: 1. it's relatively