Re: Bayesian filtering (Re: Suggentions for server side spam control)
Quoth Gil Freund on Wed, Dec 31, 2003: I wonder, does bayesian filtering make sense on a domain level (i.e. the same DB for all users) and not having each user teach the system his/her own rules? Heavy mail users should definitely have their own rules. I expect that several typical light mail users (a.k.a. The Unwashed) may share a bayesian rule database effectively (especially if they don't get lots of spam, and that they do is often sent to more than one user), but I wouldn't recommend sharing to anyone else Besides, who gets the privilege to modify the database (i.e., mark messages as spam/good)? Vadik. -- Thoughts good! Slogans bad! Thoughts good! Slogans bad! = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Bayesian filtering (Re: Suggentions for server side spam control)
01 2004, 00:34,Gil Freund: occasionally scan user's inboxes by grepping for known keywords to extract SPAM that they got and then feeds it to the dictionary. I also have some dummy accounts which exist for the sole purpose of attracting SPAM. How do you feed it? I thought SA reads MBOX and Maildir formats only? I don't use SA - I use bogofilter (see my previous message), which likes mboxs (not Maildir though) but can also cooperate with STDIN. I actually have two mail targets which gobbles everything sent to them and feed it to bogofilter's dictionary as either SPAM or HAM respectivly. I almost never use them though because bogofilter also classifies IP addresses and I fear it might classify the IP of the mail server itself (which will of course appear in all the emails) as a SPAM source. -- Oded ::.. We're programmers. Programmers are, in their hearts, architects, and the first thing they want to do when they get to a site is to bulldoze the place flat and build something grand. We're not excited by incremental renovation: tinkering, improving, planting flower beds. -- Joel Spolsky / Things you Should Never Do, Part I To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? TIA baruch I recommend MessageWall: http://messagewall.org I installed in in a government ministry with very high spam volume and it proved to be highly effective and relatively easy to set up and configure. Cheers, Henry = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
Henry Ficher wrote: Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? TIA baruch I recommend MessageWall: http://messagewall.org I installed in in a government ministry with very high spam volume and it proved to be highly effective and relatively easy to set up and configure. Cheers, Henry According to messagewall.org the last stable version was released over a year ago. Is the MessageWall package actively maitaned? baruch = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
On Wed, 31 Dec 2003, Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? I'm using spamassassin (on the client side) and it seems very effective. Be sure to install the newest version and upgrade regularly. Alon -- This message was sent by Alon Altman ([EMAIL PROTECTED]) ICQ:1366540 GPG public key at http://alon.wox.org/pubkey.txt Key fingerprint = A670 6C81 19D3 3773 3627 DE14 B44A 50A3 FE06 7F24 -- -=[ Random Fortune ]=- Revenge is a meal best served cold. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
Baruch Birnbaum wrote: Henry Ficher wrote: Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? TIA baruch I recommend MessageWall: http://messagewall.org I installed in in a government ministry with very high spam volume and it proved to be highly effective and relatively easy to set up and configure. Cheers, Henry According to messagewall.org the last stable version was released over a year ago. Is the MessageWall package actively maitaned? baruch From the site: MessageWall is currently actively working on the development series, although bug fixes are still made to the stable series. Why has it taken them so long to release new versions, I don't know. The timestamps in the package files suggest they haven't introduced bug fixes since then either. But their mailing lists are still active. Henry = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
On Wednesday 31 December 2003 17:40, Baruch Birnbaum wrote: Do you have experience with any of them as a server side spam control software? Is there anything else? I'm using bogofilter by ESR. its wasn't trivial to setup on my Postfix/Cyrus system, and it requires a very large volume of test email to be effective, but I got it to dump email that it sure is SPAM and after a couple of months of running it I get almost no SPAM that it isn't marked and the ammount of suspect as SPAM has diminished greatly. I expect it to get better as I feed it more SPAM, which I do regularly from the stuff that still lends in my inbox and the stuff I get from my unprotected work email. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
not directly answering your question, but on topic, mail administrators might be interested in the following: http://spf.pobox.com/ It is a suggested method for cutting spam from it's root - disabling froging email and verifying sender IP as permitted for sending emails fo it's domain. Boaz. Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? TIA baruch = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
This is interesting. I use SpamAssassin via amavis on a few systems that use Cyrus as MDA, but haven't figured out a reasonable way to set bayesian filtering on such a mail store. Could you elaborate on how you set up cyrus and bogofilter. The same setup should also be usable (I guess) for SpamAssassin bayesian filtering. Oded Arbel wrote: On Wednesday 31 December 2003 17:40, Baruch Birnbaum wrote: Do you have experience with any of them as a server side spam control software? Is there anything else? I'm using bogofilter by ESR. its wasn't trivial to setup on my Postfix/Cyrus system, and it requires a very large volume of test email to be effective, but I got it to dump email that it sure is SPAM and after a couple of months of running it I get almost no SPAM that it isn't marked and the ammount of suspect as SPAM has diminished greatly. I expect it to get better as I feed it more SPAM, which I do regularly from the stuff that still lends in my inbox and the stuff I get from my unprotected work email. = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] -- = Gil Freund Sysnet consulting - [EMAIL PROTECTED] http://www.sysnet.co.il voice: +972-52-676906 Fax: +972-8-9356026 = = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Bayesian filtering (Re: Suggentions for server side spam control)
I wonder, does bayesian filtering make sense on a domain level (i.e. the same DB for all users) and not having each user teach the system his/her own rules? Baruch Birnbaum wrote: Hi linux-il, What is the best server side solution for spam control? A short search in freshmeat got me the following list: 1. ASSP - Anti-Spam SMTP Proxy (http://assp.sourceforge.net) 2. DSPAM (http://www.nuclearelephant.com/projects/dspam/) 3. SpamAssassin (http://www.spamassassin.org) Do you have experience with any of them as a server side spam control software? Is there anything else? TIA baruch = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED] -- = Gil Freund Sysnet consulting - [EMAIL PROTECTED] http://www.sysnet.co.il voice: +972-52-676906 Fax: +972-8-9356026 = = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
and what's with pine+imap? (was: Re: Suggentions for server side spam control)
i tried checking for the possibility to have spam filtering with the following configuration: remote mail server, accessed using 'pine', via an imap server. - thus, i cannot install a spam-filter on the remote server. - the local procmail is never activated, and thus seems to be un-useable here. - i can't use fetchmail - this is imap, not pop3. - couldn't find a way, in pine's configuration, on how to set up a filter that passes the message via an external program. - searching for a solution using google, as well as reading spamassassin's documentation, just shows solutions that assume you can set spamassassin to run via procmail. this does not seem to work for my setup. is there any solution, _WITHOUT_ replacing the mail client, and without reverting to pop3? -- guy For world domination - press 1, or dial 0, and please hold, for the creator. -- nob o. dy = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Suggentions for server side spam control
On Wednesday 31 December 2003 20:57, Gil Freund wrote: This is interesting. I use SpamAssassin via amavis on a few systems that use Cyrus as MDA, but haven't figured out a reasonable way to set bayesian filtering on such a mail store. Could you elaborate on how you set up cyrus and bogofilter. The same setup should also be usable (I guess) for SpamAssassin bayesian filtering. Lets ignore the problem of teaching bogofilter for a second here. I wrote a simply script (attached) that runs bogofilter and then resends the output through the system's sendmail. The attached script does other things - it changes the subject of the message to reflect the SPAM level of the message as OE and other dumb email clients can't filter on arbitary headers, and it also rejects SPAM emails and store them in an mbox for later. I then installed that script as the content_filter for postfix, which was very simple to do. you might also want to check bogofilter's homepage for other success stories. -- Oded bogofilter2sendmail Description: application/shellscript
Re: Bayesian filtering (Re: Suggentions for server side spam control)
On Wednesday 31 December 2003 20:59, Gil Freund wrote: I wonder, does bayesian filtering make sense on a domain level (i.e. the same DB for all users) and not having each user teach the system his/her own rules? Good question. I have no idea :-) I've set it up anyway, and it looks to be working OK (that is no complaints from users so far :-). I know its not nice to do, but I occasionally scan user's inboxes by grepping for known keywords to extract SPAM that they got and then feeds it to the dictionary. I also have some dummy accounts which exist for the sole purpose of attracting SPAM. All in all I think SPAM is generally the same for all the users - viagra ads and other suspect materials, nigerian scams and yambateva. -- Oded = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: and what's with pine+imap? (was: Re: Suggentions for server side spam control)
On Wed, 31 Dec 2003, Alon Altman wrote: On Wed, 31 Dec 2003, guy keren wrote: i tried checking for the possibility to have spam filtering with the following configuration: remote mail server, accessed using 'pine', via an imap server. - thus, i cannot install a spam-filter on the remote server. - the local procmail is never activated, and thus seems to be un-useable here. - i can't use fetchmail - this is imap, not pop3. - couldn't find a way, in pine's configuration, on how to set up a filter that passes the message via an external program. - searching for a solution using google, as well as reading spamassassin's documentation, just shows solutions that assume you can set spamassassin to run via procmail. this does not seem to work for my setup. is there any solution, _WITHOUT_ replacing the mail client, and without reverting to pop3? IIRC, fetchmail supports IMAP, so use fetchmail+procmail and then either use the downloaded mail locally, or use IMAP to upload the mail back to the server. this setup defeats the purpose of using imap in the first place - to be able to see all messages _without_ downloading the messages themselves. i'm beginning to think i'm asking for the imposible - to filter the letter, i need to first download it. however, i should be able to filter out by the message headers that _are_ downloaded by imap, thus eliminating a large part of the spam, and only then downloading the rest of it for further inspection... oh, well. no spam solution for me... -- guy For world domination - press 1, or dial 0, and please hold, for the creator. -- nob o. dy = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: Bayesian filtering (Re: Suggentions for server side spam control)
Oded Arbel wrote: On Wednesday 31 December 2003 20:59, Gil Freund wrote: I wonder, does bayesian filtering make sense on a domain level (i.e. the same DB for all users) and not having each user teach the system his/her own rules? Good question. I have no idea :-) I've set it up anyway, and it looks to be working OK (that is no complaints from users so far :-). I know its not nice to do, but I occasionally scan user's inboxes by grepping for known keywords to extract SPAM that they got and then feeds it to the dictionary. I also have some dummy accounts which exist for the sole purpose of attracting SPAM. How do you feed it? I thought SA reads MBOX and Maildir formats only? All in all I think SPAM is generally the same for all the users - viagra ads and other suspect materials, nigerian scams and yambateva. -- Oded -- = Gil Freund Sysnet consulting - [EMAIL PROTECTED] http://www.sysnet.co.il voice: +972-52-676906 Fax: +972-8-9356026 = = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
Re: and what's with pine+imap? (was: Re: Suggentions for server side spam control)
* guy keren [EMAIL PROTECTED] [031231 23:22]: i tried checking for the possibility to have spam filtering with the following configuration: remote mail server, accessed using 'pine', via an imap server. is there any solution, _WITHOUT_ replacing the mail client, and without reverting to pop3? Search for software where it is indexed, FreshMeat. http://freshmeat.net/search/?q=filter+imapsection=projectsx=0y=0 Shows as first hit IMAPAssassin which should fit the bill. The logic of such a beast is not very hard, read from imap, send throgh spamassassin, upload a modified message according to what SA returned. Obviously, the devil is in the little details. Baruch = To unsubscribe, send mail to [EMAIL PROTECTED] with the word unsubscribe in the message body, e.g., run the command echo unsubscribe | mail [EMAIL PROTECTED]
