[AMaViS-user] Why does amavis have a very low spam score (compared to spamassassin)?

2008-02-09 Thread Jef Driesen
I have a small postfix/amavis/dovecot mailserver for my home network. 
Mails are retrieved with fetchmail and delivered to postfix with amavis 
as a after-queue content filter. It works great, except that after the 
upgrade from Ubuntu 7.04 (Feisty Fawn) to 7.10 (Gutsy Gibbon), amavis 
assigns very low spamcores.

An example from amavis:

X-Spam-Score: 2.644
X-Spam-Level: **
X-Spam-Status: No, score=2.644 tagged_above=-999 required=5
tests=[BAYES_50=0.001, HTML_MESSAGE=0.001, MIME_HTML_ONLY=1.457,
SARE_SUB_CASINO=0.555, US_DOLLARS_3=0.63]

When I remove all headers generated by my mailserver, and pass the 
message through spamassassin (with "spamassassin -t < spam.eml"), I get 
a much higher score:

X-Spam-Flag: YES
X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on
 manta.localdomain.local
X-Spam-Level: *
X-Spam-Status: Yes, score=17.7 required=5.0 tests=DNS_FROM_RFC_DSN, 
HTML_MESSAGE,MIME_HTML_ONLY,RCVD_IN_BL_SPAMCOP_NET,RCVD_IN_NJABL_PROXY,
SARE_SUB_CASINO,URIBL_BLACK,URIBL_JP_SURBL,URIBL_OB_SURBL,URIBL_RHS_DOB,
US_DOLLARS_3 autolearn=spam version=3.2.3

  pts rule name
 --
  0.6 SARE_SUB_CASINO
  1.7 RCVD_IN_NJABL_PROXY
  2.2 RCVD_IN_BL_SPAMCOP_NET
  2.5 DNS_FROM_RFC_DSN
  1.2 US_DOLLARS_3
  0.0 HTML_MESSAGE
  1.7 MIME_HTML_ONLY
  2.9 URIBL_JP_SURBL
  2.1 URIBL_OB_SURBL
  2.0 URIBL_BLACK
  0.9 URIBL_RHS_DOB

If I restart amavis, the spamscore is already much higher for the same 
message (send with "sendmail user < spam.eml"), especially if the high 
negative AWL score is ignored:

X-Quarantine-ID: 
X-Spam-Flag: YES
X-Spam-Score: 8.12
X-Spam-Level: 
X-Spam-Status: Yes, score=8.12 tagged_above=-999 required=5 
tests=[AWL=-5.476,
BAYES_40=-0.185, DNS_FROM_RFC_DSN=1.495, HTML_MESSAGE=0.001,
MIME_HTML_ONLY=1.457, RCVD_IN_BL_SPAMCOP_NET=1.96,
RCVD_IN_NJABL_PROXY=1.643, SARE_SUB_CASINO=0.555, URIBL_BLACK=1.955,
URIBL_JP_SURBL=1.501, URIBL_OB_SURBL=1.5, URIBL_RHS_DOB=1.083,
US_DOLLARS_3=0.63]

I understand that there might be some differences between amavis and my 
spamassassin test, because they did run with a different user, but I 
think something else is wrong here. It seems that network test are only 
performed if amavis is restarted in the second try. Since all settings 
are unchanged, what could be causing this and how do I fix this? I can 
provide additional information, but didn't know what to provide already.


-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


Re: [AMaViS-user] Spam folder daily summary?

2008-02-09 Thread mouss
Mike Cisar wrote:
> Hi all,
>
> Running Sendmail/Amavis/Spamassassin/Dovecot on a couple of servers.  About
> 50% of the users prefer to be spoon-fed their SPAM in their inbox, for the
> other 50% or so we've set up to sort their SPAM into an IMAP spam folder
> using plussed addressing.
>
> A number of users still use POP to access their mail and as such require a
> "reminder" to log in to their webmail once in a while to clean up their spam
> folder. 
>
> What I'm looking for is a way (script that I can run in a daily cron) to
> scan each of these user's spam folder and produce a quick summary of the
> mail therein (from, to, subject) and email them the result.  If it matters,
> we will be migrating to likely a maildir format when we migrate to a new
> server in the spring, but for now the IMAP folders are UW-mbox format (or is
> that mbx, I can never remember which is which :-)
>
> Can anyone recommend a script that could accomplish what I'm looking to do?
>   

you could start with
 formail -l "" -ds < mboxfile
this will print things like this:
From [EMAIL PROTECTED]  Wed Jan 30 16:45:12 2008
Subject: =?utf-8?B?TW9iaWxlIFdvcmxkIENvbmdyZXNz?=  =?utf-8?B?IDogV2

Folder: 7052

if you want to chose the headers, you can try something like
formail -cX "" -ds < mboxfile | \
egrep "^(From|To|Cc|Subject|Date)" | \
sed "s/^From .*//"


Note that headers may be mime encoded (subject shown above), in which 
case they are not "readable". you will need to decode them (if they are 
to be sent via email, then don't forget to encode the body!).

or you could try something like this if the mbox is not too large:

#!/usr/bin/perl

use Mail::MboxParser;
use strict;

my $mbox_file = $ARGV[0];
#headers to print
my @print_headers = ("From", "Date", "Subject", "Content-Length", 
"X-Spam-Score");

my $parseropts = {
enable_cache=> 1,
enable_grep => 1,
cache_file_name => '/tmp/mbox_cache',
};

my $mb = Mail::MboxParser->new($mbox_file,
   decode => 'HEADER',
   parseropts => $parseropts);


while (my $msg = $mb->next_message) {
print "\n";
foreach my $header (@print_headers) {
print "$header: " . $msg->header->{"\L$header"} . "\n";
}
}







-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/


[AMaViS-user] Spam folder daily summary?

2008-02-09 Thread Mike Cisar
Hi all,

Running Sendmail/Amavis/Spamassassin/Dovecot on a couple of servers.  About
50% of the users prefer to be spoon-fed their SPAM in their inbox, for the
other 50% or so we've set up to sort their SPAM into an IMAP spam folder
using plussed addressing.

A number of users still use POP to access their mail and as such require a
"reminder" to log in to their webmail once in a while to clean up their spam
folder. 

What I'm looking for is a way (script that I can run in a daily cron) to
scan each of these user's spam folder and produce a quick summary of the
mail therein (from, to, subject) and email them the result.  If it matters,
we will be migrating to likely a maildir format when we migrate to a new
server in the spring, but for now the IMAP folders are UW-mbox format (or is
that mbx, I can never remember which is which :-)

Can anyone recommend a script that could accomplish what I'm looking to do?


Cheers,
> Mike <

  


-
This SF.net email is sponsored by: Microsoft
Defy all challenges. Microsoft(R) Visual Studio 2008.
http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/