Re: autolearn=ham was wrong, howto retrain ?

2011-04-04 Thread Yet Another Ninja

On 2011-04-04 9:54, Andreas Schulze wrote:

Hello

Im using spamassassin inside amavisd-new to filter mails.

Today I noticed a mail with these headers:
X-Spam-Flag: NO
X-Spam-Score: -0.007
X-Spam-Level:
X-Spam-Status: No, score=-0.007 tagged_above=-999 required=5
 tests=[HTML_IMAGE_ONLY_32=0.001, HTML_MESSAGE=0.001, MTX_NONE=0.001,
 T_RP_MATCHES_RCVD=-0.01] autolearn=ham
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on andreasschulze.de

How can I tell SA this was spam ?
I would try sa-learn -spammessagefile

But does this let SA really forget the previous state ham ?




http://spamassassin.apache.org/full/3.3.x/doc/sa-learn.txt

-forget  Forget a message


Re: autolearn=ham was wrong, howto retrain ?

2011-04-04 Thread Andreas Schulze
Hi,


 -forget  Forget a message

I do
 sa-learn --forget message; sa-learn --spam message
right ?


-- 
Viele Grüße

Andreas Schulze



Re: Problems with sorbs and this list Fwd: Re: What blacklists are you using at your MTA?

2011-04-04 Thread Matus UHLAR - fantomas
On 03.04.11 21:56, dar...@chaosreigns.com wrote:
 If you go through the garbage required to register to get to the contents
 of this link, you'll see that this IP hits two listings, Escalated
 entries, and DUHL entries, both of which are colored green, which it says
 means Historical Listings (inactive).  But it's still listed:
 
 $ host 171.225.210.67.dnsbl.sorbs.net
 171.225.210.67.dnsbl.sorbs.net has address 127.0.0.10
 
 - Forwarded message from Jonathan Nichols jnich...@pbp.net -
  users@spamassassin.apache.org: host mx1.eu.apache.org[192.87.106.230]
  said:
 550 Dynamic IP Addresses See:
 http://www.sorbs.net/lookup.shtml?67.210.225.171 (in reply to RCPT TO
 command)
 - End forwarded message -

oh... with 300 TTL we should better not trust you this is NOT dynamic IP.
It's one of things mentioned at SORBS page...

171.225.210.67.in-addr.arpa. 300 IN PTR heap.pbp.net.

;; AUTHORITY SECTION:
225.210.67.in-addr.arpa. 300IN  NS  heap.pbp.net.

;; ADDITIONAL SECTION:
heap.pbp.net.   300 IN  A   67.210.225.171

-- 
Matus UHLAR - fantomas, uh...@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
The 3 biggets disasters: Hiroshima 45, Tschernobyl 86, Windows 95


Re: autolearn=ham was wrong, howto retrain ?

2011-04-04 Thread Matus UHLAR - fantomas
On 04.04.11 10:34, Andreas Schulze wrote:
  -forget  Forget a message
 
 I do
  sa-learn --forget message; sa-learn --spam message
 right ?

you don't need to forget the message. Learning it again will do change
values properly.

-- 
Matus UHLAR - fantomas, uh...@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Linux IS user friendly, it's just selective who its friends are...


Hijacked email accounts

2011-04-04 Thread David

Hello,

I have noticed that recently almost all spam that makes it pass my spam 
filters come from hijacked email accounts. Usually on services like 
hotmail and yahoo ( sometimes from .com sometimes from country specific 
domains ).


I wonder if perhaps a rule in spamassassin should add between 0.5 and 
1.5 to the spam rating when it comes from a free webmail service like 
hotmail and yahoo.


David


RE: Hijacked email accounts

2011-04-04 Thread Jonas
Hi David

 -Original Message-
 From: David [mailto:wiki.apache@spam.lublink.net]
 Sent: 4. april 2011 17:36
 To: users@spamassassin.apache.org
 Subject: Hijacked email accounts
 
 Hello,
 
 I have noticed that recently almost all spam that makes it pass my spam 
 filters
 come from hijacked email accounts. Usually on services like hotmail and yahoo
 ( sometimes from .com sometimes from country specific domains ).
 
 I wonder if perhaps a rule in spamassassin should add between 0.5 and
 1.5 to the spam rating when it comes from a free webmail service like hotmail
 and yahoo.
 

I am seeing the same thing with my systems. Most spam that makes it past the 
filters are from hacked accounts.

I'm not really sure if punishing all the innocent freemail users is the answer?
It should be relatively easy to do if you want to though.


Med venlig hilsen / Best regards
 
Jonas Akrouh Larsen
 
TechBiz ApS
Laplandsgade 4, 2. sal
2300 København S
 
Office: 7020 0979
Direct: 3336 9974
Mobile: 5120 1096
Fax:7020 0978
Web: www.techbiz.dk





Re: Hijacked email accounts

2011-04-04 Thread Benny Pedersen

 I wonder if perhaps a rule in spamassassin should add between 0.5 and 
 1.5 to the spam rating when it comes from a free webmail service like 
 hotmail and yahoo.

there is already freemail plugin

freemail_domain hotmail.com
freemail_whitelist ab...@hotmail.com
freemail_whitelist postmas...@hotmail.com

if you know somebody that really NOT sending spam from a freemail domain,
then add more freemail_whitelist

hotmail.com is already listed as freemail, but i just showed how to use it

i have seen this problem before, but i belive that its not hijacked more
that hotmail not consider forged senders in there own networking, resulting
in that recipient see it as spf pass, i verifyed that sender did not send
this so called hijacked email



Re: Hijacked email accounts

2011-04-04 Thread David

Hello,

Yahoo doesn't do SPF, and hotmail is still ~all.

The emails to which I refer where sent by email accounts stolen by 
viruses on computers running Windows.


The virus steals the password, and sends it to the spammer who than uses 
the account to send out spam.


So the emails are coming from Hotmail and Yahoo's servers.

David

On 2011-04-04 11:49, Benny Pedersen wrote:

I wonder if perhaps a rule in spamassassin should add between 0.5 and
1.5 to the spam rating when it comes from a free webmail service like
hotmail and yahoo.

there is already freemail plugin

freemail_domain hotmail.com
freemail_whitelist ab...@hotmail.com
freemail_whitelist postmas...@hotmail.com

if you know somebody that really NOT sending spam from a freemail domain,
then add more freemail_whitelist

hotmail.com is already listed as freemail, but i just showed how to use it

i have seen this problem before, but i belive that its not hijacked more
that hotmail not consider forged senders in there own networking, resulting
in that recipient see it as spf pass, i verifyed that sender did not send
this so called hijacked email




Re: Hijacked email accounts

2011-04-04 Thread Daniel McDonald
On 4/4/11 11:03 AM, David wiki.apache@spam.lublink.net wrote:

 Hello,
 
 Yahoo doesn't do SPF, and hotmail is still ~all.
 
 The emails to which I refer where sent by email accounts stolen by
 viruses on computers running Windows.
 
 The virus steals the password, and sends it to the spammer who than uses
 the account to send out spam.
 
 So the emails are coming from Hotmail and Yahoo's servers.

I've noticed most of the compromised accounts are exploited from
elsewhere.  I'm sorry if this rule is US centric, but it appears to work,
somewhat, for me:

headerRELAY_NOT_USX-Relay-Countries =~
/\b[ABCDEFGHIJKLMNOPQRTVWXYZ]{2}\b/
describeRELAY_NOT_USRelayed though any country other than the US
scoreRELAY_NOT_US0.01

metaAE_FOREIGN_FREEFREEMAIL_FROM  RELAY_NOT_US
describeAE_FOREIGN_FREEFreemail that originated somewhere other than
the US
scoreAE_FOREIGN_FREE0.5


I also find this to be pretty useful in cleaning out the hacked mail...

meta AE_SHORT_FREEFREEMAIL_FROM  (URIBL_DBL_SHORT ||
URIBL_SU_JMF)
describeAE_SHORT_FREEhas shortened URL from a freemail account
scoreAE_SHORT_FREE2.0

Now if I could just find a list of url shorteners that included j.mp ...

 
 David
 
 On 2011-04-04 11:49, Benny Pedersen wrote:
 I wonder if perhaps a rule in spamassassin should add between 0.5 and
 1.5 to the spam rating when it comes from a free webmail service like
 hotmail and yahoo.
 there is already freemail plugin
 
 freemail_domain hotmail.com
 freemail_whitelist ab...@hotmail.com
 freemail_whitelist postmas...@hotmail.com
 
 if you know somebody that really NOT sending spam from a freemail domain,
 then add more freemail_whitelist
 
 hotmail.com is already listed as freemail, but i just showed how to use it
 
 i have seen this problem before, but i belive that its not hijacked more
 that hotmail not consider forged senders in there own networking, resulting
 in that recipient see it as spf pass, i verifyed that sender did not send
 this so called hijacked email
 



Re: Hijacked email accounts

2011-04-04 Thread Jason Bertoch

On 2011/04/04 12:12 PM, Daniel McDonald wrote:

Now if I could just find a list of url shorteners that included j.mp ...


DecodeShortURLs plugin from Steve Freegard

http://www.fsl.com/support/DecodeShortURLs.pm
http://www.fsl.com/support/DecodeShortURLs.cf


--
/Jason


Re: Hijacked email accounts

2011-04-04 Thread darxus
On 04/04, Benny Pedersen wrote:
 freemail_domain hotmail.com
 freemail_whitelist ab...@hotmail.com
 freemail_whitelist postmas...@hotmail.com

SpamAssassin already has 2,133 domains listed via freemail_domain, so you
shouldn't need to add that part for any domain.  If you do, you should file
a bug to get it added.

The rule that goes with this is FREEMAIL_FROM, which has a default score of
0.001 (basically nothing), because it hits 21.6% of non-spam (11.4%
of spam).

But if you want it to actually do anything, you'd need to increase the
score via something like:

score FREEMAIL_FROM 1

But these scores are chosen by some pretty extensive real world data
analysis:

http://ruleqa.spamassassin.org/20110321-r1083702-n/FREEMAIL_FROM/detail


It looks like the way to just penalize a single domain would be:

blacklist_from *@yahoo.com
score USER_IN_BLACKLIST 1

By default it has a score of 100, which would usually block everything.  

I was actually doing something with a similar effect, to hotmail for a 
while.  I recently noticed yahoo is much worse, I think this graph deserves 
its own post: http://www.chaosreigns.com/dnswl/dnswlabusehistory.svg


On 04/04, David wrote:
 The emails to which I refer where sent by email accounts stolen by
 viruses on computers running Windows.

I had always assumed the spammers just registered the accounts directly.
Why do you think they were stolen, by viruses or otherwise?

-- 
Life is but a walking shadow, a poor player that struts and frets his
hour upon the stage--and then is heard no more. It is a tale told by an
idiot, full of sound and fury, signifying nothing. - William Shakespeare
http://www.ChaosReigns.com


DNSWL abuse reports by domain, over time

2011-04-04 Thread darxus
Top 20, linear Y scale:
http://www.chaosreigns.com/dnswl/dnswlabusehistory.svg

Top 10, logarithmic Y scale:
http://www.chaosreigns.com/dnswl/dnswlabusehistory_log.svg

DNSWL.org groups IPs by domain.  So I was able to count up the number of
abuse reports per domain, per month.  I graphed the percentage because I
figure reporter activity could fluctuate too much to make absolute counts
of reports useful.

So from this data, yahoo has by far sent the most spam of all legitimate
mail sources during this period (since January 2001).  They got better over
the last month (or everybody else has gotten worse...).  tp.pl is
currently second worst; aol.com is third.

The domains in the key are listed in descending order of total spam during
the period.

I think it's great that google does as well as they do.  I think it's
interesting that both postini and messagelabs show up in this top 20.  

One of the things I found interesting in this is that I had an impression
that hotmail.com was by far the worst, and apparently it never has been.
At least in this period.

I'm curious if there's a story behind orange.fr's spike in June 2010.

-- 
The most merciful thing in the world, I think, is the inability of the
human mind to correlate all its contents.
http://www.ChaosReigns.com


RE: Hijacked email accounts

2011-04-04 Thread Brent Kennedy
I have also noticed a lot of emails coming from valid domain services.  I
have also noticed many of the stolen accounts are used to authenticate with
my blog posting engine to post spam to my blogs.  It never reaches the blog
because I approve each entry, but it's been happening with increased
frequency.

The truth is, this is not a new trick, its comes and goes.  Your real
protection is in the bayes rules and making sure you do not whitelist a
service like these.

If it helpsto assist with users who have accounts on gmail(or any
domain) who are sending email to internal customers, I apply an outbound
hidden line of text in every email that amounts to code.  If the code is
seen in a reply, the email is given a -100 score, thus reducing false
positives for replied messages.  It also ensures the conversation will most
likely not be interrupted.  Its not 100% all the time since some users
clients delete replied sections of the email, but it does help.

body BK_RespondedTo /\bxXYyzb262011qa\b/i
score BK_RespondedTo -100.0

I think adding a rule as you suggest will only end up causing more false
positives.

-Brent

-Original Message-
From: David [mailto:wiki.apache@spam.lublink.net] 
Sent: Monday, April 04, 2011 11:36 AM
To: users@spamassassin.apache.org
Subject: Hijacked email accounts

Hello,

I have noticed that recently almost all spam that makes it pass my spam 
filters come from hijacked email accounts. Usually on services like 
hotmail and yahoo ( sometimes from .com sometimes from country specific 
domains ).

I wonder if perhaps a rule in spamassassin should add between 0.5 and 
1.5 to the spam rating when it comes from a free webmail service like 
hotmail and yahoo.

David