Re: reject non-enlish email body messages

2004-05-30 Thread Pascal Hakim
On Sun, May 30, 2004 at 07:55:01AM -0400, Chris Wagner wrote:
> At 04:56 PM 5/29/04 +1000, [EMAIL PROTECTED] wrote:
> > There's plans to do so. We've been stopped from doing this as
> >we'd need a different configuration file on spamassassin for every
> >list, and that represents a lot of duplicated work.
> 
> I don't think looking at a language header will do any good.  Not all
> mailers put in a language code and even if it says "en-us" that doesn't mean
> the body will be English.  And there will be cases where people with
> non-English tags will be in fact posting in English.  And I would greatly
> question trying to determine the language by "interpreting" the message text.
> 

Checkout spam-assassin language tags[1]. I was pleasantly surprised to
see how well they were working. We're running it now, with english as
the only ok language to see how it behaves, and it seems to be going
quite well. It's not stopping anything however, due to the really
really low score we gave it for testing purposes.

Cheers,

Pasc

[1]: 
http://www.spamassassin.org/doc/Mail_SpamAssassin_Conf.html#language%20options




Re: reject non-enlish email body messages

2004-05-30 Thread Pascal Hakim
On Sun, May 30, 2004 at 07:55:01AM -0400, Chris Wagner wrote:
> At 04:56 PM 5/29/04 +1000, [EMAIL PROTECTED] wrote:
> > There's plans to do so. We've been stopped from doing this as
> >we'd need a different configuration file on spamassassin for every
> >list, and that represents a lot of duplicated work.
> 
> I don't think looking at a language header will do any good.  Not all
> mailers put in a language code and even if it says "en-us" that doesn't mean
> the body will be English.  And there will be cases where people with
> non-English tags will be in fact posting in English.  And I would greatly
> question trying to determine the language by "interpreting" the message text.
> 

Checkout spam-assassin language tags[1]. I was pleasantly surprised to
see how well they were working. We're running it now, with english as
the only ok language to see how it behaves, and it seems to be going
quite well. It's not stopping anything however, due to the really
really low score we gave it for testing purposes.

Cheers,

Pasc

[1]: http://www.spamassassin.org/doc/Mail_SpamAssassin_Conf.html#language%20options


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: reject non-enlish email body messages

2004-05-29 Thread Pascal Hakim
On Wed, May 26, 2004 at 11:45:35AM -0600, Lucas Albers wrote:
> Would it break things to reject completelly non-english messages.
> That is messages in which the body was completelly non english for the
> debian-isp mailing list?
> 
> This SA rule: UNWANTED_LANGUAGE_BODY
> 
> I realize we have posters posting from all over the world, but they are
> all posting in english. And therefore it should not prevent any of them
> from posting.

'lo,

There's plans to do so. We've been stopped from doing this as
we'd need a different configuration file on spamassassin for every
list, and that represents a lot of duplicated work.

Cheers,

Pasc




Re: reject non-enlish email body messages

2004-05-29 Thread Pascal Hakim
On Wed, May 26, 2004 at 11:45:35AM -0600, Lucas Albers wrote:
> Would it break things to reject completelly non-english messages.
> That is messages in which the body was completelly non english for the
> debian-isp mailing list?
> 
> This SA rule: UNWANTED_LANGUAGE_BODY
> 
> I realize we have posters posting from all over the world, but they are
> all posting in english. And therefore it should not prevent any of them
> from posting.

'lo,

There's plans to do so. We've been stopped from doing this as
we'd need a different configuration file on spamassassin for every
list, and that represents a lot of duplicated work.

Cheers,

Pasc


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: You can start saving now

2004-05-10 Thread Pascal Hakim
On Sun, May 09, 2004 at 10:09:48PM +0200, Richard Zuidhof wrote:
> Somebody please make this list member-only. I am sick of the spam I receive
> through this list, it is my main source of spam.
>

Making lists member-only makes it harder for people to participate. Most
people who get a "Your message has been denied, subscribe to the
whitelist here"-type of message will not bother posting again rather
than subscribe on the whitelist.

If people really want to turn this list to subscribers only, please
create a bug against lists.debian.org, and get people to post a message
for or against it.

Cheers,

Pasc (as Listmaster)

Please keep listmaster in the CC list if you want further replies.




Re: You can start saving now

2004-05-10 Thread Pascal Hakim
On Mon, May 10, 2004 at 09:46:09AM +0800, Jason Lim wrote:
> You have to weigh up the pros and cons of this.

Agreed.

> Presumably lists.debian.org already uses some kind of spam filtering, such
> as using ordb.org or spamcop.net or something to filter spamming IPs
> outright?
> 
> Then on your end, you can run Spamassassin that will look at the content
> (i presume lists.debian.org server does not have enough resources to run
> Spamassassin to do content-based filtering?), and it will tag it as spam
> or whatever else you want it to do.

We are running spam assassin plus a whole bunch of custom procmail, as
well as something called cross-assassin which gets cross posts against
lists.

For those wondering about the numbers, as far as this month is
concerned, 376 messages (3.3 Mb) did not make it onto the list. This
includes 207 emails stopped by cross assassin, and 90 stopped by spam
assassin.

Cheers,

Pasc (as Listmaster)

Please keep listmaster in the CC list if you want a reply




Re: You can start saving now

2004-05-10 Thread Pascal Hakim
On Sun, May 09, 2004 at 10:09:48PM +0200, Richard Zuidhof wrote:
> Somebody please make this list member-only. I am sick of the spam I receive
> through this list, it is my main source of spam.
>

Making lists member-only makes it harder for people to participate. Most
people who get a "Your message has been denied, subscribe to the
whitelist here"-type of message will not bother posting again rather
than subscribe on the whitelist.

If people really want to turn this list to subscribers only, please
create a bug against lists.debian.org, and get people to post a message
for or against it.

Cheers,

Pasc (as Listmaster)

Please keep listmaster in the CC list if you want further replies.


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]



Re: You can start saving now

2004-05-10 Thread Pascal Hakim
On Mon, May 10, 2004 at 09:46:09AM +0800, Jason Lim wrote:
> You have to weigh up the pros and cons of this.

Agreed.

> Presumably lists.debian.org already uses some kind of spam filtering, such
> as using ordb.org or spamcop.net or something to filter spamming IPs
> outright?
> 
> Then on your end, you can run Spamassassin that will look at the content
> (i presume lists.debian.org server does not have enough resources to run
> Spamassassin to do content-based filtering?), and it will tag it as spam
> or whatever else you want it to do.

We are running spam assassin plus a whole bunch of custom procmail, as
well as something called cross-assassin which gets cross posts against
lists.

For those wondering about the numbers, as far as this month is
concerned, 376 messages (3.3 Mb) did not make it onto the list. This
includes 207 emails stopped by cross assassin, and 90 stopped by spam
assassin.

Cheers,

Pasc (as Listmaster)

Please keep listmaster in the CC list if you want a reply


-- 
To UNSUBSCRIBE, email to [EMAIL PROTECTED]
with a subject of "unsubscribe". Trouble? Contact [EMAIL PROTECTED]