Anyone? Mark?
When releasing from full MySQL quarantine, has the quarantining server to be
contacted through AM.PDP or any server in the amavisd farm can do it?
Are the two assumptions below correct? Please...
Paolo
Paolo Cravero wrote:
Hi.
Here using amavisd with full MySQL quarantine
Hi.
Here using amavisd with full MySQL quarantine backend (including message
bodies). Amavisd runs on several machines and quarantines on a single DB
instance. MailZu is currently used as a frontend for users to check their
quarantine.
Yesterday someone asked me if it is really necessary that
Hi,
I am looking for someone with an amavisd-new setup that use multi-socket
multi-core servers (2 socket, 4 core; 4s/4c; ...), in case 64-bit.
I need few performance details of these state-of-the-art servers when used as
high-load antispam gateways.
Contact me on or off-list.
Thanks,
Paolo
Mark Martinec wrote:
ALTER TABLE msgs ADD partition_tag integer DEFAULT 0;
ALTER TABLE msgrcptADD partition_tag integer DEFAULT 0;
ALTER TABLE quarantine ADD partition_tag integer DEFAULT 0;
ALTER TABLE maddr ADD partition_tag integer DEFAULT 0;
ALTER TABLE maddr DROP
Thomas Gelf wrote:
For this reason I cannot go update my production code and I'll have to stick
to manual partitioning over different tablesets.
Hmmm... and how do you accomplish this?
See my message of 28/08/2007 16.10 on this list.
Read manual partitioning as manual data partitioning
Paolo Cravero wrote:
Memory refresh: here we deal with a huge 72GB 30-day MySQL quarantine which
is
Correction, that's 72% of disk space. It is 92GB worth of trash!
Let's take per-week. On the RDBMS we create msgs01..msgs52
msgrcpt01..msgrcpt52 and quarantine01..quarantine52. Depending
Mark Martinec wrote:
Yes, %sql_clause can be assigned-to in a config file.
Thank you Mark for the prompt answer. I tried it out this way:
* exported %sql_clause to amavisd.conf from amavisd /binary/
* created a multiple set of tables:
++
|
Pelletier, Robert wrote:
Wouldn't the simplest way to handle that kind of load to use the
partitionning fonctionnality of MySQL 5.1?
Excellent shot Robert!
I had looked into MySQL documentation but for the wrong keyword. Unfortunately
we're still at MySQL 4.1.x and my suggested patch is a
Hi,
this question is mainly for Mark and amavisd-new developers.
Memory refresh: here we deal with a huge 72GB 30-day MySQL quarantine which is
constantly growing. Main problem is daily maintenance which is taking A LOT
(delete 1-day stuff now takes about 12 hours).
We might be a bit on the
Chris Picton wrote:
1: I would like to quarantine metadata (to/from/score/tests/etc) to a
database, while keeping the file on disk. Is this possible, or should I
write a script which scans the quarantine dir and extracts metadata for
myself?
Some data is there already. Have a look at
Gary V wrote:
I came up with this as an example:
#!/bin/bash echo USE amavis; amavistrim.sql
mysql -uamavis -pamavis_password amavis -B -N -e SELECT CONCAT('DELETE
FROM msgs WHERE mail_id = ', CHAR(39), mail_id, CHAR(39), ' LIMIT 1;' )
FROM msgs WHERE time_iso NOW() - INTERVAL 14 DAY;
Hi Egon,
our traffic peaks at 1Mmsg/day on weaker hardware than yours, and I worked out
a workaround that:
- completes the cleaning in 12 hours
- does not lock the DB
My deletion procedure takes advantage of the ON DELETE CASCADE on
MySQL/InnoDB.
How do we do it? Rather than running a single
Just to provide some numbers, here are our reject statistics as of a Postfix
reporting script.
In the first month of using recipient validation at MTA level, reject rate was
around 53% (Monday, 190kmsgs rejected).
Yesterday (Monday), 4 months later: 39% rejects (160kmsgs rejected).
Number of
Jason Gauthier wrote:
Is it possible to quarantine differently based on user/email? I would
like to begin implementing this, but only quarantine my own spam.
If you mean based on recipient email address, yes, amavisd-new lets you do
that.
You can probably set the quarantine method for your
Hi,
I think the following quarantining method is not supported right-away,
but it requires policy banks:
@domain1 = quarantine to SQL DB_ONE
@domain2 = quarantine to SQL DB_TWO
@domain3 = plus-addressing
default = quarantine to file
@storage_sql_dsn is used, but @lookup_sql_dsn is undefined
Mark Martinec wrote:
Thank you Mark for the quick reply.
SQL quarantining without SQL logging is not currently possible
(but SQL logging without SQL quarantining is possible).
OK.
Currently SQL logging database is used to ensure the chosen mail_id
for a new message is unique in a database.
Xueron Nee wrote:
I am working on a project with postfix + amavisd-new + spamassassin. And,
I want to use mysql as my database because I am not so familiar with
ldap. There will be at most 500, 000 users in this system. So, is there
any suggestion that which version of mysql to choose? and,
Marc Sztochay wrote:
maybe it wasnt that clear what i need. I just want a slapcat of the
amavisd structure of someones ldap with an example object.
Marc,
I was about to drop you one sample object but I doubt you'd be able to
load it into your directory server! Which server are you using?
Hi,
I reviewed headers of a Yahoo Group I receive in my mailbox and found an
interesting value for score in X-Spam-Status:
X-Spam-Score: -1.352
X-Spam-Level:
X-Spam-Status: No, score=1.648-3 tagged_above=-999 required=3.5
tests=[BAYES_50=0.001, DNS_FROM_RFC_ABUSE=0.2,
Michael Scheidell wrote:
postfix/amavisd-new/mysql/SA setup.
Same setup plus a BIND instance for DNS cache and clamav. RedHat Linux
on two Dual Xeons and 1GB RAM.
We have a load balancer that does round robin on servers.
Our setup is:
- server 1: postfix/amavisd-new/clamav/BIND
- server 2:
Gary V wrote:
time_iso char(16) NOT NULL,
vs.
time_iso TIMESTAMP NOT NULL DEFAULT 0,
My impression is (and I could be wrong) that msgs.time_iso was originally
[...]
or the other, and set up your scripts to use the one you choose to index.
Thanks. Will give it a try. Let me start my
Hi,
I've read 2.4.2 docs and past messages, but found not a real answer.
Is there a performance reason, future (un)support, cleaniness, ... to
switch from
time_iso char(16) NOT NULL,
to
time_iso TIMESTAMP NOT NULL DEFAULT 0,
??
I can't see a good reason, except for a more
Mark Martinec wrote:
Hi Mark,
Version 2.4.1 of amavisd-new has been released:
sorry I did not test it out on RC1. I just found a typo/bug in LDAP.schema .
The objectClass definition misses the amavisSpamQuarantineCutoffLevel
attribute. The correct definition should be:
objectclass (
Hans du Plooy wrote:
I'm looking into writing a SA plugin that checks message recipients
against an LDAP server and assigns extra score for non-existing address.
Why? You should reject mail to unknow recipients at smtp level. This
is surely much less expensive because at this time you have
Hi,
I'm looking into writing a SA plugin that checks message recipients
against an LDAP server and assigns extra score for non-existing address.
(We cannot implement this check at Postfix-MTA level because our users
are listed on two separate servers and some are 100% outsourced)
Brian Wong wrote:
I think this would be fairly difficult to implement. How would a WQMS
access the file in order to display it? The quarantine management
[...]
Right, forget it. We've all already discussed that, and come to the
point that it pointless.
We have a 50GB (fifty GigaB)
Mark Martinec wrote:
/* I am currently filling-up a test database in order to test if the
maintainance is actually faster with these DELETE CASCADE statements.
All 2.4 native. */
Let us know of the results.
Got to 15GB of quarantine so far. I'm heading for 30 at least.
Shortly before a
Cami wrote:
Keep far far away from these queries, they are slow.
But probably keep data consistent...
DELETE FROM quarantine WHERE time_num UNIX_TIMESTAMP() - 7*24*60*60;
(make sure you have an index on time_num)
From http://www.ijs.si/software/amavisd/README.sql.txt :
CREATE TABLE
, or not? Should I need to re-create indexes?
Has anyone done some tests?
TIA,
Paolo Cravero
---
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Mark Martinec wrote:
Why domain in maddr table is in 'subdomain fields in reverse' format?
To facilitate producing a quick by-domain summary report by a single SELECT.
Mark,
I think this kind of query is not in the documentation, right?
Do you have any ready-to-use examples for this kind
Jochen Kaechelin wrote:
I wondered if it is possible to tell amavis not to use
so much memory because it's a old server (PIII, 256 MB) and
it runs serveral websites and mailinglists. There are about
4000 email a days going through this machine.
Reduce the number of concurrent amavisd-new
Jochen Kaechelin wrote:
I set max_servers = 0 and now I have only one instance running.
I will give it a try!
Uhm, I'd put that to 1 instead. And reload amavisd-new.
Also, modify Postfix's master.cf in order to reflect the change:
v---
Andreas Schulze wrote:
Andreas replied privately, but this might be of interest for all.
... some SQL-related stuff ...
is it possible, that here amavisbypassviruschecks is unset by SQL stuff
Not really, we do not do SQL user profiling. All SQL activity is related
to Bayes and
Michael Hall wrote:
Per RFC 2252:
6.4. Boolean
( 1.3.6.1.4.1.1466.115.121.1.7 DESC 'Boolean' )
Values in this syntax are encoded according to the following BNF:
boolean = TRUE / FALSE
Boolean values have an encoding of TRUE if they are logically true,
and have an encoding of
Paolo Cravero as2594 wrote:
One update, still hoping for answers!
Setting in /etc/amavisd.conf the following
@bypass_virus_checks_maps = ( [ 'domain.com' ] );
works and lets viruses through. Still, the amavisBypassVirusChecks
content is ignored. I tried with Y, 1, true. Both
Hi,
I am playing with LDAP profiling for my users, either by domain or by
recipient address. I need to set a domain as virus lover, but can't
seem to be able to do that.
The LDAP entry looks like this:
dn: uid=amavis_as2594,ou=schiavi,ou=prova,o=c.it, c=IT
amavisVirusLover: 1
Hi.
Running here amavisd-new 2.3.3 with quarantine to MySQL 4.1.14 InnoDB
under Linux. Postfix, SA and ClamAV complete the setup.
Every night the quarantine cleanup script is run. A du -ks of MySQL
quarantine DB says 13.5GB are occupied.
During the nightly cleanup I see from MRTG that the disk
Paolo Cravero as2594 wrote:
A self-reply with a probably correct answer.
My nightly script ends with
OPTIMIZE TABLE msgs, msgrcpt, maddr, quarantine;
which apparently is NOT logged to the slow-queries MySQL log in case it
runs longer than the threshold (= 3 sec, query goes on for 35 minutes
Pablo L. Arturi wrote:
is there any way to setup quarantine quotas per user?
I agree with Jared: you can implement quotas through the nightly cleanup
script. This is handy if you quarantine to RDBMS.
The easiest thing to do is to setup a time-quota rather than a
size-quota, since in the
Michael Hall wrote:
2.3.3 includes changes to handle multiple search attributes.
OPS, retried and the expansion occurs. OTOH I started getting weird
errors in the log.
query_filter looks like this:
'((objectClass=amavisAccount)(|(mail=%m)(mailalternateaddress=%m)))'
and the directory
Michael Hall wrote:
Sorry for reviving an old thread...
with amavisd-new 2.3.2 we have problems with LDAP query_filters like this:
query_filter =
'((objectClass=amavisAccount)(|(mail=%m)(mailAlternateAddress=%m)(mailEquivalentAddress=%m)))'
Amavisd is improperly creating a LDAP filter
Gary V wrote:
Finally I reply to this thread...
While the system runs unloaded (no swapping) with 10 concurrent
amavisd-new process (ClamAV+SA with DNS tests), in the last days it
takes more than 15 seconds to process a message. There's been an
increase of about 70-80% in processing times in
Hi,
I am running amavisd-new on a RHEL3 Linux box, and I would like to
disable syslogd immediate log flushing (as written in the amavis
tweaking FAQ).
I am afraid this is not a well documented feature of syslogd, and I've
only found that prepending a dash - to the logname should activate the
Hi,
been running 2.3.3 for a while here, with DNS tests enabled.
Since the release of the system in production is getting closer, I've
started checking processing times and system load.
While the system runs unloaded (no swapping) with 10 concurrent
amavisd-new process (ClamAV+SA with DNS
Hi,
I thought you might like to know how much a commercial solution _very_
similar to amavisd-new+ClamAV+SA+MySQL+mailzu costs.
Something with AV+AS and webQuarantine to be installed on your own
hardware, and a nice web interface for management (configuration).
For 10k mailboxes it is about
Dale Walsh wrote:
Rewrote web interface, added templates for easier customization.
Added additional statistic scanning for bad headers.
SEE:
http://www.daleenterprise.com/amavis-stats
click button to download.
Looks very interesting. Dale, is Perl 5.8.*1*+ really necessary?
Got a system
Hi,
sent yesterday this patch as attachment but apparently didn't get
through the mailing list.
I patched amavislogsumm so that it handles correctly 2.3.3 log format,
and added the count of how many messages were spamautolearnt.
Please excuse the base64 copy and paste, but this is the only
Matt Juszczak wrote:
lookup_ldap: 3861 (51%) (4 seconds) I personally don't use LDAP so I
have no idea how to improve this, or if this is as good as it gets.
But this is obviously where amavisd-new spends half its time.
Ahhh ... so we need a better pool of LDAP servers. Yeah, our LDAP
Hi.
I am evaluating and stressing a amavisd + SA + clamav + MySQL setup
(one P4 3GHz machine, 1GB RAM). Full quarantine to MySQL (message bodies
too).
Latest test includes an attempt at filling up MySQL tables with LOTS of
data (million rows, 20-30GB table).
I am not a MySQL guru, but I
49 matches
Mail list logo
