Re: [AMaViS-user] Mail seems to time out

2008-09-18 Thread Ralf Hildebrandt
* Sahil Tandon [EMAIL PROTECTED]:

 Sorry I don't have any hints to offer, but curious why you made the
 change in Postfix.  Is it to just reject spam/viruses at SMTP time 

Exactly.

-- 
Ralf Hildebrandt (i.A. des IT-Zentrums) [EMAIL PROTECTED]
Charite - Universitätsmedizin BerlinTel.  +49 (0)30-450 570-155
Gemeinsame Einrichtung von FU- und HU-BerlinFax.  +49 (0)30-450 570-962
IT-Zentrum Standort CBF  I'm looking for a job!

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 

Re: [AMaViS-user] Virus Warning Delivery Rules

2008-09-18 Thread Erin D. Hughes
Sorry but no one has any idea where I can start looking to fix this?

If 2 (userA, and userB) that are in the TO, CC or BCC (or any 
combination of those) and one (userA) has virus scanning and the other 
(userB) does not they both get a virus warning but the second one 
(userB) also gets the virus.

I need to supress the virus warning mail for the second user(userB).

Can some one please show me what to look for?

E./




Erin D. Hughes wrote:
 All,

 I am having trouble with some of the virus notifications I am sending to 
 users.

 I have 2 users;

 [EMAIL PROTECTED] ---Virus checking turned off

 [EMAIL PROTECTED] --Virus checking turned on

 If I send each a virus the desired actions are completed, either pass or 
 fail.

 The problem is when some one sends a virus to multiply recipients, the 
 following happens;

 [EMAIL PROTECTED] has the message delivered to him (or 
 her) and then also receives a Virus Warning Message.  I need to stop 
 the virus Virus Warning Message from getting delivered.

 [EMAIL PROTECTED] gets only the Virus Warning 
 Message, which is the desired affect.

 This problem persist if user test-crm-smtpvcheck001 is in CC or BCC 
 line of the same mail as [EMAIL PROTECTED] .

 I need to stop delivery of virus warnings for users who are not signed 
 for virus checking.

 Any help would be appreciated. If any other info is needed like a the 
 amavis.conf I would be happy to provide it.


 Erin

 Versions;
 SunOS vmx01.unix 5.11 snv_40 i86pc i386 i86pc
 amavisd-new-2.5.3 (20071212)
 postfix 2.4.1
 ClamAV 0.92

 Sample Mail Log;
 Sep 16 17:21:34 vmx01.unix postfix/smtpd[21617]: [ID 197553 mail.info] 
 B3CA4138D5F: client=host-30-119.internal-gmo[192.168.30.119]
 Sep 16 17:21:34 vmx01.unix postfix/cleanup[21558]: [ID 197553 mail.info] 
 B3CA4138D5F: message-id=[EMAIL PROTECTED]
 Sep 16 17:21:34 vmx01.unix postfix/qmgr[29811]: [ID 197553 mail.info] 
 B3CA4138D5F: from=[EMAIL PROTECTED], size=413, nrcpt=2 (queue active)
 Sep 16 17:21:35 vmx01.unix postfix/cleanup[21434]: [ID 197553 mail.info] 
 020C2138D9B: message-id=[EMAIL PROTECTED]
 Sep 16 17:21:35 vmx01.unix amavis[21755]: [ID 702911 mail.notice] 
 (21755-01) Passed INFECTED (Eicar-Test-Signature), LOCAL 
 [192.168.30.119] [192.168.30.119] [EMAIL PROTECTED] - 
 [EMAIL PROTECTED], quarantine: s/virus-smSjgBFuUHwH, 
 Message-ID: [EMAIL PROTECTED], mail_id: 
 smSjgBFuUHwH, Hits: -, size: 413, queued_as: 020C2138D9B, 246 ms
 Sep 16 17:21:35 vmx01.unix amavis[21755]: [ID 702911 mail.notice] 
 (21755-01) Blocked INFECTED (Eicar-Test-Signature), LOCAL 
 [192.168.30.119] [192.168.30.119] [EMAIL PROTECTED] - 
 [EMAIL PROTECTED], quarantine: s/virus-smSjgBFuUHwH, 
 Message-ID: [EMAIL PROTECTED], mail_id: 
 smSjgBFuUHwH, Hits: -, size: 413, 246 ms
 Sep 16 17:21:35 vmx01.unix postfix/smtp[21786]: [ID 197553 mail.info] 
 B3CA4138D5F: to=[EMAIL PROTECTED], 
 relay=127.0.0.1[127.0.0.1]:10024, delay=0.43, 
 delays=0.15/0.02/0.02/0.24, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued 
 as 020C2138D9B, but 1 DISCARD)
 Sep 16 17:21:35 vmx01.unix postfix/smtp[21786]: [ID 197553 mail.info] 
 B3CA4138D5F: to=[EMAIL PROTECTED], 
 relay=127.0.0.1[127.0.0.1]:10024, delay=0.43, 
 delays=0.15/0.02/0.02/0.24, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued 
 as 020C2138D9B, but 1 DISCARD)
 Sep 16 17:21:35 vmx01.unix postfix/qmgr[29811]: [ID 197553 mail.info] 
 B3CA4138D5F: removed




 -
 This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
 Build the coolest Linux based applications with Moblin SDK  win great prizes
 Grand prize is a trip for two to an Open Source event anywhere in the world
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 ___
 AMaViS-user mailing list
 AMaViS-user@lists.sourceforge.net 
 https://lists.sourceforge.net/lists/listinfo/amavis-user 
  AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
  AMaViS-HowTos:http://www.amavis.org/howto/ 

   


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


[AMaViS-user] any amavisd-nfs gotchas?

2008-09-18 Thread Michael Scheidell
I know I don't want /var/spool/postfix on nfs, and I guess I don't want 
/var/amavis/tmp on nfs either.

if I put the mysql files on NFS, I guess I don't want the log or 
transaction files there either.

I should probably make sure I use async for speed.

Any other amavis/flock() lock() ing gotchas?

-- 
Michael Scheidell, CTO
Main: 561-999-5000, Office: 561-939-7259
  *| *SECNAP Network Security Corporation

* Certified SNORT Integrator
* Everything Channel Hot Product of 2008
* Shaping Information Security Award 2008
* CRN Magazine Top 40 Emerging Security Vendors

_
This email has been scanned and certified safe by SpammerTrap(r). 
For Information please see http://www.spammertrap.com
_

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] Mail seems to time out

2008-09-18 Thread Dave Miller
Ralf Hildebrandt wrote on 9/17/08 4:28 PM:
 * Noel Jones [EMAIL PROTECTED]:
 
 (I was just about to ask for the postfix logs.  HA!)
 
 :)
  
 So it chokes after anywhere from ~10k to ~500k transfer.  My 
 gut thinks this is a client problem - nothing to do with 
 amavisd-new or postfix.
 
 Yes, I think so too. It's the ONLY mail giving me troubles this day.

A (somewhat remote) possibility is that this is a TCP-level issue with
the client's network (or yours, but that's unlikely if it's the only
user having the problem).  There was a bug in older versions of FreeBSD
with the handling of TCP window scaling going through their firewalls.
The usual symptoms were that smaller communications would go through
fine, but any extended communication would just die.  If the client
system is behind one of these FreeBSD firewalls with an older version of
FreeBSD on it, that might be the issue.

-- 
Dave Miller   http://www.justdave.net/
System Administrator, Mozilla Corporation  http://www.mozilla.com/
Project Leader, Bugzilla Bug Tracking System  http://www.bugzilla.org/

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] any amavisd-nfs gotchas?

2008-09-18 Thread Patrick Domack
Why bother putting any of that on nfs?

I can somewhat understand putting postfix spool on nfs, but not a good idea

I don't see a need to put amavis tmp on nfs, it's temp, and shouldn't  
really hold anything useful anyways.

I would never put mysql on nfs, just the speed of it would slow it down.
Plus mysql is network, so you don't need multible computers to access  
the datafiles. And if your paranoid about backups, you can make  
backups, or just use a slave, or both.

I use nfs for mysql dump backups, and users maildir. Other than that,  
postfix, amavisd, mysql is all on the local drive.

Right now I'm running 1 mysql server, and 3 postfix/amavis servers.

Quoting Michael Scheidell [EMAIL PROTECTED]:

 I know I don't want /var/spool/postfix on nfs, and I guess I don't want
 /var/amavis/tmp on nfs either.

 if I put the mysql files on NFS, I guess I don't want the log or
 transaction files there either.

 I should probably make sure I use async for speed.

 Any other amavis/flock() lock() ing gotchas?

 --
 Michael Scheidell, CTO
 Main: 561-999-5000, Office: 561-939-7259
   *| *SECNAP Network Security Corporation

 * Certified SNORT Integrator
 * Everything Channel Hot Product of 2008
 * Shaping Information Security Award 2008
 * CRN Magazine Top 40 Emerging Security Vendors

 _
 This email has been scanned and certified safe by SpammerTrap(r).
 For Information please see http://www.spammertrap.com
 _

 -
 This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
 Build the coolest Linux based applications with Moblin SDK  win great prizes
 Grand prize is a trip for two to an Open Source event anywhere in the world
 http://moblin-contest.org/redirect.php?banner_id=100url=/
 ___
 AMaViS-user mailing list
 AMaViS-user@lists.sourceforge.net
 https://lists.sourceforge.net/lists/listinfo/amavis-user
  AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
  AMaViS-HowTos:http://www.amavis.org/howto/





-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


[AMaViS-user] amavis eats the machine

2008-09-18 Thread Len Conrad
FreeBSD 6.2
amavisd-new-2.4.3_1,1
p5-Mail-SpamAssassin-3.2.5
clamav-0.93.3

quad cpu 2 GHz
1 GB RAM , about 700 MB inactive or free

spamd  about 5% weighted CPU
clamav about 10% wcpu

vscan (amavis), 2 instances taking 75% wcpu

cpu 0% idle

amavis max msg 1000*1024

postfix active queue (sending to vscan), 550 - 600

Anybody know what the blockage could be with vscan(amavis)?

I can't see anything in maillog about errors, simply huge delays in postfix 
sending to :10024/vscan


Suggestions?

Len



__
IMGate OpenSource Mail Firewall www.IMGate.net


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Eugene Vilensky
 vscan (amavis), 2 instances taking 75% wcpu

What is the iowait time on this process(es)?

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Len Conrad

 vscan (amavis), 2 instances taking 75% wcpu

What is the iowait time on this process(es)?

sorry, forgot to show that. iostat shows burtsy i/o with several seconds of no  
i/o, so it's not disk congestion
iostat -c 30
  tty ad0 cpu
 tin tout  KB/t tps  MB/s  us ni sy in id
   0   23 23.07   6  0.14  19  0  2  0 79
   0  129  0.00   0  0.00  97  0  3  0  0
   0   43 10.50   4  0.04  98  0  2  0  0
   0   43  0.00   0  0.00  96  0  2  2  0
   0   43  0.00   0  0.00  98  0  2  0  0
   0   43  0.00   0  0.00  100  0  0  0  0
   0   44  0.00   0  0.00  96  0  4  0  0
   0   43  0.00   0  0.00  95  0  5  0  0
   0   43 16.74  19  0.31  97  0  2  1  0
   0   43  9.00   4  0.04  95  0  4  1  0
   0   43  0.00   0  0.00  98  0  2  0  0
   0   43  0.00   0  0.00  97  0  2  1  0
   0   43  0.00   0  0.00  96  0  2  2  0
   0   43 12.33   6  0.07  95  0  5  0  0
   0   43  0.00   0  0.00  97  0  1  2  0
   0   43  0.00   0  0.00  98  0  2  0  0
   0   43  0.00   0  0.00  98  0  2  0  0
   0   43  0.00   0  0.00  98  0  1  1  0
   0   43  0.00   0  0.00  98  0  1  1  0
   0   43 16.00  10  0.16  98  0  2  0  0
  tty ad0 cpu
 tin tout  KB/t tps  MB/s  us ni sy in id
   0   43  0.00   0  0.00  97  0  2  2  0
   0  129 16.00   4  0.06  95  0  4  1  0
   0   43  0.00   0  0.00  96  0  3  1  0
   0   43  0.00   0  0.00  87  0 11  2  0
   0   43  0.00   0  0.00  98  0  2  0  0
   0   43  0.00   0  0.00  100  0  0  0  0
   0   44  0.00   0  0.00  100  0  0  0  0
   0   44  0.00   0  0.00  98  0  2  1  0
   0   43  0.00   0  0.00  98  0  1  1  0
   0   43 15.20   5  0.07  99  0  0  1  0

Len



__
IMGate OpenSource Mail Firewall www.IMGate.net


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


[AMaViS-user] Attachment filtering question

2008-09-18 Thread Jake Vickers
Does Amavisd-new have the capability of blocking zip files that contain 
EXE files? I'd like to allow zip files, but only if they do not contain 
EXE files within them.
Thanks.


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Len Conrad

 Suggestions?

  Yes, you should be running much more than 2 instances of amavisd.

was running 6, upped that to 10 about 1/2 ago. no change.

sockstat -4 | egrep vscan
vscanperl   36980 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36979 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36978 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36977 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36976 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36975 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36974 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36973 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36972 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36971 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36919 5  tcp4   127.0.0.1:10024   *:*

 ps aux | egrep -i vscan
vscan36919  0.0  6.5 71688 66624  ??  Ss5:09PM   0:21.34 amavisd 
(master) (perl)
vscan36971  0.0  6.5 72320 66848  ??  I 5:10PM   0:00.10 amavisd 
(ch1-avail) (perl)
vscan36972  0.0  6.5 72320 66848  ??  I 5:10PM   0:00.09 amavisd 
(ch1-avail) (perl)
vscan36973  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36974  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36975  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36976  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36977  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36978  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36979  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)
vscan36980  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
(virgin child) (perl)

This is not a busy machine at the amavis/spamd/clamav level, until about 17:00 
hours:

egrep -ic '(passed clean|spam-tag|blocked spam)' /var/log/maillog
10043


Your current 2 instances virtually guarantee that mail will back up
unnecessarily while SA waits for responses from DNS queries and other
network tests.

was not two, was 6, now 10

230 MB RMA inactive or free.


  You need more RAM

we'll shoot for 2 GB


  Try 6 amavisd processes for a start (Scientific Wild Ass Guess), and
adjust up or down from there as necessary.  If it starts swapping, drop
the number of processes, of course.  Make sure that the Postfix
concurrency setting for injection into amavisd is set to match.

local concurrency was 2, upped now to 10.

local_destination_concurrency_limit = 10
default_destination_concurrency_limit = 10

but top falls back to showing only 2 vscan/perl after postfix reload jumps it 
up to 5 or 6 busy.

ockstat -4 | egrep vscan
vscanperl   37417 5  tcp4   127.0.0.1:10024   *:*
vscanperl   37267 5  tcp4   127.0.0.1:10024   *:*
vscanperl   37265 5  tcp4   127.0.0.1:10024   *:*
vscanperl   37212 5  tcp4   127.0.0.1:10024   *:*
vscanperl   37198 5  tcp4   127.0.0.1:10024   *:*
vscanperl   37198 12 tcp4   127.0.0.1:10024   127.0.0.1:57704
vscanperl   37198 16 udp4   69.51.71.14:18295 69.51.71.14:53
vscanperl   36980 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36979 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36974 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36973 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36972 5  tcp4   127.0.0.1:10024   *:*
vscanperl   36972 12 tcp4   127.0.0.1:10024   127.0.0.1:57710
vscanperl   36972 14 udp4   69.51.71.14:46990 69.51.71.14:53
vscanperl   36919 5  tcp4   127.0.0.1:10024   *:*

 
thanks,
Len




__
IMGate OpenSource Mail Firewall www.IMGate.net


-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] Attachment filtering question

2008-09-18 Thread mouss
Jake Vickers wrote:
 Does Amavisd-new have the capability of blocking zip files that contain 
 EXE files? I'd like to allow zip files, but only if they do not contain 
 EXE files within them.


That's the default behaviour. amavisd-new will see the banned file 
inside the zip.

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Clifton Royston
On Thu, Sep 18, 2008 at 06:34:23PM -0500, Len Conrad wrote:
  Suggestions?
 
   Yes, you should be running much more than 2 instances of amavisd.
 
 was running 6, upped that to 10 about 1/2 ago. no change.
 
 sockstat -4 | egrep vscan
 vscanperl   36980 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36979 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36978 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36977 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36976 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36975 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36974 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36973 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36972 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36971 5  tcp4   127.0.0.1:10024   *:*
 vscanperl   36919 5  tcp4   127.0.0.1:10024   *:*
 
  ps aux | egrep -i vscan
 vscan36919  0.0  6.5 71688 66624  ??  Ss5:09PM   0:21.34 amavisd 
 (master) (perl)
 vscan36971  0.0  6.5 72320 66848  ??  I 5:10PM   0:00.10 amavisd 
 (ch1-avail) (perl)
 vscan36972  0.0  6.5 72320 66848  ??  I 5:10PM   0:00.09 amavisd 
 (ch1-avail) (perl)
 vscan36973  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36974  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36975  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36976  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36977  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36978  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36979  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 vscan36980  0.0  6.5 72320 66816  ??  I 5:10PM   0:00.04 amavisd 
 (virgin child) (perl)
 
 This is not a busy machine at the amavis/spamd/clamav level, until about 
 17:00 hours:

  This confirms that while you have 10 configured in amavisd, only 2 are
being used.  Note that all of them after ther first 2 say virgin
indicating that postfix has never connected to them.
 
 egrep -ic '(passed clean|spam-tag|blocked spam)' /var/log/maillog
 10043
 
 
 Your current 2 instances virtually guarantee that mail will back up
 unnecessarily while SA waits for responses from DNS queries and other
 network tests.
 
 was not two, was 6, now 10

  Sorry, I was confused by your mention of 2 instances of amavisd. 
I believe I see what's going on now.

 230 MB RMA inactive or free.
 
 
   You need more RAM
 
 we'll shoot for 2 GB
 
   Try 6 amavisd processes for a start (Scientific Wild Ass Guess), and
 adjust up or down from there as necessary.  If it starts swapping, drop
 the number of processes, of course.  Make sure that the Postfix
 concurrency setting for injection into amavisd is set to match.
 
 local concurrency was 2, upped now to 10.
 
 local_destination_concurrency_limit = 10
 default_destination_concurrency_limit = 10

  Ahhh, I think that's your problem.  I think these concurrency limits
are not applying to amavisd injection.  Check your Postfix master.cf -
it may have a specific process limit of 2 set for the amavisd injection
instance of smtp.  Alternatively, check whether your main.cf has a
vscan_concurrency_limit = 2 for vscan or whatever you've called the
special amavisd injection processes in master.cf.

  -- Clifton

-- 
Clifton Royston  --  [EMAIL PROTECTED] / [EMAIL PROTECTED]
   President  - I and I Computing * http://www.iandicomputing.com/
 Custom programming, network design, systems and network consulting services

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Len Conrad
so now I've got 10 vscan's democratically eating 100% CPU with avg cpu load of 
10, 100+ MB RAM available.

spamd and clamav worker bees still doing nearly 0% wcpu.

Still doesn't seem right that amavis as an interface should be eating the 
entire machine while the content-scanners basically are idle. 

iostat still shows many seconds of 0 bytes disk i/o.

Len





-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Eugene Vilensky
 so now I've got 10 vscan's democratically eating 100% CPU with avg cpu load 
 of 10, 100+ MB RAM available.

 spamd and clamav worker bees still doing nearly 0% wcpu.

 Still doesn't seem right that amavis as an interface should be eating the 
 entire machine while the content-scanners basically are idle.

 iostat still shows many seconds of 0 bytes disk i/o.

We had this problem because vscan was inefficiently unzipping archives
to scan the files inside.  But our symptoms included iowait times.

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Gary V
On 9/18/08, Len Conrad [EMAIL PROTECTED] wrote:
 so now I've got 10 vscan's democratically eating 100% CPU with avg cpu load 
 of 10, 100+ MB RAM available.

 spamd and clamav worker bees still doing nearly 0% wcpu.

 Still doesn't seem right that amavis as an interface should be eating the 
 entire machine while the content-scanners basically are idle.

 iostat still shows many seconds of 0 bytes disk i/o.

 Len


amavisd-new does not use spamd, it uses the Mail::SpamAssassin Perl
module. Typically there is no reason to start up spamd. It's idle
because it's not doing anything.

-- 
Gary V

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/ 


Re: [AMaViS-user] amavis eats the machine

2008-09-18 Thread Gerry Massat
Gary V wrote:
 On 9/18/08, Len Conrad [EMAIL PROTECTED] wrote:
   
 so now I've got 10 vscan's democratically eating 100% CPU with avg cpu load 
 of 10, 100+ MB RAM available.

 spamd and clamav worker bees still doing nearly 0% wcpu.

 Still doesn't seem right that amavis as an interface should be eating the 
 entire machine while the content-scanners basically are idle.

 iostat still shows many seconds of 0 bytes disk i/o.

 Len

 

 amavisd-new does not use spamd, it uses the Mail::SpamAssassin Perl
 module. Typically there is no reason to start up spamd. It's idle
 because it's not doing anything.
   
Have you enabled the ram disk for amavis temporary files?  That made a
huge difference on my system. For my system I have the following in
/etc/rc.d :
amavisd_ram=100M
For my 1gb system with 2 amavis processes, seems to do the trick for me
with no swapping.  As I recall, amavis processing dropped from about 40s
to 3-4s on my lowly dual P3-300 system.
Gerry

-
This SF.Net email is sponsored by the Moblin Your Move Developer's challenge
Build the coolest Linux based applications with Moblin SDK  win great prizes
Grand prize is a trip for two to an Open Source event anywhere in the world
http://moblin-contest.org/redirect.php?banner_id=100url=/
___
AMaViS-user mailing list
AMaViS-user@lists.sourceforge.net 
https://lists.sourceforge.net/lists/listinfo/amavis-user 
 AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 
 AMaViS-HowTos:http://www.amavis.org/howto/