I just updated my production SA environment from 2.41 to 2.60 and am running into load issues. I'm running SA on a 2-node Tru64 cluster. Each node has 4 gigs of memory and dual 667mHz Alpha CPUs. We process about 150,000 messages per day but, of course, it isn't an even distribution. We can get up to 25,000 messages an hour during the day. We're using spamd/spamc with only local tests. I'm struggling with two issues. One is the amount of memory spamd is using. I had started with evilrules, popcorn, etc but had to take them back out as spamd was sucking up too much memory. Without those, it's still considerably larger than 2.4 was. The second problem is that spamd is taking longer to process the messages. It's doing more, obviously. 2.41 processed most messages in less than a second (usually 0.4 - 0.6). 2.60 is taking 1.4 - 20 seconds. The problem here is that incoming mail starts to back up. So I try to allow more spamd processes to handle it then the machine bogs down. I've been playing with -m to try to find an optimal setting.
Answering my own question: I discovered that much of this was caused by file-locking problems. [EMAIL PROTECTED] put me on the right trail. Basically, the copies of spamd running on each node of the cluster were sharing a single directory. There were problems with conflicting lock files as well as conflicting updates to the bayes database. I fixed it by creating separate spamd user home directories for each machine. The Bayes databases will eventually get out of sync but since both machines are handling about half the spam they should be reasonably close. I am still seeing higher load averages and I did under 2.41 but the machine isn't grinding to a halt anymore.
-- _______________________________________________________________________
Rick Beebe (203) 785-6416 Manager, Systems & Network Engineering FAX: (203) 785-3481 ITS-Med Production Systems [EMAIL PROTECTED] Yale University School of Medicine Suite 124, 100 Church Street South http://its.med.yale.edu New Haven, CT 06519 _______________________________________________________________________
------------------------------------------------------- This SF.net email is sponsored by: SF.net Giveback Program. Does SourceForge.net help you be more productive? Does it help you create better code? SHARE THE LOVE, and help us help YOU! Click Here: http://sourceforge.net/donate/ _______________________________________________ Spamassassin-talk mailing list [EMAIL PROTECTED] https://lists.sourceforge.net/lists/listinfo/spamassassin-talk
