> From: Kris Deugau <[EMAIL PROTECTED]> > Organization: ViaNet Internet Solutions > Reply-To: <users@spamassassin.apache.org> > Date: Wed, 09 Apr 2008 12:36:56 -0400 > To: <users@spamassassin.apache.org> > Subject: Re: Large-scale global Bayes tuning? > > Michael Scheidell wrote: >> Bayes on cluster begs the question: what if you didn't replicate the bayes >> tables, and left them server specific? > > It may yet take that. :( (If only for overall cluster reliability - > any one of the current three machines could handle the current load > without any trouble, but we're likely going to stuff ClamAV on them as > well.) Unfortunately that means doing mistake-training on *each* > machine - autolearn on it's own just doesn't cut it. > > I'm dogfooding pretty much that exact scenario on one machine; it's got > its own local Bayes DB that I'm hand-training with my own mail. > You could also take mysql off of one or several, have them load balance to the other mysql servers, run a caching (global) dns server and clamav on one of them.
What about DCC? I assume with those volumes you are running a local DCC server, and having the other boxes talk to it? >> Since (depending on configurations) some of the servers might get 'spam >> only' (higher mx records), maybe just take one of the 'valid' bayes tables >> and manually copy it (sa-learn backup, sa-learn clear, restore) every week >> or so. > > Mmmh. Access is for both inbound and outbound mail, through a Keep a couple for outbound only, won't need bayes too much on those. We have an engineering spec for a 9x9 (9 nodes in a cluster, 9 clusters in a group) to support up to 2MM users, and we do a lot of task and load splitting like that. -- Michael Scheidell, CTO >|SECNAP Network Security Winner 2008 Network Products Guide Hot Companies FreeBSD SpamAssassin Ports maintainer Charter member, ICSA labs anti-spam consortium _________________________________________________________________________ This email has been scanned and certified safe by SpammerTrap(tm). For Information please see http://www.spammertrap.com _________________________________________________________________________
