On Tue, Aug 12, 2008 at 07:32:51AM -0400, Michael Scheidell wrote: > > > From: Henrik K <[EMAIL PROTECTED]> > > Reply-To: Amavis Users <[email protected]> > > Date: Tue, 12 Aug 2008 11:39:27 +0300 > > To: Amavis Users <[email protected]> > > Subject: Re: [AMaViS-user] Q about bayes_vars/token and id value > > > > On Tue, Aug 12, 2008 at 04:13:57AM -0400, Michael Scheidell wrote: > > > > I have just 3 million tokens (~160MB of data) and few thousand users. It > > fits fine in my MySQL buffer. I even removed the atime index, since updating > > it is probably more costly than the unindexed 2 minute expire I run every > > night. > > Really? Interesting. Doesn't seem to affect expire time? > Running innodb? And some innodb_buffer_pool > 160MB?
I have just 512MB buffer. Also all amavis tables fit there. It's all in memory, so even full table scan isn't that bad. > > > > Statistics said that 57% are 1-occurence tokens. I would interpret that as > > being mostly noise, probably I could even lower my token count. > > Reason I started this exercise, is somehow, one of my clients decided 23 > Million baysian tokens is a good idea ;-) > Takes 6-10 seconds to lookup/update bayes tokens on that box. I wonder why > ;-) Sounds like more than 1GB of data. Wonder how big the buffer pool is? Seems noone has come up with good Bayes statistics, but I would imagine that's way too much tokens. There's only so much words and permutations that are usable (I'm guessing again). I think the rest is filled with old relay/IP addresses etc. For some reason SA even saves amavis queue IDs as tokens, which is completely useless. Haven't had time to investigate a fix for that and some other things yet. ------------------------------------------------------------------------- This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK & win great prizes Grand prize is a trip for two to an Open Source event anywhere in the world http://moblin-contest.org/redirect.php?banner_id=100&url=/ _______________________________________________ AMaViS-user mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/amavis-user AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3 AMaViS-HowTos:http://www.amavis.org/howto/
