email builder wrote:
Well, I know there have to be some admins out there who have a lot of users and do not use sitewide bayes...... RIGHT? See original email snippet at bottom.
I believe that there are a few running bayes is a similar configuration. It certainly is a tough problem. I believe your tuning ideas are on the mark and are certainly outside the scope of what SpamAssassin is doing, unless of course if there was something in the code that we could do more efficiently. In that case I highly encourage you to read the MySQL website, there is lots of great documentation there, also there are several books that can help in the tuning. Don't be afraid to ask the MySQL community for help, I'm sure they would gladly offer tuning advice. The key to just about any database tuning, once you've exhausted all the various config params is going to be hardware. More memory and more spindles will do wonders.
The other way to look at this is (as someone else mentioned I believe) the possibility that in the long run it just won't be possible to run efficiently with such a large database. In that case you can create a custom storage module, the API is documented, that can handle it. Of course, it's open source you can always do this yourself, or it is possible that a few amongst us would be willing to contract to come up with a storage module that better fits your needs.
The main thing is that these are all good discussions and I myself highly encourage them. It is very hard to test these types of deployments in development so anytime there is one it is a learning experience, at least for me.
Michael
