Theo Van Dinter wrote:
I'm mostly just venting, but I have 2 machines trying to do the
scoregen run, so I need to share the Bayes DB, and chose SQL. In total
across those machines, I'm currently only seeing ~25 msgs/min or 0.5
messages/sec. So for my ~215k messages, that's 430k seconds, or 5 days
of processing. Set 1 would take ~12h for this same set of messages,
so bayes adds a 10x time penalty?
Am I missing something? MySQL w/ InnoDB + and BayesStore::MySQL, MySQL 4.1.
Granted, I haven't timed this against SDBM or DBM, but I'll take any hints
for MySQL tuning. An upside of using the mass-check client/server code
is the ability to stop the clients, change MySQL configs, and restart
the clients, and not lose the previous work. :)
MySQL isn't hitting swap perhaps? That's the only way I've seen it go
that slow (with spamd) and I've done zero tuning of MySQL.
Is the load on the machine running the DB actually high, or is there an
issue somewhere else... like a crappy network switch?
For comparison, I'm getting 9.5 messages/second with 8 processes on my
2.8 Ghz 4MB Pentium duo core, with software sata raid (LVM), using SDBM.
Daryl
