Thanks to everyone for their help...Charles pointed me in the right direction, I had 2 copies of spamassassin. But just removing one didn't do the trick. Recompiled from source after that, and I think it's good to go.
So far spam has been scored above 5, so I'm keeping my fingers crossed. Evan