Wow, that's some impressive stats. Sorry to bring this thread off topic.
I will reduce to 15k messages, and scale back from 10,000 bytes to 4000 as you have. I still don't think our measly machines can do a rebuild during the day for fear of slowing everything else down, which is a real shame. Are you deleting all files after the rebuild so that these files aren't looked at over and over again? (that assumes you're adding to the spam db). On Sun, Sep 20, 2009 at 12:24 PM, Fritz Borgstedt <[email protected]> wrote: > ASSP development mailing list <[email protected]> > schreibt: >>Wow, how many messages are in your corpus? The rebuild is completeing >>in under 10 mins? In production and on the test machine we're looking >>at over an hour for corpus size of 25k per folder. > > > 25000 files per folder is not necessary. > > > Maxbytes: 4000 > Maxfiles: 15000 > > Resulting file 'spamdb' is 3,666,343 byte > Corpus norm: 0.8732 > Total processing time: 152 second(s) > > 2 X 2.8 Ghz Intel Xeon Quad-Core > 5 GB 800 MHz DDR2 FB-DIMM > Mac OSX 10.5.8 > > > ------------------------------------------------------------------------------ > Come build with us! The BlackBerry® Developer Conference in SF, CA > is the only developer event you need to attend this year. Jumpstart your > developing skills, take BlackBerry mobile applications to market and stay > ahead of the curve. Join us from November 9-12, 2009. Register now! > http://p.sf.net/sfu/devconf > _______________________________________________ > Assp-test mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/assp-test > ------------------------------------------------------------------------------ Come build with us! The BlackBerry® Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9-12, 2009. Register now! http://p.sf.net/sfu/devconf _______________________________________________ Assp-test mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/assp-test
