as I wrote earlier, I mounted the tmpDB directory to a RAM-Disk by adding

"tmpfs /usr/share/assp/tmpDB tmpfs rw,mode=1777 0 0"

to /etc/fstab and reboot

In addition to that, make sure that "Use BerkeleyDB for the Hidden  
Makrov Model databases (HMMusesBDB)" is set to on.
 From now on, read/write access to HMM is very fast now.

Nov-25-11 10:40:33 Start populating Hidden Markov Model. HMM-check is  
disabled for this time!
Nov-25-11 10:40:34 start populating Hidden Markov Model ham chains  
with 1762958 records!
Nov-25-11 10:40:55 Finished populating Hidden Markov Model ham chains  
with 1762958 records!
Nov-25-11 10:40:56 start populating Hidden Markov Model ham totals  
with 1557741 records!
Nov-25-11 10:41:15 Finished populating Hidden Markov Model ham totals  
with 1557741 records!
Nov-25-11 10:41:16 start populating Hidden Markov Model spam chains  
with 1827664 records!
Nov-25-11 10:41:38 Finished populating Hidden Markov Model spam chains  
with 1827664 records!
Nov-25-11 10:41:39 start populating Hidden Markov Model spam totals  
with 1656565 records!
Nov-25-11 10:42:00 Finished populating Hidden Markov Model spam totals  
with 1656565 records!
Nov-25-11 10:42:00 Finished populating Hidden Markov Model. HMM-check  
is now enabled again!

and ~ 25 files/sec. are processed now:

Nov-25-11 10:19:43 /usr/share/assp/notspam
Nov-25-11 10:19:43 File Count:  18,129
Nov-25-11 10:19:43 Processing... notspam with 18129 files
Nov-25-11 10:31:39 Imported Files:      18,129
Nov-25-11 10:31:39 Finished in 716 second(s)





------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
_______________________________________________
Assp-test mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-test

Reply via email to