Yeah, if there were a verbose /diagnostic switch for rebuildspamdb.pl we
could see which item it is getting stuck on so it could be trouble-shot.  It
isn't the same item every time, which says to me it's a bug in the rebuild
script.  The fact that sometimes it completes without issue tells me the
'problem' .eml has been replaced by something new.  At some point another
email that hangs up the rebuild script arrives and it's back to hanging, or
taking so long it might as well be killed.

Hard to troubleshoot when you don't know which out of 60,000 combined emails
are causing the problem ;)



Paul K. Dickson
Systems Administrator
Frederick County Government, IIT
[email protected]
301-600-2399/x12399




> From: Paul Houlbrooke <[email protected]>
> Reply-To: For Users of ASSP <[email protected]>
> Date: Tue, 22 Dec 2009 09:20:13 -0500
> To: For Users of ASSP <[email protected]>
> Subject: Re: [Assp-user] Rebuildrun Hangs At Spam Folder Processing
> 
> I moved all the spam in the C:\assp\spam folder and rebuilddatabase had
> no problem completing. So something in there is causing it to hang,
> trouble is I really don't want to start my corpus from scratch.
> 
> On 12/21/2009 10:28 AM, Paul Houlbrooke wrote:
>> For the past couple of days, rebuildrun has not completed its' tasks. It
>> hangs while processing the C:\assp\spam folder.  Any suggestions what
>> maybe causing this?
>> 
>> 
>> =================================
>> 
>> C:\ASSP>rebuilddatabase
>> Rebuilding SPAM database.... please wait
>> ECHO is off.
>> LWP::Simple 5.827 installed - download griplist available
>> 
>> ******************************************************
>> RebuildSpamDB 2.6.1.1 (1.0.00) started - Mon Dec 21 08:20:48 2009
>> 
>> Running in basedirectory 'C:/ASSP'
>> 
>> ---ASSP Settings---
>> Do Not Collect RedRe Messages: Enabled
>> **Messages matching the RedRe will be removed from the corpus!**
>> 
>> Use Subject as Maillog Names: Disabled
>> Maxbytes: 4000
>> Maxfiles: 14000
>> 
>> ---Cleaning whitelist (c:/assp/whitelist)---
>> whitelist entries older than 999 days (MaxWhitelistDays) will be removed
>> whitelist before: 110
>> whitelist after:  110
>> 
>> --- Cleaning NoBayesian folders ---
>> entries older than 30 days will be removed
>> starting cleanup old files for folder c:/assp/okmail
>> folder c:/assp/okmail before: 87
>> folder c:/assp/okmail deleted: 2
>> folder c:/assp/okmail after: 85
>> 
>> starting cleanup old files for folder c:/assp/discarded
>> folder c:/assp/discarded before: 170
>> folder c:/assp/discarded deleted: 4
>> folder c:/assp/discarded after: 166
>> 
>> starting cleanup old files for folder c:/assp/attachments
>> folder c:/assp/attachments before: 0
>> folder c:/assp/attachments after: 0
>> 
>> 
>> --- Cleaning corrected spam/notspam folders ---
>> entries older than 1000 days will be removed
>> starting cleanup old files for folder c:/assp/errors/spam
>> folder c:/assp/errors/spam before: 30
>> folder c:/assp/errors/spam after: 30
>> 
>> starting cleanup old files for folder c:/assp/errors/notspam
>> folder c:/assp/errors/notspam before: 55
>> folder c:/assp/errors/notspam after: 55
>> 
>> 
>> --- Cleaning Bayesian folders ---
>> starting cleanup files for folder c:/assp/spam
>> folder c:/assp/spam before: 12447
>> starting cleanup files for folder c:/assp/notspam
>> folder c:/assp/notspam before: 11267
>> 
>> c:/assp/errors/spam
>> File Count:     30
>> Processing...
>> Imported Files: 30
>> Finished in 1 second(s)
>> 
>> c:/assp/errors/notspam
>> File Count:     55
>> Processing...
>> Imported Files: 55
>> Finished in 2 second(s)
>> 
>> c:/assp/spam
>> File Count:     12,447
>> Processing...
>> 
>> =================================
>> 
>> 
>> 
----------------------------------------------------------------------------->>
-
>> This SF.Net email is sponsored by the Verizon Developer Community
>> Take advantage of Verizon's best-in-class app development support
>> A streamlined, 14 day to market process makes app distribution fast and easy
>> Join now and get one step closer to millions of Verizon customers
>> http://p.sf.net/sfu/verizon-dev2dev
>> _______________________________________________
>> Assp-user mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/assp-user
> 
> 
> ------------------------------------------------------------------------------
> This SF.Net email is sponsored by the Verizon Developer Community
> Take advantage of Verizon's best-in-class app development support
> A streamlined, 14 day to market process makes app distribution fast and easy
> Join now and get one step closer to millions of Verizon customers
> http://p.sf.net/sfu/verizon-dev2dev
> _______________________________________________
> Assp-user mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/assp-user


------------------------------------------------------------------------------
This SF.Net email is sponsored by the Verizon Developer Community
Take advantage of Verizon's best-in-class app development support
A streamlined, 14 day to market process makes app distribution fast and easy
Join now and get one step closer to millions of Verizon customers
http://p.sf.net/sfu/verizon-dev2dev 
_______________________________________________
Assp-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/assp-user

Reply via email to