Hi Folks,
Sunday I re-indexed my site a third time with 3.2.0b3; after five hours
and 5 minutes htdig finished and htpurge started; for some reason it ran
out of control and started increasing the size of db.words.db
indefinitely, as well as spitting garbage on nohup.out file. Luckily I
was watching it and killed it before it could fill the entire file system.
Today I summoned enough courage to try it again;) this time I used
compression level 6. After five hours and 51 minutes it indexed the site
without a run away purge;) Here are the results:
total 31640
-rw-r--r-- 1 jjah www 1441792 Mar 6 16:33 db.docdb
-rw-r--r-- 1 jjah www 655360 Mar 6 16:33 db.docs.index
-rw-r--r-- 1 jjah www 14344192 Mar 6 16:33 db.excerpts
-rw-r--r-- 1 jjah www 17839104 Mar 6 16:38 db.words.db
-rw-r--r-- 1 jjah www 16384 Mar 6 16:38 db.words.db_weakcmpr
rundig: Start time: Tue Mar 6 10:47:12 PST 2001
htdig: Run complete
htdig: 1 server seen:
htdig: www.ccsf.cc.ca.us:80 5188 documents
[snipped Errors]
HTTP statistics
===============
Persistent connections : Yes
HEAD call before GET : No
Connections opened : 247
Connections closed : 246
Changes of server : 0
HTTP Requests : 1188
HTTP KBytes requested : 26268.2
HTTP Average request time : 0.0218855 secs
HTTP Average speed : 1010.31 KBytes/secs
htdig: Done Digging: Tue Mar 6 16:32:44 PST 2001
htpurge: Start Purging: Tue Mar 6 16:32:44 PST 2001
htpurge: Done Purging: Tue Mar 6 16:38:38 PST 2001
htmerge: Start Merging: Tue Mar 6 16:38:38 PST 2001
htmerge: Done Merging: Tue Mar 6 16:38:38 PST 2001
End time: Tue Mar 6 16:38:39 PST 2001
Searching is still perceptibly slower than 3.1.5.
Regards,
Joe
--
_/ _/_/_/ _/ ____________ __o
_/ _/ _/ _/ ______________ _-\<,_
_/ _/ _/_/_/ _/ _/ ......(_)/ (_)
_/_/ oe _/ _/. _/_/ ah [EMAIL PROTECTED]
_______________________________________________
htdig-dev mailing list
[EMAIL PROTECTED]
http://lists.sourceforge.net/lists/listinfo/htdig-dev
