* Dan Jacobson <[EMAIL PROTECTED]> [12.04.04 06:34]: > My installing namazu for wwwoffle on debian experience: > Indexing my gigabytes of cache took several hours: > Size (bytes): 297,458,983 #that's just the index > Total Documents: 57,775 > Total Keywords: 3,797,251 > Wakati: module_kakasi -ieuc -oeuc -w #left it on. Guess it didn't hurt > Time (sec): 25,689 #date +%R -d'0 + 25689 sec' gives 07:08, i.e. 7 hours > File/Sec: 2.25
SNIP > > > So that's my report from my first day. Sure hope my massive namazu > index doesn't get blown away one day like htdig's did. > > Day 2: >**** Wait, it's my first run of wwwoffle-htdig-lasttime***, and SNIP > > Hey, what's this > Deleted Documents: 57,775 > why, that all that were there ... all gone ... uh huh. Good thing I > kept a backup. > > It couldn't have been that my documents were ALL too old. It seems that > /usr/share/wwwoffle/search/namazu/wwwoffle-mknmz-lasttime is missing a > --no-delete ! Ok, trying... OK ... otherwise all those hours of Looks as though there are now at least two WWWOFFLE users who use namazu. An extract of my NMZ.log is attached for your information. As you can see from the dates, I have been using it for 2 years and rerun namazu every week immediately after purging my WWWOFFLE cache. I had massive problems with the scripts supplied by Andrew Bishop - mainly because I did not know what I was doing. And I have had time to forget how the scripts got sorted out. I had a lengthy correspondence with Andrew about the problems - on my archives, if needed. At this point I would just say that I _never_ run wwwoffle-mknmz-lasttime. I _always_ run wwwoffle-mknmz-full. As you can see from my logs, in spite of the name, only the changes in the contents of the cache get updated in the index. Running wwwoffle-mknmz-lasttime (from memory) wipes out the old index. HTH Felix -- Felix Karpfen Public Key 72FDF9DF (DH/DSA)
[Base] Date: Sun Dec 29 07:50:51 2002 Added Documents: 738 Size (bytes): 9,802,967 Total Documents: 738 Added Keywords: 63,551 Total Keywords: 63,551 Wakati: module_kakasi -ieuc -oeuc -w Time (sec): 716 File/Sec: 1.03 System: linux Perl: 5.006 Namazu: 2.0.12 [Append] Date: Sat Jan 4 07:10:59 2003 Added Documents: 156 Updated Documents: 21 Size (bytes): 3,915,184 Total Documents: 894 Added Keywords: 17,949 Total Keywords: 81,500 Wakati: module_kakasi -ieuc -oeuc -w Time (sec): 333 File/Sec: 0.53 System: linux Perl: 5.006 Namazu: 2.0.12 SNIP [Append] Date: Sat Apr 3 07:27:35 2004 Added Documents: 252 Deleted Documents: 1 Updated Documents: 25 Size (bytes): 3,808,707 Total Documents: 6,085 Added Keywords: 7,662 Total Keywords: 612,939 Wakati: module_kakasi -ieuc -oeuc -w Time (sec): 698 File/Sec: 0.40 System: linux Perl: 5.006 Namazu: 2.0.10 [Append] Date: Fri Apr 9 08:14:49 2004 Added Documents: 214 Deleted Documents: 2 Updated Documents: 61 Size (bytes): 3,892,451 Total Documents: 6,297 Added Keywords: 4,841 Total Keywords: 617,780 Wakati: module_kakasi -ieuc -oeuc -w Time (sec): 730 File/Sec: 0.38 System: linux Perl: 5.006 Namazu: 2.0.10
