Greetings Neal, Yes, this is the "page leak" that was discussed late last month with Krzysztof Gorgolewski. My patch tickles a bug in the existing code to write a page -- unless the page is flushed from the cache after writing, any new chain which is introduced is lost. Without my new code, the only time the page is written is when it is about to be flushed from the cache, so the bug doesn't manifest itself. (I wrote an email describing all of this, but I can't find it in my outbox, so I may not have actually sent it ):
The best solution is to fix the original bug, but that involves yet more changes to db.h etc to allocate room in each page header for the list of overflow pages, or some similar. A simple way of avoiding the problem is, of course, to remove all my new code to flush the cache periodically, which is made redundant by using the "standalone" database for the "weak compression" free list. As a hack until I get time to remove the flushing completely, CVS currently disables cache flushing by setting wordlist_cache_dirty_level to a very large value, so it *shouldn't* be a problem in the latest snapshot. What version are you using to generate the problem? I'm off overseas for a month tomorrow, so I don't have time to work on ht://Dig at all. If you like, feel free to revert to the original before I started messing things up... On Tue, 15 Jul 2003 11:08, Neal Richter wrote: > Lachlan, > > I'm seeing a startling difference in db.word.db sizes before and > after your changes to mp_alloc.c and others. > > 77824 Jul 14 18:45 db.words.db > 184320 Jul 14 18:24 db.words.db > > If I use htdump to dump these files, the dump is exactly the same. > > Ack! Do you see this? > > Neal Richter > Knowledgebase Developer > RightNow Technologies, Inc. > Customer Service for Every Web Site > Office: 406-522-1485 -- [EMAIL PROTECTED] ------------------------------------------------------- This SF.net email is sponsored by: VM Ware With VMware you can run multiple operating systems on a single machine. WITHOUT REBOOTING! Mix Linux / Windows / Novell virtual machines at the same time. Free trial click here: http://www.vmware.com/wl/offer/345/0 _______________________________________________ ht://Dig Developer mailing list: [EMAIL PROTECTED] List information (subscribe/unsubscribe, etc.) https://lists.sourceforge.net/lists/listinfo/htdig-dev
