Hi again I ran "gdb /path/to/htmerge /path/to/core" then "bt",
as suggested in http://www.geocrawler.com/mail/msg.php3?msg_id=8091212&list=8822 (sorry I didn't notice those posts earlier) this is the output I got - I hope it's of some help thanks Sean gdb output ------------------------------- Core was generated by `htmerge'. Program terminated with signal 6, Abort trap. Reading symbols from /usr/local/htdig-3.2.0b4-200203//lib/htdig/libhtnet-3.2.0.so...done. Reading symbols from /usr/lib/libz.so.2...done. Reading symbols from /usr/local/htdig-3.2.0b4-200203//lib/htdig/libcommon-3.2.0.so...done. Reading symbols from /usr/local/htdig-3.2.0b4-200203//lib/htdig/libhtword-3.2.0.so...done. Reading symbols from /usr/local/htdig-3.2.0b4-200203//lib/htdig/libht-3.2.0.so...done. Reading symbols from /usr/local/htdig-3.2.0b4-200203//lib/mifluz/libhtdb-3.2.0.so...done. Reading symbols from /usr/lib/libstdc++.so.3...done. Reading symbols from /usr/lib/libm.so.2...done. Reading symbols from /usr/lib/libc.so.4...done. Reading symbols from /usr/libexec/ld-elf.so.1...done. #0 0x282453bc in kill () from /usr/lib/libc.so.4 (gdb) bt #0 0x282453bc in kill () from /usr/lib/libc.so.4 #1 0x28281026 in abort () from /usr/lib/libc.so.4 #2 0x28077e30 in __terminate () at HtHTTPBasic.cc:33 #3 0x28077e4d in __terminate () at HtHTTPBasic.cc:33 #4 0x280780c3 in __sjthrow () at HtHTTPBasic.cc:33 #5 0x28077138 in __builtin_vec_new () at HtHTTPBasic.cc:33 #6 0x280e7e04 in WordDBCompress::Uncompress (this=0x9089050, inbuff=0x28047000 "\004", inbuff_length=1016, outbuff=0x8417220 "\001", outbuff_length=8192) at WordDBPage.h:490 #7 0x280e7783 in WordDBCompress_uncompress_c (inbuff=0x28047000 "\004", inbuff_length=1016, outbuff=0x8417220 "\001", outbuff_length=8192, user_data=0x9089050) at WordDBCompress.cc:48 #8 0x28193840 in CDB___memp_cmpr_read (dbmfp=0x80526c0, bhp=0x84171e8, db_io=0xbfbff1f4, niop=0xbfbff1f0) at mp_cmpr.c:288 #9 0x281935b6 in CDB___memp_cmpr (dbmfp=0x80526c0, bhp=0x84171e8, db_io=0xbfbff1f4, flag=1, niop=0xbfbff1f0) at mp_cmpr.c:139 #10 0x28192cbd in CDB___memp_pgread (dbmfp=0x80526c0, bhp=0x84171e8, can_create=0) at mp_bh.c:212 #11 0x28194c27 in CDB_memp_fget (dbmfp=0x80526c0, pgnoaddr=0xbfbff2b8, flags=0, addrp=0x806fb84) at mp_fget.c:353 #12 0x2816059e in CDB___bam_c_next (dbc=0x806fd00, initial_move=1) at bt_cursor.c:1289 #13 0x2815f2c1 in CDB___bam_c_get (dbc_orig=0x806fa00, key=0xbfbff454, data=0xbfbff43c, flags=17) at bt_cursor.c:636 #14 0x280e651d in WordCursor::WalkNextStep (this=0x806fc00) at WordDB.h:271 #15 0x280e644e in WordCursor::WalkNext (this=0x806fc00) at WordCursor.cc:245 #16 0x280e5ad9 in WordCursor::Walk (this=0x806fc00) at WordCursor.cc:123 #17 0x280f7fee in WordList::Collect (this=0xbfbff7a0, wordRef=@0xbfbff530) at WordList.cc:201 #18 0x280f7e13 in WordList::WordRefs (this=0xbfbff7a0) at WordList.cc:193 #19 0x804a4be in mergeDB () at htmerge.cc:323 #20 0x8049a70 in main (ac=8, av=0xbfbffb20) at htmerge.cc:174 #21 0x8049561 in _start () ------------------------------- > -----Original Message----- > From: Gilles Detillieux [mailto:[EMAIL PROTECTED]] > Sent: Tuesday 19 March 2002 05:53 PM > To: [EMAIL PROTECTED] > Cc: Sean Downey; [EMAIL PROTECTED] > Subject: Re: [htdig] HTMerge memory problem > > > According to [EMAIL PROTECTED]: > > If this is a "huge" merge, you may also, in fact, *first* want > to check that > > you are not using a default kernel, which doesn't have near enough file > > descriptors. This issue went away for us (under FreeBSD) by > (a) building a > > kernel that explicitly expected processes to exceed 256mb (look > for MAX_DFLD > > and company), and (b) upgrading to 2gb of RAM. The second > processor didn't > > hurt either ;-) > > If it is indeed a problem with htmerge chewing up too much RAM, then > throwing more hardware at the problem is certainly an option. First, > though, it's important to sort out what the problem is and what > it isn't... > > > On Tue, 19 Mar 2002, Sean Downey wrote: > > > I've been having problems with htmerge - I think it's a memory problem > > > > > > I get a message "Abort trap (cored dumped)" > > > > > > I looked up the mailing list archives and another guy had a > similar problem > > > http://sourceforge.net/mailarchive/message.php?msg_id=220767 > > > he said he hacked the words.cc file which is required for BSD systems. > > > > > > I couldn't find the words.cc file > > > I'm using snapshot htdig-3.2.0b4-20020303 on FreeBSD > > > > > > is there another file I can change to modify the default tmp directory > > Sean, did you not see my reply from March 13? It's archived at > > http://www.geocrawler.com/mail/msg.php3?msg_id=8091212&list=8822 > > and Geoff's response is at > > http://www.geocrawler.com/mail/msg.php3?msg_id=8096875&list=8822 > > There's no words.cc file in 3.2's htmerge, and it doesn't use /tmp. > I believe there's a partial solution to the problem of htmerge's memory > consumption in the patch archives, but I can't get at the ftp.ccsf.org > FTP site right now to confirm. I'll let you know if I eventually do > find the patch, but you may be able to get at it before me if you can > get through to this ftp site. > > -- > Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]> > Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil Dept. Physiology, U. of Manitoba Phone: (204)789-3766 Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930 _______________________________________________ htdig-general mailing list <[EMAIL PROTECTED]> To unsubscribe, send a message to <[EMAIL PROTECTED]> with a subject of unsubscribe FAQ: http://htdig.sourceforge.net/FAQ.html

