Hello,
I am getting a core dump while indexing moderately large collections
( about 80000 docs).
Configuration is as follows:
HtDig version: 3.2.0b3
Platform: Sparc, Solaris 2.7
System memory: 1Gb RAM
Built with: ./configure --without-zlib --disable-shared
Indexing was performed with the -m listfile ( minimal mode )
listfile contained about 10-20 urls. The incremental indexing worked
satisfactorily for some time, but now it core dumps every time.
htsearch is still able to find documents from the collection.
Do you think turning off "wordlist_compress" may help? What will be
the space/performance implication of that?
Thanks for your help.
/Raj Inamdar
Backtrace is as follows:
lcsol12% gdb ./htdig core
GNU gdb 4.18
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "sparc-sun-solaris2.7"...
Core was generated by `/usr/local/htdig/htdig/bin/htdig -v -a -m
/tmp/crlist.010726065501 -c
/usr/loca'.
Program terminated with signal 6, Abort.
Reading symbols from /usr/lib/libnsl.so.1...done.
Reading symbols from /usr/lib/libsocket.so.1...done.
Reading symbols from /usr/local/lib/libstdc++.so.2.10.0...done.
Reading symbols from /usr/lib/libm.so.1...done.
Reading symbols from /usr/lib/libc.so.1...done.
Reading symbols from /usr/lib/libdl.so.1...done.
Reading symbols from /usr/lib/libmp.so.2...done.
Reading symbols from /usr/platform/SUNW,Ultra-250/lib/libc_psr.so.1...done.
#0 0xff198444 in C () from /usr/lib/libc.so.1
(gdb) bt
#0 0xff198444 in C () from /usr/lib/libc.so.1
#1 0xff139470 in abort () from /usr/lib/libc.so.1
#2 0xff248f50 in __default_terminate ()
from /usr/local/lib/libstdc++.so.2.10.0
#3 0xff248f80 in __terminate () from /usr/local/lib/libstdc++.so.2.10.0
#4 0xff249a94 in throw_helper (eh=0xff26c2fc, pc=0x6ac27,
my_udata=0xffbee838, offset_p=0xffbee834)
from /usr/local/lib/libstdc++.so.2.10.0
#5 0xff249c9c in __throw () from /usr/local/lib/libstdc++.so.2.10.0
#6 0xff24b804 in __builtin_vec_new (sz=16599576) at ../../gcc/cp/new2.cc:39
#7 0x6ac28 in Compressor::get_vals (this=0xffbeed10, pres=0xfd4aa0, tag=0x0)
at WordBitCompress.cc:815
#8 0x60160 in WordDBPage::Uncompress_main (this=0xffbeed70, pin=0xffbeed10)
at WordDBPage.cc:213
#9 0x5e514 in WordDBPage::Uncompress (this=0xffbeed70, pin=0xffbeed10,
ndebug=4) at WordDBPage.cc:155
#10 0x5d5b4 in WordDBCompress::Uncompress (this=0xfce400,
inbuff=0xfd0378 "\004", inbuff_length=2032, outbuff=0xec9dc0 "",
outbuff_length=8192) at WordDBCompress.cc:127
#11 0x5ce48 in WordDBCompress_uncompress_c (inbuff=0xfd0378 "\004",
inbuff_length=2032, outbuff=0xec9dc0 "", outbuff_length=8192,
user_data=0xfce400) at WordDBCompress.cc:48
#12 0xb0348 in CDB___memp_cmpr_read (dbmfp=0xfcfd10, bhp=0xec9d60,
---Type <return> to continue, or q <return> to quit---
db_io=0xffbeef98, niop=0xffbeef94) at mp_cmpr.c:288
#13 0xb005c in CDB___memp_cmpr (dbmfp=0xffbeef98, bhp=0xec9d60,
db_io=0xffbeef98, flag=1, niop=0xffbeef94) at mp_cmpr.c:139
#14 0xaf5cc in CDB___memp_pgread (dbmfp=0xfcfd10, bhp=0xec9d60, can_create=0)
at mp_bh.c:212
#15 0x890f4 in CDB_memp_fget (dbmfp=0xfcfd10, pgnoaddr=0xffbef0ac, flags=0,
addrp=0xffbef0a8) at mp_fget.c:353
#16 0xbeda0 in CDB___bam_search (dbc=0xfd0150, key=0xffbef308, flags=12802,
stop=1, recnop=0x0, exactp=0xffbef1cc) at bt_search.c:251
#17 0xb7278 in CDB___bam_c_search (dbc=0xfd0150, key=0xffbef308, flags=15,
exactp=0xffbef1cc) at bt_cursor.c:1594
#18 0xb6118 in CDB___bam_c_put (dbc_orig=0xfcfd58, key=0xffbef308,
data=0xffbef2f0, flags=15) at bt_cursor.c:982
#19 0x9b42c in CDB___db_put (dbp=0x341bf0, txn=0x0, key=0xffbef308,
data=0xffbef2f0, flags=0) at db_am.c:508
#20 0x587ec in WordList::Put (this=0xffbefb04, arg=@0x122800, flags=0)
at WordDB.h:128
#21 0x4d888 in HtWordList::Flush (this=0xffbefb04) at ../htword/WordList.h:118
#22 0x3c71c in Retriever::parse_url (this=0xffbefa58, urlRef=@0xffbef4b8)
at Retriever.cc:655
#23 0x3bda0 in Retriever::Start (this=0xffbefa58) at Retriever.cc:423
#24 0x427c8 in main (ac=7, av=0xffbefe2c) at htdig.cc:317
(gdb)
_______________________________________________
htdig-dev mailing list
[EMAIL PROTECTED]
http://lists.sourceforge.net/lists/listinfo/htdig-dev
