Could turning on wordlist_compress create problems when zlib is not
available? Also, is a collection with 90000 docs too much for HtDig?
If that is the case, I may consider splitting it into multiple collections.
Again, thanks for your help.
/Raj
Gilles Detillieux wrote:
> According to Rajendra Inamdar:
> > I am getting a core dump while indexing moderately large collections
> > ( about 80000 docs).
> >
> > Configuration is as follows:
> >
> > HtDig version: 3.2.0b3
> > Platform: Sparc, Solaris 2.7
> > System memory: 1Gb RAM
> >
> > Built with: ./configure --without-zlib --disable-shared
> >
> > Indexing was performed with the -m listfile ( minimal mode )
> > listfile contained about 10-20 urls. The incremental indexing worked
> > satisfactorily for some time, but now it core dumps every time.
> > htsearch is still able to find documents from the collection.
> >
> > Do you think turning off "wordlist_compress" may help? What will be
> > the space/performance implication of that?
>
> Well, if you configure with the option --without-zlib, it won't be able
> to compress anyway, so there shouldn't be any space implication to it.
> Do try turning off wordlist_compress. You may also want to try the
> latest 3.2.0b4 development snapshot (http://www.htdig.org/files/snapshots)
> instead, as it has a number of bug fixes. In any case, you'll probably
> want to reindex from scratch when you're done installing and configuring.
>
> --
> Gilles R. Detillieux E-mail: <[EMAIL PROTECTED]>
> Spinal Cord Research Centre WWW: http://www.scrc.umanitoba.ca/~grdetil
> Dept. Physiology, U. of Manitoba Phone: (204)789-3766
> Winnipeg, MB R3E 3J7 (Canada) Fax: (204)789-3930
_______________________________________________
htdig-dev mailing list
[EMAIL PROTECTED]
http://lists.sourceforge.net/lists/listinfo/htdig-dev
