AW: Question about termDocs.read(docs, freqs)

2006-09-19 Thread Kroehling, Thomas
27;ll side-step the explanations part of your mail since I don't know how to answer.. But a few observations, see below. On 9/19/06, Kroehling, Thomas <[EMAIL PROTECTED]> wrote: > > Hi, > I am trying to write a WildcardFilter in order to prevent > TooManyBooleanClauses and high

Question about termDocs.read(docs, freqs)

2006-09-19 Thread Kroehling, Thomas
Hi, I am trying to write a WildcardFilter in order to prevent TooManyBooleanClauses and high memory usage. I wrap a Filter in a ConstantScoreQuery. I enumerate over the WildcardTerms for a query. This way I can set a maximum number of terms which i will evaluate. If too many terms match, I throw an

AW: MemoryUsage of sorting

2006-06-29 Thread Kroehling, Thomas
That is exactly what I did when I started to realize the effects of using Lucene sorting with millions of documents in the index. I used STORED fields and sorted the results with a generic Comparator, which is configured for a field and a search order. I only do this if the query did not return

MemoryUsage of sorting

2006-06-28 Thread Kroehling, Thomas
Hi, I have a question about using sorting in Lucene, because we experienced some OutOfMemory errors. If I understand it correctly, each unique term in a field is read into a cache, when I use Searcher.search(Query query, Sort sort) with one SortField. So even if my query only finds 5 documents, Luc