lt;[EMAIL PROTECTED]>
Sent: Wednesday, May 28, 2003 10:21 PM
Subject: Re: too many hits - OutOfMemoryError
>
> Unfortunately, no.
> The modifications are not very extreme, though.
> If you're interested in seeing our approach, let me know.
>
> DaveB
cc:
05/28/03 12:22 PM Subject: Re: too many hits -
OutOfMemoryError
Please respond to
> We ran into this problem and decided to put a check
> on the number of expanded terms and abort the query
> if the number got too high.
Is it possible to perform this check without having to modify Lucene's
source code?
--
Eric Jain
---
ROTECTED]To: "Lucene Users
List"
com>
<[EMAIL PROTECTED]>
cc:
05/28/03 11:16 AM Subject: Re: too many
hits - OutOfMemoryError
Please respond
to
AM Subject: Re: too many hits -
OutOfMemoryError
Please respond to
"Lucene Users
> Yes. Is that the problem?
I believe a term with a wildcard is expanded into all possible terms in
memory before searching for it, so if the term is 'a*', and you have a
million different terms starting with 'a' occuring in your documents,
it's quite possible to run out of memory.
Does anyone kn
Yes. Is that the problem?
At 05:13 PM 5/28/2003 +0200, you wrote:
> When I search with a query I know will hit most of the 1.8 million
> records, the "collect" print
> does not even print, it eats up the 700+MB I allocated and then
> throws an OutOfMemoryError.
Are you using wildcard queries?
--
> When I search with a query I know will hit most of the 1.8 million
> records, the "collect" print
> does not even print, it eats up the 700+MB I allocated and then
> throws an OutOfMemoryError.
Are you using wildcard queries?
--
Eric Jain
--
Thanks for the info, but unfortunately it still is getting an OutOfMemoryError,
Here's my code:
--
final BitSet bits = new BitSet();
HitCollector hc = new HitCollector() {
public void collect(int doc, float score){
System.out.println("co
> Hits hits = searcher.search(myQuery);
BitSet results = new BitSet();
searcher.search(myQuery, new HitCollector()
{
public void collect(int doc, float score)
{
if (score > THRESHOLD)
results.set(doc);
}
});
--
Eric Jain
-
The computer is a 1.7Ghz P4 with 1.25GB Ram. I tried the jvm
arg: -Xmx700M (as I had a little over 700MB free).
Cory Albright
At 02:37 PM 5/27/2003 -0400, you wrote:
Out of curiosity, how much free RAM does the computer normally have? And
have you tried increasing the amount available to the
Out of curiosity, how much free RAM does the computer normally have? And
have you tried increasing the amount available to the JVM?
David Medinets
http://www.codebits.com
-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For addition
Hi -
I have created an index of 1.8 million documents, each document containing
5-10 fields. When I run a search, that I know has a small number of hits,
it works great. However, if I run a search that I know will hit most of
the documents, I get an OutOfMemoryError.I am using the basic
13 matches
Mail list logo
