RE: search performance benchmarks

2006-06-26 Thread Mike Streeton
We recently ran some benchmarks on Linux with 4 xeon cpus and 2gb of heap (not that this was needed). We managed to easily get 1000 term based queries a second, this including the query execution time and retrieving the top 10 documents from the index. We did notice some contention as adding more c

Index confusion and organization

2006-06-26 Thread Aleksander M. Stensby
Hello, I tried sending this message yesterday, but I think i wasn't registered until now, so i'll post again. (Sorry if this gets doubled up). I have recently started using Lucene and I must say i love it:) But, i have a few questions (probably stupid ones), but still, here goes: I have cre

RE: search performance benchmarks

2006-06-26 Thread Wang, Jeff
Performance varies a lot, and depends upon the number of indexes, the number of fields, and the CPU/memory configuration. For myself, a 65Gb source indexed to 1Gb (or so) returns single term queries (oh yeah, the query makeup also matters a lot) in sub seconds on a Intel dual processor (each is 3.

Re: termquery beginners question

2006-06-26 Thread James Pine
Hey, I do not think mergeBooleanQueries is necessary. It sounds like what you want to do is this: Query userEntered = QueryParser.parse("foo bar"); Query otherQuery = new TermQuery(new Term("myfield","abc defg")); BooleanQuery completeQuery = new BooleanQuery(); completeQuery.add(userEntered,tru

Re: Searching is taking a lot...

2006-06-26 Thread Chris Hostetter
: Can you provide some information on your setup? How are you indexing : and searching? Do you have a lot of terms in your query, etc? Have you : done any profiling of your setup to determine where the bottlenecks : are? Are you sure they are in Lucene? what methods are you using for doing t

search performance benchmarks

2006-06-26 Thread Vladimir Olenin
Hi, I'm evaluating Lucene right now to use as a base for one open source project. I found some _indexing_ benchmarks on the lucene website (http://lucene.apache.org/java/docs/benchmarks.html), but, after a short browsing, couldn't find any 'runtime' performance benchmarks (Query speed). Only one

Re: Searching is taking a lot...

2006-06-26 Thread Grant Ingersoll
Can you provide some information on your setup? How are you indexing and searching? Do you have a lot of terms in your query, etc? Have you done any profiling of your setup to determine where the bottlenecks are? Are you sure they are in Lucene? -Grant heritrix.lucene wrote: Hi, I have

Searching is taking a lot...

2006-06-26 Thread heritrix . lucene
Hi, I have created an index of 47 Million documents. I have 1.28GB RAM. When i am doing a search over this index it is taking on average 25 sec. Is there a way so that i can get results in part of a second... I hope there must be some ways.. Thanks and regards..