In memory indexes in clucene

2010-03-04 Thread suman . holani
Hi, I was looking into Lucene in-memory Indexes using RAMDirectory. It has also provided with something "MMapDirectory" I want the indexes to persist , so want go for FSDirectory. But to enhance the searching capability , need to put the indexes onto RAM. Now , problem is how can i synchronise b

Sharding of Indexes in clucene

2010-03-10 Thread suman . holani
Hi, Does the clucene have the concept of Sharding of Indexes. How much performance boost it provides in case of searching.Can we mention to get documents from a perticular shard only, so as to reduce the set of documents to be searched from. Regards, Suman > Oops. I was thinking solr. > > How

[Fwd: Re: Lucene 3.0 Search Performance Stats]

2010-03-22 Thread suman . holani
Hi , I am also using range based searches for dates .I am converting time to utc based seconds format and storing them to indexes. and then running range queries Is there something needed to make it more efficient. Thanks, Suman > Very nice! Thanks for sharing :) > > Mike > > On Fri, Ma

Optimising the lucene search

2010-03-23 Thread suman . holani
Hello, Optimising the lucene search Use combined search field for all text fields instead (or on the top) of indexing them separately and searching with complex query like field1:query OR field2:query ... OR fieldN:query Reducing number of field make indexing and search much faster. Use combin

using lucene from apache threads

2010-03-23 Thread suman . holani
Hi, I am using Apache threads to invoke a cgi , which is opening and closing the index searcher for every thread. for all threads , m making searches. Does that mean , for every thread the indexes would be loaded on to memory for searching. coz, then its very inefficient. Is there any method by

how lucene search works in memory

2010-03-23 Thread suman . holani
Hello, I am trying for optimizing the searching by putting indexes onto memory. RAMDirectory is not option for me, as I am transferring indexes built to slave system to use. So if u could let me know that how to place my indexes onto memory(m thinking of using mmap) .For this I wanna know how exa

Range Queries Performance Hit

2010-03-25 Thread suman . holani
Hello, Range queries are lowering down the performance of search. I am using date in my clucene application . lucene doc has these kind of fields: startdt="1242758400" enddt="1241980500" now when i am searching for searchingdate = new RangeQuery(lastyear time in seconds,current time in secon

RE: Range Queries Performance Hit

2010-03-25 Thread suman . holani
U mean I need to use padding technique in indexing and searching in order to make numeric searches rt? for numbers 1...10 indexes should be 01 0210 rather than 1 10 2.9 thanks, Suman > You should use NumericRangeQuery and NumericField (since 2.9). > > - > Uwe Schindler > H.-H.-Me

Re: Range Queries Performance Hit

2010-03-25 Thread suman . holani
Hi, Is there something of this sort provided in clucene as well..lucene for c++ ??? thanks, Suman > No. See java classes > > org.apache.lucene.search.NumericRangeQuery > org.apache.lucene.document.NumericField > > See also recent thread on this list with subject "Lucene 3.0 Search > Performan