another question about update an unidexed field.

2007-04-18 Thread Omar Didi
Hi all, Before posting this question I have read a couple of old threads on this list on ways to update an existing index. the conclusion was to recreate a new index. unfortunalty this may not be possible in my case (please correct me if I am wrong). let me first describe what I am having

RE: IndexSearcher in Servlet

2006-06-27 Thread Omar Didi
you can initiliaze your IndexSearcher in a Servlet Listner, and even warm it up with few queries. that way when the user sends the first query it won't take a long time to load the index in RAM. -Original Message- From: Fabrice Robini [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 27,

searching multiple indexes in multiple servers.

2006-06-09 Thread Omar Didi
Hi all, my index size has grown too much and I keep getting outOfMemoryError after running few searches. I am using all the RAM that the JVM is allowing me 2.6GB. I am left with two solutions now, the easy and expensive solution is to upgrade the hardware to a 64-bit System and use more RAM.

RE: spring lucene

2006-06-06 Thread Omar Didi
have a look at spring module 0.3. it has a lucene module which contains many interesting classes LuceneIndexTemplate, LuceneSearchTemplate, and all kind of factotires following spring concepts. here is the url to the documentation: http://www.springframework.org/node/270 -Original

best way to get specific results

2006-05-25 Thread Omar Didi
Hi all, I need to be able to get specific documents out of the returned documents without the need to retrieve all the other documents. just to describe my case, the user is allowed to specify in the queryString the page number and number of results to return. for example if a query returns

RE: Checking for duplicates inside index

2006-05-22 Thread Omar Didi
you have two choices that I can think of: 1- before adding a document, check if it does't exist in the index. you can do this by querying on a unique field if you have it . 2- you can index all your documents, and once the indexing is done you can dedupe. (Lucene has built in methods that can

RE: index merging

2006-02-15 Thread Omar Didi
I have tried to use the isCurrent() method IndexReader to figure out if an index is merging. but since I have to do this evrytime I need to add a document, the performance got s slow. here is what I am doing, I create 4 indexs and I am running with 4 threads. I do a round robbin on the

RE: index merging

2006-02-02 Thread Omar Didi
high so that merges will never happen, and set maxBufferedDocs to the size of the segments you want. -Yonik On 2/2/06, Omar Didi [EMAIL PROTECTED] wrote: Hi all, I am trying to index in 2 different indexes with different mergefactors. so if one of the indexes is merging than I want to index

RE: TooManyClauses in BooleanQuery

2005-06-13 Thread Omar Didi
if you get an OutOfMemoryException, I beleive the only thing you can do is just increase the JVM heap to a larger size. -Original Message- From: Harald Stowasser [mailto:[EMAIL PROTECTED] Sent: Monday, June 13, 2005 8:28 AM To: java-user@lucene.apache.org Subject: Re: TooManyClauses in

RE: Cannot search on plain numbers

2005-06-07 Thread Omar Didi
this depends on the analyzer you are using, use luke and check that numbers are actually in the index. if not then use an analyzer that does index numbers. omar -Original Message- From: Daniel Naber [mailto:[EMAIL PROTECTED] Sent: Tuesday, June 07, 2005 4:27 PM To:

RE: Deleting duplicates from a Lucene index

2005-05-27 Thread Omar Didi
what you can do is open the index and loop through all the documents in decending order. the code below will explain more. Directory dir = FSDirectory.getDirectory( args[ 0 ], false ); IndexReader reader = IndexReader.open( dir ); int numDocs = reader.numDocs(); HashSet items = new HashSet(

indexing to multiple indexes

2005-05-03 Thread Omar Didi
Hi guys, I am writing an indexing applications that writes to 4 different indexes. the way it work is the following: I write to one index every 1 documents and then close that index and call optimize() as well, at the same time I write to the second index and close it after 1 docs and

fields that are indexed as UnStored

2005-04-20 Thread Omar Didi
Hi guys, If a field is indexed as UnStored how can I get it value? I tried document.get(UnStored_field) it returns null. thanks -Original Message- From: Kevin L. Cobb [mailto:[EMAIL PROTECTED] Sent: Wednesday, April 20, 2005 8:52 AM To: java-user@lucene.apache.org Subject: RE: Best way

filter search

2005-04-04 Thread Omar Didi
hi guys, is it possible to filter the hits returned from a certain query?. for example if I have a search like this: Query searchQuery = queryParser.parse( query ); Hits results = m_searcher.search( searchQuery ); is there a way to use the results and find out how many of the

Performance Question

2005-04-01 Thread Omar Didi
I have 5 indexes, each one is 6GB...I need 512MB of Heap size in order to open the index and have all type of queries. My question is, is it better to just have on large Index 30GB? will increasing the Heap size increase performance? can I store an instance of MultiSearcher(OR just Searcher in

RE: error when query contains numbers

2005-03-31 Thread Omar Didi
PROTECTED] Sent: Wednesday, March 30, 2005 8:58 PM To: java-user@lucene.apache.org Subject: Re: error when query contains numbers On Mar 30, 2005, at 8:05 PM, Omar Didi wrote: the .toString() looks excactly like the query I enter: if I search for yahoo AND 200 it returns 0 hits. I am sure

searcher question

2005-03-30 Thread Omar Didi
I am having a large index (100GB) and when i run the following code : String indexLocation = servlet.getServletContext().getInitParameter( com.lucene.index ); logger.log( Level.INFO, got the index location from: + indexLocation ); searcher = new IndexSearcher(indexLocation); logger.log(

RE: searcher question

2005-03-30 Thread Omar Didi
: Wednesday, March 30, 2005 1:59 PM To: java-user@lucene.apache.org Subject: Re: searcher question Omar Didi wrote: I am having a large index (100GB) and when i run the following code : String indexLocation = servlet.getServletContext().getInitParameter( com.lucene.index ); logger.log( Level.INFO

error when query contains numbers

2005-03-30 Thread Omar Didi
hi guys, I am using a QueryParser to search the index. when the query has numbers, i don t get any results?? any suggestions?? - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

RE: error when query contains numbers

2005-03-30 Thread Omar Didi
[mailto:[EMAIL PROTECTED] Sent: Wed 3/30/2005 8:58 PM To: java-user@lucene.apache.org Subject: Re: error when query contains numbers On Mar 30, 2005, at 8:05 PM, Omar Didi wrote: the .toString() looks excactly like the query I enter: if I search for yahoo AND 200 it returns 0 hits. I am sure

RE: error when query contains numbers

2005-03-30 Thread Omar Didi
am just developing an aplication to search using the analyzer that was used while indexing. my concern now is if there is an error with the way the indexing was do I have to reindex the documents? thanks On Mar 30, 2005, at 4:41 PM, Omar Didi wrote: I am using a QueryParser to search the index

Re: Result grouping

2005-03-29 Thread omar didi
Hi all, I am running a search on a large index (100GB), my search consists of 10 booleanQueries that run at the same time and their results is combined to display the results. the first problem is it is very slow, but that is normal i guess for such a big index, the problem i have been having

java.lang.OutOfMemoryException

2005-03-29 Thread omar didi
Hi all, I am running a search on a large index (100GB), my search consists of 10 booleanQueries that run at the same time and their results is combined to display the results. the first problem is it is very slow, but that is normal i guess for such a big index, the problem i have been having