Cannot overwrite "_0.fdt" file

2009-12-22 Thread TejKiran
Hi, I am indexing some data and then searching on indexed data to find then doing some action on that. while i close the application, i am deleting these indexed data from TempIndex folder like here "20091019237559". and for deleting i am maintaining list of which file/folder created in current ru

Re: Lucene' results paging

2009-12-22 Thread Антон Кириллов
Thanks for your answer. But how should I get the total nubmer of search results in this case? On Mon, Dec 21, 2009 at 6:51 PM, Ian Lea wrote: > Hi > > > The standard approach to paging is just to do the search again and > pick out the docs you want, along the lines you outline.  You cannot > pass

RE: Lucene' results paging

2009-12-22 Thread Uwe Schindler
Ist inside TopDocs class as a getter method. - Uwe Schindler H.-H.-Meier-Allee 63, D-28213 Bremen http://www.thetaphi.de eMail: u...@thetaphi.de > -Original Message- > From: Антон Кириллов [mailto:antonv.kiril...@gmail.com] > Sent: Tuesday, December 22, 2009 1:05 PM > To: java-user@lu

Re: Cannot overwrite "_0.fdt" file

2009-12-22 Thread Michael McCandless
Likely you still have an old IndexWriter open on the index, when you are attempting to use a new IndexWriter? Try turning on IndexWriter.setInfoStream, and look for confirmation that all opened writers get closed? Mike On Tue, Dec 22, 2009 at 7:00 AM, TejKiran wrote: > > Hi, > I am indexing som

Re: PayloadNearQuery

2009-12-22 Thread Grant Ingersoll
What is the problem you are trying to solve? Is this something to do with weighting the head of a noun phrase? My guess is you will have to write your own PayloadQuery. -Grant On Dec 21, 2009, at 4:47 PM, Elias Khsheibun wrote: > You are right, that is the behavior that I'm getting, any othe

Lucene going non-responsive under heavy load

2009-12-22 Thread Siraj Haider
Hello guys, We have a dilemma on a few of our lucene machines. We have a tomcat running our servlets for searching and indexing on each of these machines. Its a live index where documents are being added to index while online searches are also being served at the same time. Indexing happens

Re: Lucene going non-responsive under heavy load

2009-12-22 Thread Michael McCandless
Is it possible a large merge is running? You can turn on IndexWriter.setInfoStream to see more details about what IW is doing, including merging. Mike On Tue, Dec 22, 2009 at 5:19 PM, Siraj Haider wrote: > Hello guys, > We have a dilemma on a few of our lucene machines.  We have a tomcat runnin

RE: Lucene going non-responsive under heavy load

2009-12-22 Thread Uwe Schindler
If it suddenly gets unresponsive, you may have a GC (garbage collector) problem. Can you post your Java options, Java VM version, max heap and so on. Maybe you are doing some strange things. For us the best GC to use (we have Java 1.5) was the "Parallel New GC" / "The Concurrent Low Pause Collecto

Re: Lucene going non-responsive under heavy load

2009-12-22 Thread Siraj Haider
Hi Mike, You are right, sometimes there is an implicit merge running when the machine goes non-responsive. How can we avoid running those merges during the day and how can we minimize the effect it will have on searches? -siraj Michael McCandless wrote: Is it possible a large merge is runni

Re: Lucene going non-responsive under heavy load

2009-12-22 Thread Siraj Haider
Hi Uwe, Following are the info: Java VM: "1.6.0_05" Java Options: -server -Xms512m -Xmx2048m We are not using any specific GC. regards -siraj Uwe Schindler wrote: If it suddenly gets unresponsive, you may have a GC (garbage collector) problem. Can you post your Java options, Java VM version, m

Re: Lucene going non-responsive under heavy load

2009-12-22 Thread Michael McCandless
A merge shouldn't make the machine completely non-responsive, just, slower to run searches / index documents. What kind of machine / IO system is this? You can set maxMergeDocs to limit how large the merge is allowed to be. But, be careful, since if you set this too small you'll wind up with way

Need help with XML Query Parser example in Lucene 3.0

2009-12-22 Thread syedfa
Dear fellow Java developers: I am trying to run the XML Query Parser example that comes with Lucene 3.0 source distribution. I have the application structured identical to the one you download, and I am trying to run it in eclipse. When I launch the application, fill out the form that appears o

Re: Need help with XML Query Parser example in Lucene 3.0

2009-12-22 Thread syedfa
I have found an error in the web.xml file, however, this DID NOT fix the problem. Inside the web.xml file, there is the following snippet: Default field used in standard Lucene QueryParser used in UserQuery tag defaultSta

Lucene Index size v/s available memory

2009-12-22 Thread Shakti Purohit
We are required to find out how much percentage/part of lucene index needs to be in memory for acceptable search response time. The index size we have is around 100 GB while the available memory is 24 GB. Since we do not have the option of loading whole of the index in memory we wanted to know w