Re: Java Heap Space -Out Of Memory Error

HI testn, 1.I optimize the Large Indexes of size 10 GB using Luke.it optimize all the content into a single CFS file and it generates segments.gen and segments_8 file when i search the item it shows an error that segments file is not there.could you help me in this testn wrote:

Re: regarding FieldSelector

Thanks as I saw the documents, we can only use this great field selector in IndexReader.document() method the problem is I have a Searcher in my result set structure and when the client calls getString(a_field_name) at that time I invoke the searcher.doc(current_doc_id).get(a_field_name), I

OutOfMemoryError: allocLargeArray

I got this intermittent stacktrace 3 times in a month from using Lucene with JRockIt. Has anyone ever seen this in Lucene 2.2? java.lang.OutOfMemoryError: allocLargeArray at org.apache.lucene.util.PriorityQueue.initialize(PriorityQueue.java:36) at

Re: Java Heap Space -Out Of Memory Error

What is the error message? Probably Mike, Erick or Yonik can help you better on this since I'm no one in index area. Sebastin wrote: HI testn, 1.I optimize the Large Indexes of size 10 GB using Luke.it optimize all the content into a single CFS file and it generates

Re: Tokenization question

If I'm understanding you correctly, the answer is... maybe, kinda. Take a look at some of the Luke code. That tries to reconstruct document fields from the index, but it's lossy. So it depends upon what kind of fidelity you need. Erick On 9/12/07, Dan Luria [EMAIL PROTECTED] wrote: If I have a

Re: regarding FieldSelector

Do you have any evidence that you're having a performance issue? If not, I'd just do the simple thing and ignore the rest. The performance issues I found were because I was spinning through many, many documents. If you're only worrying about one document at a time, it may not be an issue. If you

Problem in building Lucene

I have to change lucene code for some reason. I changed the source code of the lucene and ran the ant command on build.xml. it created a jar file in build directory then i added the jar file to my project in eclipse . I am facing a bizarre problem now. Changes i have made in source code are not

Re: regarding FieldSelector

well, actually, I have 5 index directory and it will increase in future. and the thing is that each document about 20 fields on average. considering many users may connect to the system (we anticipate 500 users at this time) I want to know whether this will make performance issue or not. we

Re: Java Heap Space -Out Of Memory Error

java.io.IoException:File Not Found- Segments is the error message testn wrote: What is the error message? Probably Mike, Erick or Yonik can help you better on this since I'm no one in index area. Sebastin wrote: HI testn, 1.I optimize the Large Indexes of size 10 GB

Re: Java Heap Space -Out Of Memory Error

Should the file be segments_8 and segments.gen? Why is it Segment? The case is different. Sebastin wrote: java.io.IoException:File Not Found- Segments is the error message testn wrote: What is the error message? Probably Mike, Erick or Yonik can help you better on this since I'm no

Re: Java Heap Space -Out Of Memory Error

It sounds like there may be a Lucene version mismatch? When Luke was used it was likely based on Lucene 2.2, but it sounds like an older version of Lucene is now being used to open the index? Mike testn [EMAIL PROTECTED] wrote: Should the file be segments_8 and segments.gen? Why is it

Re: Java Heap Space -Out Of Memory Error

Hi testn, i wrote the case wrongly actually the error is java.io.ioexception file not found-segments testn wrote: Should the file be segments_8 and segments.gen? Why is it Segment? The case is different. Sebastin wrote: java.io.IoException:File Not Found- Segments is

Re: Java Heap Space -Out Of Memory Error

As Mike mentioned, what is the version of Lucene you are using? Plus can you also post the stacktrace? Sebastin wrote: Hi testn, i wrote the case wrongly actually the error is java.io.ioexception file not found-segments testn wrote: Should the file be segments_8 and

Re: Problem in building Lucene

Also, ensure that you didn't inadvertently add an older version of your Jar file somewhere in your classpath. Eclipse will take the first it comes to, and skip any others found later on in the path. Right Click on your Project - Properties - Java Build Path and ensure you don't have an older

Treating values of numeric fields as numbers

Hi All, I have made some changes in my Lucene source, so that values of numeric fields to be treated as numbers but not as Strings. After testing everything seems to work correctly, but I still would like to know your opinion about this. So my approach is the following: 1. As during the

Re: regarding FieldSelector

I'm not entirely sure. So what I'd do if I were you is write a little test program and step through it in the debugger and see G But, if you're only allowing the user to fetch a single document at a time, I don't think it matters enough to worry about. If, on the other hand, you're allowing

Re: search results with sort

:I have this exception there are more terms than documents in field : Title, but it's impossible to sort on tokenized fields. : :I'm try to sort the result by Title and the field title is un_tokenized : and it has only one term such as document, 06, rational, etc, and some other : fields

Re: Tokenization question

On 13-Sep-07, at 12:37 PM, Dan Luria wrote: What I do is Doc1 = source_doc Doc2 = new Document() foreach (field f in doc1.getfields) { Doc2.Add(new Field(doc1.getField(key), doc1.getField(value)); } but when i pull the fields from Doc1, i never get the tokenized field.. it just doesnt

Re: search results with sort

Hi, Thanks. However, I tested with more terms in title field, for instance, lucene sort, abc_def, and that works. I deleted the old index file and re-index the whole documents again, and it works fine. So, I'm little bit confuse about how that really work. Please advise. -- View

Re: Treating values of numeric fields as numbers

Ivan - have you considered using NumberUtils? http://lucene.zones.apache.org:8080/hudson/job/Lucene-Nightly/ javadoc/org/apache/lucene/document/NumberTools.html I'm curious if those utility methods solve the same problem you're working on. Erik On Sep 13, 2007, at 1:19 PM,

Re: Lucene

Hi I want to use Apache Lucene to do a full text search for Postgresql. May i know the set up requirements and if it supports postgresql -- Devinder -- Devinder

Re: Lucene

Hi, Devinder, Lucene is agnostic of any database configuration. You need to pull data via jdbc out, and feed it to Lucene to create an index file, and then use Lucene API to search on it. -- Chris Lu - Instant Scalable Full-Text Search On Any Database/Application site:

Re: Lucene

Hi Chris Thanks do you also have a channel on IRC so we wan communicate. Devinder On 14/09/2007, Chris Lu [EMAIL PROTECTED] wrote: Hi, Devinder, Lucene is agnostic of any database configuration. You need to pull data via jdbc out, and feed it to Lucene to create an index file, and then

Re: Lucene

I want to know what type of setup i need to get started with Lucene. Do i need Java and Apache Tomcat on Windows XP. Devinder On 14/09/2007, Devinder Singh [EMAIL PROTECTED] wrote: Hi Chris Thanks do you also have a channel on IRC so we wan communicate. Devinder On 14/09/2007, Chris

Re: Java Heap Space -Out Of Memory Error

It works finally .i use Lucene 2.2 in my application.thanks testn and Mike Michael McCandless-2 wrote: It sounds like there may be a Lucene version mismatch? When Luke was used it was likely based on Lucene 2.2, but it sounds like an older version of Lucene is now being used to open the