Memory leak (JVM 1.6 only)

2007-05-15 Thread Stephen Gray
Hi everyone, I have an application that indexes/searches xml documents using Lucene. I'm having a problem with what looks like a memory leak, which occurs when indexing a large number of documents, but only when the application is running under JVM 1.6. Under JVM 1.5 there is no problem. What

number of times the keyword match

2007-05-15 Thread Anny Bridge
Hi all, When do search with lucene,can i get the number of times the keyword match with a specific document? Thanks in advance. Best Regards, Anny.

Re: number of times the keyword match

2007-05-15 Thread Grant Ingersoll
Yes, have a look at the SpanQuery functionality. -Grant On May 15, 2007, at 3:05 AM, Anny Bridge wrote: Hi all, When do search with lucene,can i get the number of times the keyword match with a specific document? Thanks in advance. Best Regards, Anny. -- Grant

Re: Memory leak (JVM 1.6 only)

2007-05-15 Thread Mark Miller
I don't have much help to offer other than to say I am also using a tweaked version of the IndexAccess code you are, with java 1.6, with hundreds of thousands to millions of docs, at multiple locations, for months -- and I have not seen any memory leaks. Leads me to think the leak may be with

Re: Memory leak (JVM 1.6 only)

2007-05-15 Thread Narednra Singh Panwar
try using -Xmx option with your Application. and specify maximum/ minimum memory for your Application. Hope this will solve you problem. On 5/15/07, Stephen Gray [EMAIL PROTECTED] wrote: Hi everyone, I have an application that indexes/searches xml documents using Lucene. I'm having a

Re: FSDirectory and merge indexes

2007-05-15 Thread Gilbert Groenendijk
Thank you for your reply. With addIndexes this works perfectly but when i change it to: writer.addIndexesNoOptimize(new Directory[] { fsd1}); It throws an exception saying it doesn't have a method with this parameters. I need a fast merge and with the optimization this is not possible and i

phrases containing escaped quotes

2007-05-15 Thread Martin Kobele
Hi, I tried to parse the following phrase: foo \bar\ I get the following exception: org.apache.lucene.queryParser.ParseException: Lexical error at line 1, column 18. Encountered: EOF after : \) Am I mistaken that foo \bar\ is a valid phrase? Thanks! Martin pgp6qEn6ntvUi.pgp Description:

Re: phrases containing escaped quotes

2007-05-15 Thread Michael Busch
Martin Kobele wrote: Hi, I tried to parse the following phrase: foo \bar\ I get the following exception: org.apache.lucene.queryParser.ParseException: Lexical error at line 1, column 18. Encountered: EOF after : \) Am I mistaken that foo \bar\ is a valid phrase? Thanks! Martin Hi

Re: phrases containing escaped quotes

2007-05-15 Thread Mark Miller
Works fine as long as you escape your query correctly -- in java code: String query = \foo \\\bar On 5/15/07, Martin Kobele [EMAIL PROTECTED] wrote: Hi, I tried to parse the following phrase: foo \bar\ I get the following exception: org.apache.lucene.queryParser.ParseException: Lexical

Re: phrases containing escaped quotes

2007-05-15 Thread Martin Kobele
thank you! I was indeed using lucene 2.0 and it works very nicely with 2.1 thanks! Martin On Tuesday 15 May 2007 09:59:42 Michael Busch wrote: Martin Kobele wrote: Hi, I tried to parse the following phrase: foo \bar\ I get the following exception:

RE: How can I limit the number of hits in my query?

2007-05-15 Thread Bruce Ritchie
Ok, you're right. It's not the limiting of the results that's the problem, it's the way the search is expanded. Since this is an autocomplete, when the user types, for example a or a Japanese character あ, I am using PrefixFilter for this, so I guess the search turns into a* and あ*

Can UID be URI or it has to be INTEGER?

2007-05-15 Thread Ram Peters
Can UID be URI or it has to be INTEGER? thnx - To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]

Re: FSDirectory and merge indexes

2007-05-15 Thread Erick Erickson
That *should* work. Can you post more of your code? Particularly the index creation code where you instantiate your index. Also, what assurance do you have that fsd1 exists? Although even if it doesn't exist the exception seems odd. Instead of just giving the name of the exception, please post

Re: Can UID be URI or it has to be INTEGER?

2007-05-15 Thread Grant Ingersoll
If by UID you mean the internal, volatile, Lucene integer used to identify docs, then, yes, it must be an integer. If by UID you mean some application specific field set on your document, then it can be whatever you want that uniquely identifies that doc. Just know Lucene knows nothing

Re: Memory leak (JVM 1.6 only)

2007-05-15 Thread Daniel Noll
On Tuesday 15 May 2007 21:59:31 Narednra Singh Panwar wrote: try using -Xmx option with your Application. and specify maximum/ minimum memory for your Application. It's funny how a lot of people instantly suggest this. What if it isn't possible? There was a situation a while back where I

Re: Memory leak (JVM 1.6 only)

2007-05-15 Thread Stephen Gray
Thanks, that narrows it down a bit. Thanks for all the replies to my question. Steve Mark Miller wrote: I don't have much help to offer other than to say I am also using a tweaked version of the IndexAccess code you are, with java 1.6, with hundreds of thousands to millions of docs, at

Concept Search

2007-05-15 Thread Charles Patridge
I have looked around on Lucene web site as well as some documentation but have not found anything to do with Concept Search. My definition of Concept Search is as follows: 1. I would have a file (list) of various phrases / N-grams which I would like to Lucene to use as a search

QueryFilter usage

2007-05-15 Thread Anna Putnam
Hi all, I am new to Lucene so I apologize if this is a really easy question. I am having trouble using the QueryFilter class. Basically, I want to narrow my search results, getting hits only for a particular category. This is what I've tried (getting no results) String line

Re: QueryFilter usage

2007-05-15 Thread James Rhodes
unsubscribe