Re: How to read the index in terms order

2009-11-14 Thread Michael McCandless
You can't easily change the order in which terms are enumerated from the index. They are stored in unicode code point sort order, and then TermEnum reads them back. You'll have to do your own buffering & collation on top of TermEnum which if you have alot of terms, and you really need all of

Re: IndexingChain and TermHash

2009-11-14 Thread Michael McCandless
On Fri, Nov 6, 2009 at 1:34 PM, Renaud Delbru wrote: > Hi Michael, > > Thanks for the quick fix. I have tested it (indexing multiple documents + > searching), and it seems to work. > > On 06/11/09 18:09, Michael McCandless wrote: >> >> To be honest, you are sort of forging new territory here :) >>

Max number of open IndexWriters

2009-11-14 Thread Hrishikesh Agashe
Is there any limit on how many IndexWriter can I keep open at same time? What does it depends on (RAM?) Can I keep 100 or 200 IndexWriters open in say HashMap and use them as I process documents? DISCLAIMER == This e-mail may contain privileged and confidential information which is the

synonym-group filter

2009-11-14 Thread Babak Farhang
SynonymTokenFilter, if I understand correctly, maps a given token to a set of tokens representing its synonyms. If used in the filter chain of a query analyzer, it causes a "query expansion". (Correct terminology?) If used in the filter chain of an analyzer it causes "index expansion". I was wonde

Re: Max number of open IndexWriters

2009-11-14 Thread Erick Erickson
Hmmm, why would you want to do this? What problem are you trying to address with so many readers? I ask because I'm having a hard time thinking of a reasonable use-case. Best Erick On Sat, Nov 14, 2009 at 11:35 AM, Hrishikesh Agashe < hrishikesh_aga...@persistent.co.in> wrote: > Is there any li

Re: Max number of open IndexWriters

2009-11-14 Thread Simon Willnauer
In general you should only use one single writer and use it with multiple threads. IndexWriter is optimized for concurrency and fully thread-safe. Is that what you trying to achieve? otherwise I would 100% agree with eric not knowing of a use-case. simon On Sun, Nov 15, 2009 at 12:58 AM, Erick E

Problems with fragments size on highlight.

2009-11-14 Thread Felipe Lobo
Hi, i'm having some problems with the size of the fragmentes when i'm doing the highlight. I pass on the constructor of the SimpleSpanFragmenter a size of 80, but i'm having some fragments of 500. But it only happen when i do searches with 3 or more words. What i notice is that he tries to put the