Re: Lucene Index File Format

2012-10-01 Thread Michael McCandless
See the javadocs for each part of the Lucene40Codec: each class details its format. Mike McCandless http://blog.mikemccandless.com On Mon, Oct 1, 2012 at 1:16 AM, Selvakumar wrote: > Hi Pranab Kumar, > > I'm not looking for reading the documents through IndexReader. > I just want to know how do

Re: Variable term weighting while indexing

2012-10-01 Thread Erick Erickson
Here's a good explanation http://searchhub.org/dev/2009/08/05/getting-started-with-payloads/ Best Erick On Sun, Sep 30, 2012 at 8:02 AM, parnab kumar wrote: > Hi Erick, > Can you please share your thoughts on the following : > Since lucene by default does vector s

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jack Krupansky
The scape merely assures that the slash will not be parsed as query syntax and will be passed directly to the analyzer, but the standard analyzer will in fact always remove it. Maybe you want the white space analyzer or keyword analyzer (no characters removed.) -- Jack Krupansky -Original

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jack Krupansky
That's "The escape merely..." -- Jack Krupansky -Original Message- From: Jack Krupansky Sent: Monday, October 01, 2012 9:58 AM To: java-user@lucene.apache.org Subject: Re: Searching for a search string containing a literal slash doesn't work with QueryParser The scape merely assures

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jochen Hebbrecht
Hi Jack, I tried analyzing through WhitespaceAnalyzer. Now I can search on my query string AND I can find my document! Great! But all my searches are now case sensitive. So when I index a field as "JavaOne", I also have to enter in my search word: "JavaOne" and not "javaone" or "javaOne". How do

Re: Variable term weighting while indexing

2012-10-01 Thread parnab kumar
Thanks Erick , I have figured out the underlying principle of working with payloads. Regards, Parnab On Mon, Oct 1, 2012 at 5:14 PM, Erick Erickson wrote: > Here's a good explanation > > http://searchhub.org/dev/2009/08/05/getting-started-with-payloads/ > > Best > Erick > > On Sun, S

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jack Krupansky
You can apply the lower case filter to the whitespace or other analyzer and use that as the analyzer. -- Jack Krupansky -Original Message- From: Jochen Hebbrecht Sent: Monday, October 01, 2012 10:34 AM To: java-user@lucene.apache.org Subject: Re: Searching for a search string containi

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jack Krupansky
Sorry, I meant apply the filter to the TOKENIZER that the analyzer uses. -- Jack Krupansky -Original Message- From: Jack Krupansky Sent: Monday, October 01, 2012 10:44 AM To: java-user@lucene.apache.org Subject: Re: Searching for a search string containing a literal slash doesn't work

Re: Searching for a search string containing a literal slash doesn't work with QueryParser

2012-10-01 Thread Jochen Hebbrecht
Jack, I wrote this custom analyzer: @Override protected TokenStreamComponents createComponents(String fieldName, Reader reader) { final Tokenizer source = new WhitespaceTokenizer(matchVersion, reader); TokenStream sink = new LowerCaseFilter(matchVersion, source); return new Token

Lucene index on NFS

2012-10-01 Thread Jong Kim
Hi, According to the Lucene In Action (Second Edition), the section 2.11.2 "Accessing an index over a remote file system" explains that there are issues related to accessing a Lucene index across remote file system including NFS. I'm particuarly interested in NFS compatibility, and wondering if t

Re: Lucene index on NFS

2012-10-01 Thread Vitaly Funstein
How tolerant is your project of decreased search and indexing performance? You could probably write a simple test that compares search and write speeds of local and NFS-mounted indexes and make the decision based on the results. On Mon, Oct 1, 2012 at 3:06 PM, Jong Kim wrote: > Hi, > > According