Best way to do date sort

2009-01-13 Thread Ganesh
I am indexing and storing date time with minute resolution. I need to do date range query and also do sorting on this field. I am having almost 30 million records spread across 20 database. option1: To index the date time as string option2: To index date, hour and minute separately as number.

Re: Best way to do date sort

2009-01-13 Thread prabin meitei
As far as I have encountered the best and simplest option is to use date time as string (mmddHHmmss or mmdd) as per your requirement. Prabin toostep.com On Tue, Jan 13, 2009 at 2:37 PM, Ganesh wrote: > I am indexing and storing date time with minute resolution. I need to do > date range

Re: Using analyzer while constructing Lucene queries

2009-01-13 Thread Ian Lea
If you are building queries manually, bypassing analysis, you just need to make sure that you know what you are doing. As a trivial example, if you are indexing with an analyzer that downcases everything then you need to pass lowercase terms to TermQuery. You can still use an analyzer where appro

Re: Using PerFieldAnalyzerWrapper with KeywordAnalyzer - MultiFieldQueryParser

2009-01-13 Thread Erick Erickson
Are you sure that you close the IndexWriter *before* you open your _Searcher in your program (it kinda looks like a test program is why I'm asking). If the above is OK, I'd really recommend getting a copy of Luke, writing your index to a FSDirectory and looking at it with Luke. Barring all that,

Re: Best way to do date sort

2009-01-13 Thread Erick Erickson
This question, along with many possible answers has been discussed many times, so there's a wealth of information in the searchable archive. The short form is "it depends". Do you want to sort? In that case storing a single field will cost you when sorting. Store the coarsest granularity you can.

ShingleMatrixFilter for synonyms

2009-01-13 Thread Angel, Eric
Does anyone have an example using this? I have a SynonymEngine that returns a an array list of strings, some of which may be multiple words. How can I incorporate this with my SynonymEngine at index time? Also, the javadoc for the ShingleMatrixFilter class says: Without a spac

Re: ShingleMatrixFilter for synonyms

2009-01-13 Thread Otis Gospodnetic
Eric, Unit tests should help you see how this can be used: ./contrib/analyzers/src/java/org/apache/lucene/analysis/shingle/ShingleFilter.java ./contrib/analyzers/src/java/org/apache/lucene/analysis/shingle/ShingleAnalyzerWrapper.java ./contrib/analyzers/src/java/org/apache/lucene/analysis/shingle

RE: ShingleMatrixFilter for synonyms

2009-01-13 Thread Angel, Eric
The unit tests don't really show how I could use it for synonyms at index time- does anyone have sample code? Is it possible? -Original Message- From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] Sent: Tuesday, January 13, 2009 3:06 PM To: java-user@lucene.apache.org Subject: Re: