Date search by specific month and day
Hello all! We have a situation involving date searching that I could use some seasoned opinions on. What we have is a collection of records, each containing a Solr date field by which we want search on. The catch is that we want to be able to search for items that match a specific day/month. Essentially, we're trying to implement a this day in history feature for our dataset, so that users would be able to put in a date and we'd return all matching records from the past 100 years or so. Is there a way to perform this kind of search with only the basic Solr date field? Or would I have parse out the month and day and store them in separate fields at indexing time? Thanks for the help! -Kurt
Re: Strange anomaly(?) with string matching in query
Does anybody have any further suggestions on what I might try in this
situation? Any tools perhaps that might help me put my finger on Solr's
pulse so I can figure out just what's going on in there at index and query
time?
-Kurt
Kurt Nordstrom wrote:
Changed the config so that both WordDelimiterFilterFactory settings on
both index and query use:
org.apache.solr.analysis.WordDelimiterFilterFactory
{generateNumberParts=1, catenateWords=1, generateWordParts=1,
catenateAll=0, catenateNumbers=1}
Restarted Solr, reindexed the records.
Unfortunately, no change in the search results. It still won't find that
pesky string. It seems to be generating the same results as before in the
analysis page.
Any other things I might try or diagnostics that might give useful output?
-Kurt
--
View this message in context:
http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22785313.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: solr date parsing issue
Mr. Das, Can you provide a little more details here? Helpful information would be: - The query string you're using - The fieldtype you're using for indexing the value in question. - The exact error message you're getting from Solr. Suryasnat Das wrote: Hi, I am implementing a project using SOLR in which we need to do a search based on date range. I am passing the date in SOLR date format. During formation of the SOLR query i am encoding the date string using UTF-8 encoding. After forming the whole query string i am posting the search request to SOLR by using Apache's HTTPClient class. But during posting it says invalid query. How to resolve this? please i need a resolution on a immediate basis. Thanks in advance. Regards Suryasnat Das Infosys -- View this message in context: http://www.nabble.com/solr-date-parsing-issue-tp22753196p22753613.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Strange anomaly(?) with string matching in query
Changed the config so that both WordDelimiterFilterFactory settings on both
index and query use:
org.apache.solr.analysis.WordDelimiterFilterFactory {generateNumberParts=1,
catenateWords=1, generateWordParts=1, catenateAll=0, catenateNumbers=1}
Restarted Solr, reindexed the records.
Unfortunately, no change in the search results. It still won't find that
pesky string. It seems to be generating the same results as before in the
analysis page.
Any other things I might try or diagnostics that might give useful output?
-Kurt
Otis Gospodnetic wrote:
Kurt,
Attributes for WordDelimiterFilterFactory have different values in the
index vs. query sections. Do things work if you make them identical?
(you'll have to reindex)
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
- Original Message
From: Kurt Nordstrom knordst...@library.unt.edu
To: solr-user@lucene.apache.org
Sent: Wednesday, March 25, 2009 1:33:41 PM
Subject: Re: Strange anomaly(?) with string matching in query
Otis,
Absolutely. Here are the tokenizers and filters for the text fieldtype
in
the schema. http://pastebin.com/f2bb249f3
Thanks!
That's what I suspected. Want to paste the relevant tokenizer+filters
sections of your schema? The index-time and query-time analysis has to
be
the same or compatible enough, and that's not the case here.
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
--
View this message in context:
http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22707191.html
Sent from the Solr - User mailing list archive at Nabble.com.
--
View this message in context:
http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22726833.html
Sent from the Solr - User mailing list archive at Nabble.com.
Strange anomaly(?) with string matching in query
Hello, We've encountered a strange issue in our Solr install regarding a particular string that just doesn't seem to want to return results, despite the exact same string being in the index. What makes it even stranger is that we had the same data in a previous install of Solr, and it worked there, but doesn't here. The string that's been showing the trouble is Abilene Christian College -- Students -- Yearbooks. The field, in this case, is of type text. Strangely enough, when we search for Abilene Christian College -- Students --, the relevant documents are returned. It just fails when the full string is specified. At this point, I'm a little bit stymied. Any suggestions or ideas would be highly appreciated. In order to possibly help with diagnosis, I'm including links to, hopefully, relevant outputs and configurations. We're using Solr version 1.3. This is the output of a search for the string, with debugQuery turned on. http://pastebin.com/f72c017c1 This is the output of a document containing the string in question. The field is dc_subject. http://pastebin.com/f17a2e722 Here is our current schema. http://pastebin.com/f2768bece If there's any more information or diagnostics that I can post or run, please let me know. Thanks for your help and suggestions. -Kurt -- View this message in context: http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22704639.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Strange anomaly(?) with string matching in query
Otis: Okay, I'm not sure whether I should be including the quotes in the query when using the analyzer, so I've run it both ways (no quotes on the index value). I'll try to approximate the final tables returned for each term: The field is dc_subject in both cases, being of type text *** Version 1 (With Quotes) Index Value: Abilene Christian College -- Students -- Yearbooks Query Value: Abilene Christian College -- Students -- Yearbooks Index final table: 1 2 3 4 5 abilene christian college students yearbooks Query final table: 1 2 3 4 6 abilene christian college studentsyearbooks Version 2 (Without Quotes) Index Value: Abilene Christian College -- Students -- Yearbooks Query Value: Abilene Christian College -- Students -- Yearbooks Index final table: 1 2 3 4 5 abilene christian college students yearbooks Query final table: 1 2 3 4 5 abilene christian college students yearbooks *** The main difference seems to be that there is no 5 index when I surround the string with quotes, and instead it skips to 6. This happens at the WordDelimiterFilterFactory step. It seems to me like those tokens should be returning a match, but either way, apparently they're not? Any suggestions at this point? Otis Gospodnetic wrote: Hi, Take the whole string to your Solr Admin - Analysis page and analyze it. Does it get analyzed the way you'd expect it to be analyzed? Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch -- View this message in context: http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22706495.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Strange anomaly(?) with string matching in query
Otis, Absolutely. Here are the tokenizers and filters for the text fieldtype in the schema. http://pastebin.com/f2bb249f3 Thanks! That's what I suspected. Want to paste the relevant tokenizer+filters sections of your schema? The index-time and query-time analysis has to be the same or compatible enough, and that's not the case here. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch -- View this message in context: http://www.nabble.com/Strange-anomaly%28-%29-with-string-matching-in-query-tp22704639p22707191.html Sent from the Solr - User mailing list archive at Nabble.com.
