case sensitivity

I've looked through the mailing lists and can't find much of anything regarding case sensitivity. It seems SOLR is case sensitive by default - I'm using the default settings with a very basic schema - just text fields. Is there any way to tell the query parser to be case insen

Re: case sensitivity

On Apr 26, 2007, at 5:43 PM, Michael Kimsal wrote: I've looked through the mailing lists and can't find much of anything regarding case sensitivity. It seems SOLR is case sensitive by default - I'm using the default settings with a very basic schema - just text fields. All

Re: case sensitivity

mailing lists and can't find much of anything > regarding case sensitivity. It > seems SOLR is case sensitive by default - I'm using the default > settings > with a very basic schema - just text fields. All depends on the analysis you have set up for the fields. If you'

Re: case sensitivity

. I'm still digging in to this, but are there any other things to look for anyone can point me to? (Thanks Erik!) On 4/26/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: > > > On Apr 26, 2007, at 5:43 PM, Michael Kimsal wrote: > > I've looked through the mailing

Re: case sensitivity

look for > anyone can point me to? (Thanks Erik!) > > > > > On 4/26/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: > > > > > > On Apr 26, 2007, at 5:43 PM, Michael Kimsal wrote: > > > I've looked through the mailing lists and can't find much of

Re: case sensitivity

On Apr 26, 2007, at 6:03 PM, Michael Kimsal wrote: My colleague, after some digging, found in SolrQueryParser (around line 62) setLowercaseExpandedTerms(false); The default for Lucene is true. Was this intentional? Or an oversight? I was just about to respond that this is likely the issu

Re: case sensitivity

We're (and by 'we' I mean my esteemed colleague!) working on patching a few of these items to be in the solrconf.xml file and should likely have some patches submitted next week. It's being done on 'company time' and I'm not sure about the exact policy/procedure for this sort of thing here (or in

Re: case sensitivity

On 4/26/07, Michael Kimsal <[EMAIL PROTECTED]> wrote: We're (and by 'we' I mean my esteemed colleague!) working on patching a few of these items to be in the solrconf.xml file and should likely have some patches submitted next week. It's being done on 'company time' and I'm not sure about the ex

Re: case sensitivity

Can you point me to the process for submitting these small patches? I'm looking at the jira site but don't see much of anything there outlining a process for submitting patches. Sorry to be so basic about this, but I'm trying to follow correct procedures on both sides of the aisle, so to speak.

Re: case sensitivity

Michael Kimsal wrote: Can you point me to the process for submitting these small patches? I'm looking at the jira site but don't see much of anything there outlining a process for submitting patches. Sorry to be so basic about this, but I'm trying to follow correct procedures on both sides of t

Re: case sensitivity

So I just create my own 'issue' first? OK. Thanks. On 4/27/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: Michael Kimsal wrote: > Can you point me to the process for submitting these small patches? I'm > looking at the jira site but don't see much of anything there outlining a > process for su

Re: case sensitivity

What's the procedure then for something to get included in the next release? Thanks again all! On 4/27/07, Michael Kimsal <[EMAIL PROTECTED]> wrote: So I just create my own 'issue' first? OK. Thanks. On 4/27/07, Ryan McKinley <[EMAIL PROTECTED]> wrote: > > Michael Kimsal wrote: > > Can you

Re: case sensitivity

on. Otis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Simpy -- http://www.simpy.com/ - Tag - Search - Share - Original Message From: Michael Kimsal <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Friday, April 27, 2007 1:47:06 PM Subject: Re: case sensitivity What's the procedure then

Re: case sensitivity

On 4/26/07, Erik Hatcher <[EMAIL PROTECTED]> wrote: I think we should open up as many of the switches as we can to QueryParser, allowing users to tinker with them if they want, setting the defaults to the most common reasonable settings we can agree upon. I think we should also try and handle w

Re: case sensitivity

On 4/26/07, Michael Kimsal <[EMAIL PROTECTED]> wrote: My colleague, after some digging, found in SolrQueryParser (around line 62) setLowercaseExpandedTerms(false); The default for Lucene is true. Was this intentional? Or an oversight? Way back before Solr was opensourced, and Chris

Re: case sensitivity

In our experience, setting a LowercaseFilter in the query did not work; we had to call setLowercaseExpandedTerms(true) to get wildcard queries to be case-insensitive. Here's our analyzer definition from our solr schema:

Re: case sensitivity

On 4/27/07, Michael Pelz Sherman <[EMAIL PROTECTED]> wrote: In our experience, setting a LowercaseFilter in the query did not work; we had to call setLowercaseExpandedTerms(true) to get wildcard queries to be case-insensitive. Correct, because in that case the QueryParser does not invoke anal

TextField case sensitivity

I run a problem when searching on a TextField. When I pass q=William or q=WILLiam, solr is able to find records whose default search field value is William, however if I pass q=WilliAm, solr did not return any thing. I searched on the archive, Yonik mentioned the lowercasefilterfactory doesn't work

Re: TextField case sensitivity

On 6/7/07, Xuesong Luo <[EMAIL PROTECTED]> wrote: I run a problem when searching on a TextField. When I pass q=William or q=WILLiam, solr is able to find records whose default search field value is William, however if I pass q=WilliAm, solr did not return any thing. Sounds like WordDelimiterFil

Re: TextField case sensitivity

have you taken a look the output from the admin/analysis? http://localhost:8983/solr/admin/analysis.jsp?highlight=on This lets you see what tokens are generated for index/query. From your description, I'm suspicious that the generated tokens are actually: willi am Also, if you want the same

RE: TextField case sensitivity

om: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent: Thursday, June 07, 2007 11:25 AM To: solr-user@lucene.apache.org Subject: Re: TextField case sensitivity On 6/7/07, Xuesong Luo <[EMAIL PROTECTED]> wrote: > I run a problem when searching on a TextField. When I

RE: TextField case sensitivity

Ryan, you are right, that's the problem. WilliAM is treated as two words by the WordDelimiterFilterFactory. Thanks Xuesong -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Thursday, June 07, 2007 11:30 AM To: solr-user@lucene.apache.org Subject: Re: TextField

Re: TextField case sensitivity

On 7-Jun-07, at 1:04 PM, Xuesong Luo wrote: Ryan, you are right, that's the problem. WilliAM is treated as two words by the WordDelimiterFilterFactory. I have found this behaviour a little too aggresive for my needs, so i added an option to disable it. Patch is here: http://issues.apach

Text field case sensitivity problem

I am using the following for my text field: I have a field defined as when I execute a go to the following url I get re

Re: Text field case sensitivity problem

Also of interest to me is this returns results http://localhost:8983/solr/select?defType=lucene&q=Person_Name:Kristine On Tue, Jun 14, 2011 at 5:08 PM, Jamie Johnson wrote: > I am using the following for my text field: > > positionIncrementGap="100" autoGeneratePhraseQueries="true"> >

Re: Text field case sensitivity problem

Wildcard queries aren't analyzed, I think? I'm not completely sure what the best workaround is here: perhaps simply lowercasing the query terms yourself in the application. Also - I hope someone more knowledgeable will say that the new HighlightQuery in trunk doesn't have this restriction, bu

RE: Text field case sensitivity problem

bob.sandif...@sirsidynix.com www.sirsidynix.com > -Original Message- > From: Jamie Johnson [mailto:jej2...@gmail.com] > Sent: Tuesday, June 14, 2011 5:13 PM > To: solr-user@lucene.apache.org > Subject: Re: Text field case sensitivity problem > > Also of interest to me

Re: Text field case sensitivity problem

opps, please s/Highlight/Wildcard/ On 06/14/2011 05:31 PM, Mike Sokolov wrote: Wildcard queries aren't analyzed, I think? I'm not completely sure what the best workaround is here: perhaps simply lowercasing the query terms yourself in the application. Also - I hope someone more knowledgeable

Re: Text field case sensitivity problem

So simply lower casing the works but can get complex. The query that I'm executing may have things like ranges which require some words to be upper case (i.e. TO). I think this would be much better solved on Solrs end, is there a JIRA about this? On Tue, Jun 14, 2011 at 5:33 PM, Mike Sokolov wr

Re: Text field case sensitivity problem

I wonder whether CharFilters are applied to wildcard terms? I suspect they might be. If that's the case, you could use the MappingCharFilter to perform lowercasing (and strip diacritics too if you want that) -Mike On 06/15/2011 10:12 AM, Jamie Johnson wrote: So simply lower casing the works

Re: Text field case sensitivity problem

I'm not familiar with the CharFilters, I'll look into those now. Is the solr.LowerCaseFilterFactory not handling wildcards the expected result or is this a bug? On Wed, Jun 15, 2011 at 4:34 PM, Mike Sokolov wrote: > I wonder whether CharFilters are applied to wildcard terms?  I suspect they > mi

Re: Text field case sensitivity problem

I think my answer is here... "On wildcard and fuzzy searches, no text analysis is performed on the search word. " taken from http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#Analyzers On Thu, Jun 30, 2011 at 10:23 AM, Jamie Johnson wrote: > I'm not familiar with the CharFilters, I'l

Re: Text field case sensitivity problem

Yes, after posting that response, I read some more and came to the same conclusion... there seems to be some interest on the dev list in building a capability to specify an analysis chain for use with wildcard and related queries, but it doesn't exist now. -Mike On 06/30/2011 10:34 AM, Jamie

Re: Text field case sensitivity problem

Jamie - there is a JIRA about this, at least one: Erik On Jun 15, 2011, at 10:12 , Jamie Johnson wrote: > So simply lower casing the works but can get complex. The query that I'm > executing may have things like ranges which require som

Re: Text field case sensitivity problem

Yes, and this too: https://issues.apache.org/jira/browse/SOLR-219 On 06/30/2011 12:46 PM, Erik Hatcher wrote: Jamie - there is a JIRA about this, at least one: Erik On Jun 15, 2011, at 10:12 , Jamie Johnson wrote: So simply lower c

eDisMax and Boolean operator case-sensitivity

Hi, I'm using eDisMax query parser, and need to support Boolean operators AND and OR. It seems from testing that these are *not* case sensitive, e.g. setting mm to 0, "oscar AND wilde" returns the same results as "oscar and wilde" (15 hits) while "oscar foo wilde" returns the same results as "osca

DataImportHandler - case sensitivity of column names

I encountered the problem with Oracle converting column names to upper case. As a result SolrInputDocument is created with field names in upper case and "Document [null] missing required field: id" exception is thrown ( although ID field is defined ). I do not specify "field" elements explicitly.

solr field types and case sensitivity

it's bad idea ... May be any one know good solution for this problem? -- View this message in context: http://www.nabble.com/solr-field-types-and-case-sensitivity-tp14395912p14395912.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: eDisMax and Boolean operator case-sensitivity

On 11/6/2013 11:46 AM, Tom Mortimer wrote: I'm using eDisMax query parser, and need to support Boolean operators AND and OR. It seems from testing that these are *not* case sensitive, e.g. setting mm to 0, "oscar AND wilde" returns the same results as "oscar and wilde" (15 hits) while "oscar foo

Re: eDisMax and Boolean operator case-sensitivity

Oh, good grief - I was just reading that page, how did I miss that? *derp* Thanks Shawn!!! Tom On 6 November 2013 18:59, Shawn Heisey wrote: > On 11/6/2013 11:46 AM, Tom Mortimer wrote: > >> I'm using eDisMax query parser, and need to support Boolean operators AND >> and OR. It seems from tes

documentation deficiency : case sensitivity of boolean operators

I couldn't find this anywhere on solr's docs / faq i finally found a reference on lucene http://lucene.apache.org/java/2_4_0/queryparsersyntax.html this should really be added somewhere. i'm not sure where, but I thought this was worth bringing up to the list -- as it really confuse

Re: DataImportHandler - case sensitivity of column names

On Mon, Feb 8, 2010 at 3:59 PM, Alexey Serba wrote: > I encountered the problem with Oracle converting column names to upper > case. As a result SolrInputDocument is created with field names in > upper case and "Document [null] missing required field: id" exception > is thrown ( although ID field

Re: solr field types and case sensitivity

Dryganets Sergey wrote: can I change query analyzer for concrete request to solr? ie: I want add option on my site use case-sensitive search or not for this search request, but can't find any good solution ... I think that create duplicates (index only fields with different analyzers configurati

Re: solr field types and case sensitivity

//www.nabble.com/solr-field-types-and-case-sensitivity-tp14395912p14411420.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: solr field types and case sensitivity

p;hl=true&hl.fl=post_text return nothing, request for Appl return nothing too and just Apples word return result I don't understand it ... I just remove lower case factory -- View this message in context: http://www.nabble.com/solr-field-types-and-case-sensitivity-tp14395

Case sensitivity on hostnames and email addresses

I've run into some unexpected case sensitivity on searches, at least unexpected by me. If you index a text field containing this sentence: A sentence containing CamelCase words by [EMAIL PROTECTED] is found at StudlyCaps.org The document will be found by searching for "camelcase&qu

why does "*" affect case sensitivity of query results

4387828BUL* itemModelNoExactMatchStr:4387828BULK* below are the specifics of my field and fieldType thx mark -- View this message in context: http://lucene.472066.n3.nabble.com/why-does-affect-case-sens

Solr Case-sensitivity issue with search field name

pply this change all the field on the fly not one by one ... Many many thanks in advance! Thanks, Hyrax -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Case-sensitivity-issue-with-search-field-name-tp4043800.html Sent from the Solr - User mailing list archive at Nabble.com.

How to ignore whitespace/ case sensitivity with dedupe

eld? Thanks heaps Cheers tinman -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-ignore-whitespace-case-sensitivity-with-dedupe-tp2997624p2997624.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: documentation deficiency : case sensitivity of boolean operators

: Subject: documentation deficiency : case sensitivity of boolean operators : : I couldn't find this anywhere on solr's docs / faq if you have suggestions on places to add it, feel free to update the wiki. (most of the documentation is deliberatly agnostic to the specifics of the qu

Re: documentation deficiency : case sensitivity of boolean operators

That's already linked from http://wiki.apache.org/solr/SolrQuerySyntax -Yonik http://www.lucidimagination.com On Tue, Sep 15, 2009 at 5:38 PM, Jonathan Vanasco wrote: > I couldn't find this anywhere on solr's docs / faq > > i finally found a reference on lucene >        http://lucene.apache.org

Re: Case sensitivity on hostnames and email addresses

- Original Message From: Wade Leftwich <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Wednesday, December 13, 2006 11:32:11 PM Subject: Case sensitivity on hostnames and email addresses I've run into some unexpected case sensitivity on searches, at least unexpected by me. If

Re: Case sensitivity on hostnames and email addresses

> - Original Message > From: Wade Leftwich <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Wednesday, December 13, 2006 11:32:11 PM > Subject: Case sensitivity on hostnames and email addresses > > I've run into some unexpected case sensitivity on se

Re: Case sensitivity on hostnames and email addresses

On 12/13/06, Wade Leftwich <[EMAIL PROTECTED]> wrote: I've run into some unexpected case sensitivity on searches, at least unexpected by me. If you index a text field containing this sentence: A sentence containing CamelCase words by [EMAIL PROTECTED] is found at StudlyCaps.org T

Re: Case sensitivity on hostnames and email addresses

ade Leftwich <[EMAIL PROTECTED]> wrote: > I've run into some unexpected case sensitivity on searches, at least > unexpected by me. > > If you index a text field containing this sentence: > > A sentence containing CamelCase words by [EMAIL PROTECTED] is found > at Stu

Re: why does "*" affect case sensitivity of query results

gt; below are the specifics of my field and fieldType > >stored="true"/> > > > positionIncrementGap="100"> > > > > > > > > > > > > thx

Re: why does "*" affect case sensitivity of query results

ntly, don't stem. << thx mark -- View this message in context: http://lucene.472066.n3.nabble.com/why-does-affect-case-sensitivity-of-query-results-tp4059801p4059812.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: why does "*" affect case sensitivity of query results

here is the jira link: https://issues.apache.org/jira/browse/SOLR-219 -- View this message in context: http://lucene.472066.n3.nabble.com/why-does-affect-case-sensitivity-of-query-results-tp4059801p4059814.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: why does "*" affect case sensitivity of query results

; > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/why-does-affect-case-sensitivity-of-query-results-tp4059801p4059814.html > Sent from the Solr - User mailing list archive at Nabble.com.

Re: why does "*" affect case sensitivity of query results

hello erik, thank you for the info - yes - i did notice ;) one more reason for us to upgrade from 3.5. thx mark -- View this message in context: http://lucene.472066.n3.nabble.com/why-does-affect-case-sensitivity-of-query-results-tp4059801p406.html Sent from the Solr - User mailing

Re: Solr Case-sensitivity issue with search field name

On 2/28/2013 3:40 PM, hyrax wrote: I'm using Solr 4.0 and I recently notice an issue that bothers me a lot which is that if you define a field in your schema named 'HOST' then in the query you have to specify this field by 'HOST' while if you used 'host' it would throw an 'undefined field' error.

Re: Solr Case-sensitivity issue with search field name

Lower case is safer than upper case. For unicode, uppercasing is a lossy conversion. There are sets of different lower case characters that convert to the same upper case character. When you convert back to lower case, you don't know which one it was originally. Always use lower case for text.

Re: Solr Case-sensitivity issue with search field name

Hi Shawn, Thanks for your reply. So you mean the field name can't be case insensitive when specifies in a query? I'm gonna stop doing research on this issue if this is confirmed... Thanks, Hyrax -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Case-sensiti

Re: Solr Case-sensitivity issue with search field name

Hyrax -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Case-sensitivity-issue-with-search-field-name-tp4043800p4044010.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How to ignore whitespace/ case sensitivity with dedupe

(11/05/29 8:47), tinman wrote: Hi all, I've followed the instructions at this link http://wiki.apache.org/solr/Deduplication and got the basic dedupe field working. However, it doesn't seem to recognize case differences or white space differences even thought I've defined the type of the fields

Re: How to ignore whitespace/ case sensitivity with dedupe

as I want to use field collapsing for removing dedupe at query time. Thanks tinman -- View this message in context: http://lucene.472066.n3.nabble.com/How-to-ignore-whitespace-case-sensitivity-with-dedupe-tp2997624p2997738.html Sent from the Solr - User mailing list archive at Nabble.com.

Redundant indexing * 4 only solution (for par/sen and case sensitivity)

Hi all, Using SOLR, I believe I have to index the same content 4 times (not desirable) into 2 indexes -- and I don't know how you can practically do multiple indexes in SOLR (if indeed there is no better solution than 4 indexing runs into two indexes? My need is case-sensitive and case insensi

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

So now I have: (1) 4X in content indexing (2) 2X in actual SOLR/Lucene indices (3) I don't know how to practically due multiple indices using SOLR? If there is a better way of attacking this problem, I would appreciate recommendations!!! I don't quite follow your current approach, but it so

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

such an approach make querying difficult under the following condition: ? The app that I am replacing (and trying to enhance) has the ability to search multiple books at once with sen/par and case sensitivity settings individually selectable per book (e.g. default search modes per book). So

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

u automatically. > The app that I am replacing (and trying to enhance) has the ability to search > multiple books at once > with sen/par and case sensitivity settings individually selectable per book You could easily select case sensitivity or not *per query* across all books. You should st

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

David Neubert wrote: Ryan, Thanks for your response. I infer from your response that you can have a different analyzer for each field yes! each field can have its own indexing strategy. I believe that the Analyzer approach you suggested requires the use of the same Analzyer at query time

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

read up on the payload discussion? Dave - Original Message From: Ryan McKinley <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Saturday, November 10, 2007 5:00:43 PM Subject: Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity) David Neube

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

: Redundant indexing * 4 only solution (for par/sen and case sensitivity) On Nov 10, 2007 4:24 PM, David Neubert <[EMAIL PROTECTED]> wrote: > So if I am hitting multiple fields (in the same search request) that invoke different Analyzers -- am I at a dead end, and have to result to c

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

indexing * 4 only solution (for par/sen and case sensitivity) On Nov 10, 2007 4:24 PM, David Neubert <[EMAIL PROTECTED]> wrote: So if I am hitting multiple fields (in the same search request) that invoke different Analyzers -- am I at a dead end, and have to result to consequeti

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

oad discussion? > > Dave > > > > > - Original Message > From: Ryan McKinley <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Saturday, November 10, 2007 5:00:43 PM > Subject: Re: Redundant indexing * 4 only solution (for par/sen and ca

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

- From: Erik Hatcher <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Sunday, November 11, 2007 5:21:45 AM Subject: Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity) Solr query syntax is documented here: <http://wiki.apache.org/solr/ SolrQuerySyntax>

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

- Original Message From: Erick Erickson <[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Monday, November 12, 2007 2:11:14 PM Subject: Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity) DISCLAIMER: This is from a Lucene-centric viewpoint. That said, this

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

On Nov 12, 2007 2:20 PM, David Neubert <[EMAIL PROTECTED]> wrote: > Erik - thanks, I am considering this approach, verses explicit redundant > indexing -- and am also considering Lucene - There's not a well defined solution in either IMO. > - problem is, I am one week into both technologies (tho

Re: Redundant indexing * 4 only solution (for par/sen and case sensitivity)

: > - problem is, I am one week into both technologies (though have years in the search space) -- wish I could : > go to Hong Kong -- any discounts available anywhere :) : : Unfortunately the OS Summit has been canceled. Or rescheduled to 2008 ... depending on wether you are a half-empty / hal