Re: NGram for misspelt words
Have you tried the analysis window to debug. I believe you are doing something wrong in the fieldType. On Wed, Jul 18, 2012 at 8:07 PM, Husain, Yavar wrote: > Thanks Sahi. I have replaced my EdgeNGramFilterFactory to > NGramFilterFactory as I need substrings not just in front or back but > anywhere. > You are right I put the same NGramFilterFactory in both Query and Index > however now it does not return any results not even the basic one. > > -Original Message- > From: Dikchant Sahi [mailto:contacts...@gmail.com] > Sent: Wednesday, July 18, 2012 7:54 PM > To: solr-user@lucene.apache.org > Subject: Re: NGram for misspelt words > > You are creating grams only while indexing and not querying hence 'ludlwo' > would not match. Your analyzer will create the following grams while > indexing for 'ludlow': lu lud ludl ludlo ludlow and hence would not match > to 'ludlwo'. > > Either you need to create gram while querying also or use Edit Distance. > > On Wed, Jul 18, 2012 at 7:43 PM, Husain, Yavar > wrote: > > > > > > > > > I have configured NGram Indexing for some fields. > > > > Say I search for the city Ludlow, I get the results (normal search) > > > > If I search for Ludlo (with w ommitted) I get the results > > > > If I search for Ludl (with ow ommitted) I still get the results > > > > I know that they are all partial strings of the main string hence > > NGram works perfect. > > > > But when I type in Ludlwo (misspelt, characters o and w interchanged) > > I dont get any results, It should ideally match "Ludl" and provide the > > results. > > > > I am not looking for Edit distance based Spell Correctors. How can I > > make above NGram based search work? > > > > Here is my schema.xml (NGramFieldType): > > > > > stored="false" multiValued="true"> > > > > > > > > > > > > > > > > > > > > > maxGramSize="15" side="front" /> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > ** > > This message may contain confidential or > > proprietary information intended only for the use of > > theaddressee(s) named above or may contain information that is > > legally privileged. If you arenot the intended addressee, or the > > person responsible for delivering it to the intended addressee,you > > are hereby notified that reading, disseminating, distributing or > > copying this message is strictlyprohibited. If you have received > > this message by mistake, please immediately notify us byreplying > > to the message and delete the original message and any copies > > immediately thereafter. Thank you.~ > > > > ** > > > > FAFLD > > > > >
RE: NGram for misspelt words
Thanks Sahi. I have replaced my EdgeNGramFilterFactory to NGramFilterFactory as I need substrings not just in front or back but anywhere. You are right I put the same NGramFilterFactory in both Query and Index however now it does not return any results not even the basic one. -Original Message- From: Dikchant Sahi [mailto:contacts...@gmail.com] Sent: Wednesday, July 18, 2012 7:54 PM To: solr-user@lucene.apache.org Subject: Re: NGram for misspelt words You are creating grams only while indexing and not querying hence 'ludlwo' would not match. Your analyzer will create the following grams while indexing for 'ludlow': lu lud ludl ludlo ludlow and hence would not match to 'ludlwo'. Either you need to create gram while querying also or use Edit Distance. On Wed, Jul 18, 2012 at 7:43 PM, Husain, Yavar wrote: > > > > I have configured NGram Indexing for some fields. > > Say I search for the city Ludlow, I get the results (normal search) > > If I search for Ludlo (with w ommitted) I get the results > > If I search for Ludl (with ow ommitted) I still get the results > > I know that they are all partial strings of the main string hence > NGram works perfect. > > But when I type in Ludlwo (misspelt, characters o and w interchanged) > I dont get any results, It should ideally match "Ludl" and provide the > results. > > I am not looking for Edit distance based Spell Correctors. How can I > make above NGram based search work? > > Here is my schema.xml (NGramFieldType): > > stored="false" multiValued="true"> > > > > > > > > > > maxGramSize="15" side="front" /> > > > > > > > > > > > > > > > > > > > > > ** > This message may contain confidential or > proprietary information intended only for the use of > theaddressee(s) named above or may contain information that is > legally privileged. If you arenot the intended addressee, or the > person responsible for delivering it to the intended addressee,you > are hereby notified that reading, disseminating, distributing or > copying this message is strictlyprohibited. If you have received > this message by mistake, please immediately notify us byreplying > to the message and delete the original message and any copies > immediately thereafter. Thank you.~ > > ** > > FAFLD > >
Re: NGram for misspelt words
You are creating grams only while indexing and not querying hence 'ludlwo' would not match. Your analyzer will create the following grams while indexing for 'ludlow': lu lud ludl ludlo ludlow and hence would not match to 'ludlwo'. Either you need to create gram while querying also or use Edit Distance. On Wed, Jul 18, 2012 at 7:43 PM, Husain, Yavar wrote: > > > > I have configured NGram Indexing for some fields. > > Say I search for the city Ludlow, I get the results (normal search) > > If I search for Ludlo (with w ommitted) I get the results > > If I search for Ludl (with ow ommitted) I still get the results > > I know that they are all partial strings of the main string hence NGram > works perfect. > > But when I type in Ludlwo (misspelt, characters o and w interchanged) I > dont get any results, It should ideally match "Ludl" and provide the > results. > > I am not looking for Edit distance based Spell Correctors. How can I make > above NGram based search work? > > Here is my schema.xml (NGramFieldType): > > stored="false" multiValued="true"> > > > > > > > > > > maxGramSize="15" side="front" /> > > > > > > > > > > > > > > > > > > > > > **This > message may contain confidential or proprietary information intended only > for the use of theaddressee(s) named above or may contain information > that is legally privileged. If you arenot the intended addressee, or > the person responsible for delivering it to the intended addressee,you > are hereby notified that reading, disseminating, distributing or copying > this message is strictlyprohibited. If you have received this message > by mistake, please immediately notify us byreplying to the message and > delete the original message and any copies immediately thereafter. > > Thank you.~ > > ** > FAFLD > >
NGram for misspelt words
I have configured NGram Indexing for some fields. Say I search for the city Ludlow, I get the results (normal search) If I search for Ludlo (with w ommitted) I get the results If I search for Ludl (with ow ommitted) I still get the results I know that they are all partial strings of the main string hence NGram works perfect. But when I type in Ludlwo (misspelt, characters o and w interchanged) I dont get any results, It should ideally match "Ludl" and provide the results. I am not looking for Edit distance based Spell Correctors. How can I make above NGram based search work? Here is my schema.xml (NGramFieldType): **This message may contain confidential or proprietary information intended only for the use of theaddressee(s) named above or may contain information that is legally privileged. If you arenot the intended addressee, or the person responsible for delivering it to the intended addressee,you are hereby notified that reading, disseminating, distributing or copying this message is strictlyprohibited. If you have received this message by mistake, please immediately notify us byreplying to the message and delete the original message and any copies immediately thereafter. Thank you.~ ** FAFLD
