Re: Solr Autocomplete with did you means functionality handle misspell word like google
It's really simple indeed. Solr provide the SpellCheck[1] feature that allow you to do this. You have only to configure the RequestHandler and the Search Component. And of course develop a simple ui ( you can find an example in the velocity response handler Solritas[2] . Cheers [1] https://cwiki.apache.org/confluence/display/solr/Spell+Checking [2] https://cwiki.apache.org/confluence/display/solr/Velocity+Search+UI 2013/9/27 Otis Gospodnetic otis.gospodne...@gmail.com Hi, Not sure if Solr suggester can do this (can it, anyone?), but... shameless plug... I know http://sematext.com/products/autocomplete/index.html can do that. Otis -- Solr ElasticSearch Support -- http://sematext.com/ Performance Monitoring -- http://sematext.com/spm On Thu, Sep 26, 2013 at 8:26 AM, Suneel Pandey pandey.sun...@gmail.com wrote: http://lucene.472066.n3.nabble.com/file/n4092127/autocomplete.png Hi, I have implemented auto complete it's working file but, I want to implement autosuggestion like google (see above screen) . when someone typing misspell words suggestion should be show e.g: cmputer = computer. Please help me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Autocomplete-with-did-you-means-functionality-handle-misspell-word-like-google-tp4092127.html Sent from the Solr - User mailing list archive at Nabble.com. -- -- Benedetti Alessandro Visiting card : http://about.me/alessandro_benedetti Tyger, tyger burning bright In the forests of the night, What immortal hand or eye Could frame thy fearful symmetry? William Blake - Songs of Experience -1794 England
Solr Autocomplete with did you means functionality handle misspell word like google
http://lucene.472066.n3.nabble.com/file/n4092127/autocomplete.png Hi, I have implemented auto complete it's working file but, I want to implement autosuggestion like google (see above screen) . when someone typing misspell words suggestion should be show e.g: cmputer = computer. Please help me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Autocomplete-with-did-you-means-functionality-handle-misspell-word-like-google-tp4092127.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Autocomplete with did you means functionality handle misspell word like google
Hi, Not sure if Solr suggester can do this (can it, anyone?), but... shameless plug... I know http://sematext.com/products/autocomplete/index.html can do that. Otis -- Solr ElasticSearch Support -- http://sematext.com/ Performance Monitoring -- http://sematext.com/spm On Thu, Sep 26, 2013 at 8:26 AM, Suneel Pandey pandey.sun...@gmail.com wrote: http://lucene.472066.n3.nabble.com/file/n4092127/autocomplete.png Hi, I have implemented auto complete it's working file but, I want to implement autosuggestion like google (see above screen) . when someone typing misspell words suggestion should be show e.g: cmputer = computer. Please help me. - Regards, Suneel Pandey Sr. Software Developer -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Autocomplete-with-did-you-means-functionality-handle-misspell-word-like-google-tp4092127.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr autocomplete feature
Solr has an autocomplete/suggester feature: http://wiki.apache.org/solr/Suggester -- Jack Krupansky -Original Message- From: ilay Sent: Thursday, January 24, 2013 7:34 AM To: solr-user@lucene.apache.org Subject: Solr autocomplete feature Hi I want to change autocomplete implementation for our search. Current I have a suggest field whose definition in schema.xml is as below: field name=suggest type=edgytext indexed=true stored=true required=true omitNorms=false/ fieldType name=edgytext class=solr.TextField positionIncrementGap=0 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=0 splitOnCaseChange=0 splitOnNumerics=0 catenateWords=1 catenateNumbers=1 catenateAll=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=2 maxGramSize=10 / /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType It works as follows. “shoes” will match “casual shoes”, “sports shoes”, “shoes” etc. Whereas I want it to match only the values that starts with the user query. Ie. If user types “shoes”, I want suggest terms that starts with “shoes” (or) has the query string as prefix string in “suggest” filed in the index. Please let me know how to do this. Regards, Ilay -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-autocomplete-feature-tp4035927.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr autocomplete feature
Hi I want to change autocomplete implementation for our search. Current I have a suggest field whose definition in schema.xml is as below: field name=suggest type=edgytext indexed=true stored=true required=true omitNorms=false/ fieldType name=edgytext class=solr.TextField positionIncrementGap=0 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=0 splitOnCaseChange=0 splitOnNumerics=0 catenateWords=1 catenateNumbers=1 catenateAll=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=2 maxGramSize=10 / /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType It works as follows. “shoes” will match “casual shoes”, “sports shoes”, “shoes” etc. Whereas I want it to match only the values that starts with the user query. Ie. If user types “shoes”, I want suggest terms that starts with “shoes” (or) has the query string as prefix string in “suggest” filed in the index. Please let me know how to do this. Regards, Ilay -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-autocomplete-feature-tp4035927.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr autocomplete feature
Hi I want to change autocomplete implementation for our search. Current I have a suggest field whose definition in schema.xml is as below: field name=suggest type=edgytext indexed=true stored=true required=true omitNorms=false/ fieldType name=edgytext class=solr.TextField positionIncrementGap=0 analyzer type=index tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=0 splitOnCaseChange=0 splitOnNumerics=0 catenateWords=1 catenateNumbers=1 catenateAll=1/ filter class=solr.LowerCaseFilterFactory/ filter class=solr.EdgeNGramFilterFactory minGramSize=2 maxGramSize=10 / /analyzer analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType It works as follows. shoes will match casual shoes, sports shoes, shoes etc. Whereas I want it to match only the values that starts with the user query. Ie. If user types shoes, I want suggest terms that starts with shoes (or) has the query string as prefix string in suggest filed in the index. Please let me know how to do this. Regards, Ilay
Solr autocomplete keyword and geolocation based
I am looking for getting auto complete suggestions using Solr based on keyword as well as geolocation. Is there a way the 'Suggester' component or any other way, Solr can take in multiple fields for auto completion? For e.g. if I have a restaurants database and I want to get suggestions using keyword e.g. 'Piz', the results should be based both on the keyword 'Piz' and also the locations that are close to certain latitude, longitude. Is there a way to do it in Solr ? Thanks. -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-autocomplete-keyword-and-geolocation-based-tp4025466.html Sent from the Solr - User mailing list archive at Nabble.com.
solr autocomplete
Hi all, I'am using the apache-solr4.0.0, and the autocomplete feature. In general it works fine, but I still have two problems which I can't solve. In general I need the autocomplete to show a movie titles. 1. The first thing is that the autocomplete search ignores all characters after the space. For example when I search for the word the I get the the matrix and the girl next door. And when I type the m instead of getting only the matrix, the server keep returning the previous two results. It seems that the search has been proceed only fro the first token. I red a post here which says that the solution can be implementing a custom QueryConverter for it, but I also sow that there is a SuggestQueryConverter which may do the same? 2. The second problem I have is configuring an autocompletion to suggest not only movie titles starting with the searched string but also titles which has this string in the middle of the title. For example when i type tibet to get a suggestion not only for tibet and tibetan but also for seven years in tibet. Is this possible at all? Here is my configuration: schema.xml field name=title type=text_general indexed=true stored=true multiValued=true/ field name=title_autocomplete type=lowercase_de indexed=true stored=true multiValued=true / copyField source=title dest=title_autocomplete / fieldType name=lowercase_de class=solr.TextField analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory / /analyzer /fieldType config.xml searchComponent class=solr.SpellCheckComponent name=suggest lst name=spellchecker str name=namesuggest/str str name=classnameorg.apache.solr.spelling.suggest.Suggester/str str name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str str name=fieldtitle_autocomplete/str str name=fieldtitle/str /lst /searchComponent requestHandler class=org.apache.solr.handler.component.SearchHandler name=/suggest lst name=defaults str name=spellchecktrue/str str name=spellcheck.dictionarysuggest/str str name=spellcheck.onlyMorePopulartrue/str str name=spellcheck.count10/str str name=spellcheck.collatefalse/str /lst arr name=components strsuggest/str /arr /requestHandler Thank you. -- View this message in context: http://lucene.472066.n3.nabble.com/solr-autocomplete-tp4021587.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: solr autocomplete requirement
Anyone with suggestions on this? On Mon, Nov 19, 2012 at 10:13 PM, Sujatha Arun suja.a...@gmail.com wrote: Hi, Our requirement for auto complete is slightly complicated , We need two types of auto complete 1. Meta data Auto complete 2. Full text Content Auto complete In addition the metadata fields are multi-valued we need to filter the results for certain auto-complete both types After trying different approaches like 1)Suggester -We cannot filter results 2)Terms Comp - We cannot filter 3)Facets on Full text Content with Tokenized fields - Expensive 4)Same core with n-gram Indexing and storing the results and using the highlight component to fetch the snippet for autosuggest. The last approach which we are leaning towards has 2 draw backs - One- it returns duplicates data as ,some meta data is the same across documents Two- words are getting truncated at character when results are returned with highlight Mitigation for the above 2 issue could be : Remove duplicates after obtaining results at Application (issue could be additional time for this) Use fast vector highlight that can help with full word snippets (could be heavy on the Index Size) Anybody body has any suggestion / had similar requirements with successful implementation? Other question ,what would be impact of serving the suggestions out of the same core as the one we are searching while using highlight component for fetching snippets. For our full text search requirements ,we are doing the highlight outside solr, in our application and we would be storing and using the highlight , only for suggestion. Thanks Sujatha
Solr Autocomplete
Hi, I am using mysql for solr indexing data in solr. I have two fields: name and college. How can I add auto suggest based on these two fields? -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Autocomplete-tp4013859.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr Autocomplete
I am using mysql for solr indexing data in solr. I have two fields: name and college. How can I add auto suggest based on these two fields? Here is a blog post and code an example. http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/
Re: Solr Autocomplete
http://find.searchhub.org/?q=autosuggest+OR+autocomplete - Original Message - | From: Rahul Paul rahul.p...@iiitb.org | To: solr-user@lucene.apache.org | Sent: Monday, October 15, 2012 9:01:14 PM | Subject: Solr Autocomplete | | Hi, | I am using mysql for solr indexing data in solr. I have two fields: | name | and college. How can I add auto suggest based on these two fields? | | | | -- | View this message in context: | http://lucene.472066.n3.nabble.com/Solr-Autocomplete-tp4013859.html | Sent from the Solr - User mailing list archive at Nabble.com. |
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
Thanks Jan, this is perfect! I'm going to work on implementing it this week
and let you know how it works for us. Thanks again!
Dave
On Wed, Jan 25, 2012 at 1:10 PM, Jan Høydahl jan@cominvent.com wrote:
Hi,
I don't think that the suggester can output multiple fields. You would
have to encode your data in a special way with separators.
Using the separate Solr core approach, you may return whatever fields you
choose to the suggest Ajax component.
I've written up a blog post and uploaded an example to GitHub. See
http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 20:41, Dave wrote:
I've got another question for anyone that might have some insight - how
do
you get all of your indexed information along with the suggestions? i.e.
if
each suggestion has an ID# associated with it, do I have to then query
for
that ID#, or is there some way or specifying a field list in the URL to
the
suggester?
Thanks!
Dave
On Tue, Jan 3, 2012 at 9:41 AM, Dave dla...@gmail.com wrote:
Hi Jan,
Yes, I just saw the answer. I've implemented that, and it's working as
expected. I do have Suggest running on its own core, separate from my
standard search handler. I think, however, that the custom
QueryConverter
that was linked to is now too restrictive. For example, it works
perfectly
when someone enters brooklyn, n, but if they start by entering ny or
new york it doesn't return anything. I think what you're talking
about,
suggesting from whole input and individual tokens is the way to go. Is
there anything you can point me to as a starting point? I think I've got
the basic setup, but I'm not quite comfortable enough with SOLR and the
SOLR architecture yet (honestly I've only been using it for about 2
weeks
now).
Thanks for the help!
Dave
On Tue, Jan 3, 2012 at 8:24 AM, Jan Høydahl jan@cominvent.com
wrote:
Hi,
As you see, you've got an answer at StackOverflow already with a
proposed
solution to implement your own QueryConverter.
Another way is to create a Solr core solely for Suggest, and tune it
exactly the way you like. Then you can have it suggest from the whole
input
as well as individual tokens and weigh these as you choose, as well as
implement phonetic normalization and other useful tricks.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 00:52, Dave wrote:
Hi,
I'm reposting my StackOverflow question to this thread as I'm not
getting
much of a response there. Thank you for any assistance you can
provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the
DIH,
and properly returning results for queries. I'm trying to setup
another
core to run suggester, in order to autocomplete geographical
locations.
We
have a web application that needs to take a city, state / region,
country
input. We'd like to do this in a single entry box. Here are some
examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into
this
3-form input. I've setup my DIH to create a TemplateTransformer field
that
combines the 4 tables (city, state and country are all independent
tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I
type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks
them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead
of a
suggestion that matches brooklyn, ny. I've tried every solution I
can
find via google and haven't had any luck. Is there something simple
that
I've missed, or is this the wrong approach
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
Jan Høydahl / Cominvent wrote Hi, As you see, you've got an answer at StackOverflow already with a proposed solution to implement your own QueryConverter. Another way is to create a Solr core solely for Suggest, and tune it exactly the way you like. Then you can have it suggest from the whole input as well as individual tokens and weigh these as you choose, as well as implement phonetic normalization and other useful tricks. -- Jan Høydahl, search solution architect Cominvent AS - www.cominvent.com Solr Training - www.solrtraining.com On 3. jan. 2012, at 00:52, Dave wrote: Jan, Awesome autosuggester. Very flexible and something I have been looking for, for a long time. Thanx for sharing this gem! Tip: to enable phonetic searching, change phonetic field in qf to textphon. Or add phonetic as a copyfield. -- View this message in context: http://lucene.472066.n3.nabble.com/Using-SOLR-Autocomplete-for-addresses-i-e-multiple-terms-tp3627856p3698254.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
Hi,
I don't think that the suggester can output multiple fields. You would have to
encode your data in a special way with separators.
Using the separate Solr core approach, you may return whatever fields you
choose to the suggest Ajax component.
I've written up a blog post and uploaded an example to GitHub. See
http://www.cominvent.com/2012/01/25/super-flexible-autocomplete-with-solr/
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 20:41, Dave wrote:
I've got another question for anyone that might have some insight - how do
you get all of your indexed information along with the suggestions? i.e. if
each suggestion has an ID# associated with it, do I have to then query for
that ID#, or is there some way or specifying a field list in the URL to the
suggester?
Thanks!
Dave
On Tue, Jan 3, 2012 at 9:41 AM, Dave dla...@gmail.com wrote:
Hi Jan,
Yes, I just saw the answer. I've implemented that, and it's working as
expected. I do have Suggest running on its own core, separate from my
standard search handler. I think, however, that the custom QueryConverter
that was linked to is now too restrictive. For example, it works perfectly
when someone enters brooklyn, n, but if they start by entering ny or
new york it doesn't return anything. I think what you're talking about,
suggesting from whole input and individual tokens is the way to go. Is
there anything you can point me to as a starting point? I think I've got
the basic setup, but I'm not quite comfortable enough with SOLR and the
SOLR architecture yet (honestly I've only been using it for about 2 weeks
now).
Thanks for the help!
Dave
On Tue, Jan 3, 2012 at 8:24 AM, Jan Høydahl jan@cominvent.com wrote:
Hi,
As you see, you've got an answer at StackOverflow already with a proposed
solution to implement your own QueryConverter.
Another way is to create a Solr core solely for Suggest, and tune it
exactly the way you like. Then you can have it suggest from the whole input
as well as individual tokens and weigh these as you choose, as well as
implement phonetic normalization and other useful tricks.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 00:52, Dave wrote:
Hi,
I'm reposting my StackOverflow question to this thread as I'm not
getting
much of a response there. Thank you for any assistance you can provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the
DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations.
We
have a web application that needs to take a city, state / region,
country
input. We'd like to do this in a single entry box. Here are some
examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into
this
3-form input. I've setup my DIH to create a TemplateTransformer field
that
combines the 4 tables (city, state and country are all independent
tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I
type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks
them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead
of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
Hi,
As you see, you've got an answer at StackOverflow already with a proposed
solution to implement your own QueryConverter.
Another way is to create a Solr core solely for Suggest, and tune it exactly
the way you like. Then you can have it suggest from the whole input as well as
individual tokens and weigh these as you choose, as well as implement phonetic
normalization and other useful tricks.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 00:52, Dave wrote:
Hi,
I'm reposting my StackOverflow question to this thread as I'm not getting
much of a response there. Thank you for any assistance you can provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations. We
have a web application that needs to take a city, state / region, country
input. We'd like to do this in a single entry box. Here are some examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into this
3-form input. I've setup my DIH to create a TemplateTransformer field that
combines the 4 tables (city, state and country are all independent tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler
searchComponent name=suggest class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggest/str
str name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldname_autocomplete/str`br/
/lst
/searchComponent
Thanks for any assistance!
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
Hi Jan,
Yes, I just saw the answer. I've implemented that, and it's working as
expected. I do have Suggest running on its own core, separate from my
standard search handler. I think, however, that the custom QueryConverter
that was linked to is now too restrictive. For example, it works perfectly
when someone enters brooklyn, n, but if they start by entering ny or
new york it doesn't return anything. I think what you're talking about,
suggesting from whole input and individual tokens is the way to go. Is
there anything you can point me to as a starting point? I think I've got
the basic setup, but I'm not quite comfortable enough with SOLR and the
SOLR architecture yet (honestly I've only been using it for about 2 weeks
now).
Thanks for the help!
Dave
On Tue, Jan 3, 2012 at 8:24 AM, Jan Høydahl jan@cominvent.com wrote:
Hi,
As you see, you've got an answer at StackOverflow already with a proposed
solution to implement your own QueryConverter.
Another way is to create a Solr core solely for Suggest, and tune it
exactly the way you like. Then you can have it suggest from the whole input
as well as individual tokens and weigh these as you choose, as well as
implement phonetic normalization and other useful tricks.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 00:52, Dave wrote:
Hi,
I'm reposting my StackOverflow question to this thread as I'm not getting
much of a response there. Thank you for any assistance you can provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the
DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations.
We
have a web application that needs to take a city, state / region, country
input. We'd like to do this in a single entry box. Here are some
examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into
this
3-form input. I've setup my DIH to create a TemplateTransformer field
that
combines the 4 tables (city, state and country are all independent tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I
type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead
of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler
searchComponent name=suggest class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggest/str
str
name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldname_autocomplete/str`br/
/lst
/searchComponent
Thanks for any assistance!
Re: Using SOLR Autocomplete for addresses (i.e. multiple terms)
I've got another question for anyone that might have some insight - how do
you get all of your indexed information along with the suggestions? i.e. if
each suggestion has an ID# associated with it, do I have to then query for
that ID#, or is there some way or specifying a field list in the URL to the
suggester?
Thanks!
Dave
On Tue, Jan 3, 2012 at 9:41 AM, Dave dla...@gmail.com wrote:
Hi Jan,
Yes, I just saw the answer. I've implemented that, and it's working as
expected. I do have Suggest running on its own core, separate from my
standard search handler. I think, however, that the custom QueryConverter
that was linked to is now too restrictive. For example, it works perfectly
when someone enters brooklyn, n, but if they start by entering ny or
new york it doesn't return anything. I think what you're talking about,
suggesting from whole input and individual tokens is the way to go. Is
there anything you can point me to as a starting point? I think I've got
the basic setup, but I'm not quite comfortable enough with SOLR and the
SOLR architecture yet (honestly I've only been using it for about 2 weeks
now).
Thanks for the help!
Dave
On Tue, Jan 3, 2012 at 8:24 AM, Jan Høydahl jan@cominvent.com wrote:
Hi,
As you see, you've got an answer at StackOverflow already with a proposed
solution to implement your own QueryConverter.
Another way is to create a Solr core solely for Suggest, and tune it
exactly the way you like. Then you can have it suggest from the whole input
as well as individual tokens and weigh these as you choose, as well as
implement phonetic normalization and other useful tricks.
--
Jan Høydahl, search solution architect
Cominvent AS - www.cominvent.com
Solr Training - www.solrtraining.com
On 3. jan. 2012, at 00:52, Dave wrote:
Hi,
I'm reposting my StackOverflow question to this thread as I'm not
getting
much of a response there. Thank you for any assistance you can provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the
DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations.
We
have a web application that needs to take a city, state / region,
country
input. We'd like to do this in a single entry box. Here are some
examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into
this
3-form input. I've setup my DIH to create a TemplateTransformer field
that
combines the 4 tables (city, state and country are all independent
tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I
type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks
them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead
of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler
searchComponent name=suggest class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggest/str
str
name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldname_autocomplete/str`br/
/lst
/searchComponent
Thanks for any assistance!
Using SOLR Autocomplete for addresses (i.e. multiple terms)
Hi,
I'm new to SOLR, but I've got it up and running, indexing data via the DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations. We
have a web application that needs to take a city, state / region, country
input. We'd like to do this in a single entry box. Here are some examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into this
3-form input. I've setup my DIH to create a TemplateTransformer field that
combines the 4 tables (city, state and country are all independent tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler
searchComponent name=suggest class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggest/str
str name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldname_autocomplete/str`br/
/lst
/searchComponent
Thanks for any assistance!
Using SOLR Autocomplete for addresses (i.e. multiple terms)
Hi,
I'm reposting my StackOverflow question to this thread as I'm not getting
much of a response there. Thank you for any assistance you can provide!
http://stackoverflow.com/questions/8705600/using-solr-autocomplete-for-addresses
I'm new to SOLR, but I've got it up and running, indexing data via the DIH,
and properly returning results for queries. I'm trying to setup another
core to run suggester, in order to autocomplete geographical locations. We
have a web application that needs to take a city, state / region, country
input. We'd like to do this in a single entry box. Here are some examples:
Brooklyn, New York, United States of America
Philadelphia, Pennsylvania, United States of America
Barcelona, Catalunya, Spain
Assume for now that every location around the world can be split into this
3-form input. I've setup my DIH to create a TemplateTransformer field that
combines the 4 tables (city, state and country are all independent tables
connected to each other by a master places table) into a field called
fullplacename:
field column=fullplacename template=${city_join.plainname},
${region_join.plainname}, ${country_join.plainname}/
I've defined a text_auto field in schema.xml:
fieldType class=solr.TextField name=text_auto
analyzer
tokenizer class=solr.KeywordTokenizerFactory/
filter class=solr.LowerCaseFilterFactory/
/analyzer
/fieldType
and have defined these two fields as well:
field name=name_autocomplete type=text_auto indexed=true
stored=true multiValued=true /
copyField source=fullplacename dest=name_autocomplete /
Now, here's my problem. This works fine for the first term, i.e. if I type
brooklyn I get the results I'd expect, using this URL to query:
http://localhost:8983/solr/places/suggest?q=brooklyn
However, as soon as I put a comma and/or a space in there, it breaks them
up into 2 suggestions, and I get a suggestion for each:
http://localhost:8983/solr/places/suggest?q=brooklyn%2C%20ny
Gives me a suggestion for brooklyn and a suggestion for ny instead of a
suggestion that matches brooklyn, ny. I've tried every solution I can
find via google and haven't had any luck. Is there something simple that
I've missed, or is this the wrong approach?
Just in case, here's the searchComponent and requestHandler definition:
requestHandler name=/suggest
class=org.apache.solr.handler.component.SearchHandler
lst name=defaults
str name=spellchecktrue/str
str name=spellcheck.dictionarysuggest/str
str name=spellcheck.count10/str
/lst
arr name=components
strsuggest/str
/arr
/requestHandler
searchComponent name=suggest class=solr.SpellCheckComponent
lst name=spellchecker
str name=namesuggest/str
str name=classnameorg.apache.solr.spelling.suggest.Suggester/str
str
name=lookupImplorg.apache.solr.spelling.suggest.tst.TSTLookup/str
str name=fieldname_autocomplete/str`br/
/lst
/searchComponent
Thanks for any assistance!
Re: Solr AutoComplete (Suggester) - Numbers not returned
You may want to take a look at the autocomplete component using Solr with RankingAlgorithm. It allows you to do edge as well as infix search. You can get more information and also try out a demo from here: http://solr-ra.tgels.org/solr-ra-autocomplete.jsp -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-AutoComplete-Suggester-Numbers-not-returned-tp3590112p3598618.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr AutoComplete - Address Search
Just to add to it, I'm using Suggester component to implement Auto Complete http://wiki.apache.org/solr/Suggester -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-AutoComplete-Address-Search-tp3590112p3592017.html Sent from the Solr - User mailing list archive at Nabble.com.
Solr AutoComplete - Address Search
Hi, I'm trying to implement autocomplete functionality for Address search. I've used the KeywordTokenizerFactory LowerCaseFilterFactory. Problem is, when I start typing the numbers at start, I got any results from SOLR (Eg: 3500 W South). Could you please guide on this fieldType class=solr.TextField name=text_autophrase analyzer tokenizer class=solr.KeywordTokenizerFactory/ filter class=solr.LowerCaseFilterFactory/ /analyzer /fieldType Thanks, Vijay -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-AutoComplete-Address-Search-tp3590112p3590112.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: Solr + autocomplete
Thanks Ryan, This looks like the way to go. However, when I set up my schema I get, Error loading class 'solr.EdgeNGramFilterFactory'. For some reason the class is not found. I tried the stable 1.2 build and even tried the nightly build. I'm using filter class=solr.EdgeNGramFilterFactory minGramSize=1 maxGramSize=20/. Any suggestions? Thanks, Mike -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Monday, October 15, 2007 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr + autocomplete I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan
RE: Solr + autocomplete
: Error loading class 'solr.EdgeNGramFilterFactory'. For some reason EdgeNGramFilterFactory didn't exist when Solr 1.2 was released, but the EdgeNGramTokenizerFactory did. (the javadocs that come with each release list all of the various factories in that release) -Hoss
RE: Solr + autocomplete
Will I need to use Solr 1.3 with the EdgeNGramFilterFactory in order to get the autosuggest feature? -Original Message- From: Chris Hostetter [mailto:[EMAIL PROTECTED] Sent: Monday, November 12, 2007 1:05 PM To: solr-user@lucene.apache.org Subject: RE: Solr + autocomplete : Error loading class 'solr.EdgeNGramFilterFactory'. For some reason EdgeNGramFilterFactory didn't exist when Solr 1.2 was released, but the EdgeNGramTokenizerFactory did. (the javadocs that come with each release list all of the various factories in that release) -Hoss
RE: Solr + autocomplete
You should take a look at http:\\www.extjs.com. The combo box has got an autocomplete fultionality. Infact it even has paging built into it. I just did a demo using Solr for autocomplete and i got a very good responsive GUI. I have got about 100,000 documents with 26 fields each and get a response 1s Hope that helps -Bharani Park, Michael wrote: Thanks! That's a good suggestion too. I'll look into that. Actually, I was hoping someone had used a reliable JS library that accepted JSON. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Monday, October 15, 2007 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr + autocomplete I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan -- View this message in context: http://www.nabble.com/Solr-%2B-autocomplete-tf4630140.html#a13271445 Sent from the Solr - User mailing list archive at Nabble.com.
RE: Solr + autocomplete
Thx! I remember coming across extjs a ways back. It was very slick. I'll give it a try. -Original Message- From: Bharani [mailto:[EMAIL PROTECTED] Sent: Thursday, October 18, 2007 5:59 AM To: solr-user@lucene.apache.org Subject: RE: Solr + autocomplete You should take a look at http:\\www.extjs.com. The combo box has got an autocomplete fultionality. Infact it even has paging built into it. I just did a demo using Solr for autocomplete and i got a very good responsive GUI. I have got about 100,000 documents with 26 fields each and get a response 1s Hope that helps -Bharani Park, Michael wrote: Thanks! That's a good suggestion too. I'll look into that. Actually, I was hoping someone had used a reliable JS library that accepted JSON. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Monday, October 15, 2007 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr + autocomplete I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan -- View this message in context: http://www.nabble.com/Solr-%2B-autocomplete-tf4630140.html#a13271445 Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr + autocomplete
I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan
RE: Solr + autocomplete
Thanks! That's a good suggestion too. I'll look into that. Actually, I was hoping someone had used a reliable JS library that accepted JSON. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Monday, October 15, 2007 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr + autocomplete I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan
Re: Solr + autocomplete
We have been using: http://www.pengoworks.com/workshop/jquery/autocomplete.htm with good success ryan Park, Michael wrote: Thanks! That's a good suggestion too. I'll look into that. Actually, I was hoping someone had used a reliable JS library that accepted JSON. -Original Message- From: Ryan McKinley [mailto:[EMAIL PROTECTED] Sent: Monday, October 15, 2007 4:44 PM To: solr-user@lucene.apache.org Subject: Re: Solr + autocomplete I would imagine there is a library to set up an autocomplete search with Solr. Does anyone have any suggestions? Scriptaculous has a JavaScript autocomplete library. However, the server must return an unordered list. Solr does not provide an autocomplete UI, but it can return JSON that a JS library can use to populate an autocomplete. Depending on you index size/ query speed, you may be fine with a standard faceting prefix filter. If the index is large, you may want to index using the EdgeNGramFilterFactory. Check the last comment in: https://issues.apache.org/jira/browse/SOLR-357 ryan
