RE: Query regarding Spelling Suggestions
Hi Grant,
My spellcheck is now working fine with the following configuration:
searchComponent name=spellcheck class=solr.SpellCheckComponent
lst name=spellchecker
str name=fieldTypeword/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str
name=sourceLocationd:\solr-tomcat\solr\data\syn_index/str
str name=spellcheckIndexDir./spellcheckerFile1/str
/lst
/searchComponent
Earlier I configured the lucene-index (dictionary) syn_index to the
spellcheckIndexDir as interpreted from the wiki page.
Then I was looking into the file IndexBasedSpellChecker.java and found
the usage of sourceLocation.
When I configured my lucene-index (dictionary) syn_index as
sourceLocation the IndexBasedSpellChecker worked.
I have following question / observation : (just to ensure that my
configurations are correct)
The lucene-index (dictionary) syn_index is already an index so do we
have to specify the spellcheckIndexDir again?
(If I do not give the spellcheckIndexDir I do not get any
suggestions.)
When I give the build command the spellcheckIndexDir gets populated
reading the syn_index. Can we avoid this duplication?
If the sourceLocation is mandatory when using a third party index for
spelling suggestions, may I update the Solr WIKI to include this
important information.
Thanks Best Regards,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Monday, January 12, 2009 10:15 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Solr 1.3 doesn't use Log4J, it uses Java Utility Logging (JUL). I
believe the info level in the logs is sufficient. Let's start by
posting what you have?
Also, are you able to get the sample spellchecking to work?
On Jan 12, 2009, at 2:16 AM, Deshpande, Mukta wrote:
Hi,
Could you please send me the needful entries in log4j.properties to
enable logging, explicitly for SpellCheckComponent.
My current log4j.properties looks like:
log4j.rootLogger=INFO,console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd
HH:mm:ss} %p
%c{2}: %m%n
log4j.logger.org.apache.solr=DEBUG
With these settings I can only see the INFO level logs.
I tried to change the log level for SpellCheckComponent to FINE
using
the admin logging page http://localhost:8080/solr/admin/logging but
did not see any difference in logging.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Monday, January 12, 2009 3:22 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you send the full log?
On Jan 11, 2009, at 1:51 PM, Deshpande, Mukta wrote:
I am using the example schema that comes with the Solr installation
downloaded from http://www.mirrorgeek.com/apache.org/lucene/solr/.
I have added the word field with textSpell fieldtype in the
schema.xml file, as specified in the below mail.
My spelling index exist under SOLR HOME/data/ If I open my index in
Luke I can see the entries against word
field.
Thanks,
~Mukta
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Fri 1/9/2009 8:29 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?
q=documnetspellcheck=truespellch
eck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field
word
and stored in location solr-home/data/syn_index, using
syns2Index.java
Re: Query regarding Spelling Suggestions
On Tue, Jan 13, 2009 at 5:16 PM, Deshpande, Mukta mudes...@ptc.com wrote: I have following question / observation : (just to ensure that my configurations are correct) The lucene-index (dictionary) syn_index is already an index so do we have to specify the spellcheckIndexDir again? (If I do not give the spellcheckIndexDir I do not get any suggestions.) The syn_index here is your Lucene index from which you want to use as the source for words. Spell checker processes each token to create n-grams which are then stored into a lucene index at the spellCheckIndexDir or in memory. This is why you need to specify both sourceLocation and spellcheckIndexDir. If you do not give spellCheckIndexDir, spell checker will create a Lucene index in-memory, so it should still work. Are you sure you gave a build command before issuing the query? When I give the build command the spellcheckIndexDir gets populated reading the syn_index. Can we avoid this duplication? Spell checker needs a Lucene index to work. It creates a new one and adds tokens after some processing to this index. There is no way to avoid creation of another index at present. However, it should be possible to modify it to store it's fields inside an existing Lucene index (maybe even Solr's own index). Contributions are always welcome :) If the sourceLocation is mandatory when using a third party index for spelling suggestions, may I update the Solr WIKI to include this important information. Sure, please go ahead. Thanks! -- Regards, Shalin Shekhar Mangar.
RE: Query regarding Spelling Suggestions
Thanks all for the help and information. Best Regards, ~Mukta -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Tuesday, January 13, 2009 6:50 PM To: solr-user@lucene.apache.org Subject: Re: Query regarding Spelling Suggestions On Tue, Jan 13, 2009 at 5:16 PM, Deshpande, Mukta mudes...@ptc.com wrote: I have following question / observation : (just to ensure that my configurations are correct) The lucene-index (dictionary) syn_index is already an index so do we have to specify the spellcheckIndexDir again? (If I do not give the spellcheckIndexDir I do not get any suggestions.) The syn_index here is your Lucene index from which you want to use as the source for words. Spell checker processes each token to create n-grams which are then stored into a lucene index at the spellCheckIndexDir or in memory. This is why you need to specify both sourceLocation and spellcheckIndexDir. If you do not give spellCheckIndexDir, spell checker will create a Lucene index in-memory, so it should still work. Are you sure you gave a build command before issuing the query? When I give the build command the spellcheckIndexDir gets populated reading the syn_index. Can we avoid this duplication? Spell checker needs a Lucene index to work. It creates a new one and adds tokens after some processing to this index. There is no way to avoid creation of another index at present. However, it should be possible to modify it to store it's fields inside an existing Lucene index (maybe even Solr's own index). Contributions are always welcome :) If the sourceLocation is mandatory when using a third party index for spelling suggestions, may I update the Solr WIKI to include this important information. Sure, please go ahead. Thanks! -- Regards, Shalin Shekhar Mangar.
Re: Query regarding Spelling Suggestions
Solr 1.3 doesn't use Log4J, it uses Java Utility Logging (JUL). I
believe the info level in the logs is sufficient. Let's start by
posting what you have?
Also, are you able to get the sample spellchecking to work?
On Jan 12, 2009, at 2:16 AM, Deshpande, Mukta wrote:
Hi,
Could you please send me the needful entries in log4j.properties to
enable logging, explicitly for SpellCheckComponent.
My current log4j.properties looks like:
log4j.rootLogger=INFO,console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd
HH:mm:ss} %p
%c{2}: %m%n
log4j.logger.org.apache.solr=DEBUG
With these settings I can only see the INFO level logs.
I tried to change the log level for SpellCheckComponent to FINE
using
the admin logging page http://localhost:8080/solr/admin/logging but
did
not see any difference in logging.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Monday, January 12, 2009 3:22 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you send the full log?
On Jan 11, 2009, at 1:51 PM, Deshpande, Mukta wrote:
I am using the example schema that comes with the Solr installation
downloaded from http://www.mirrorgeek.com/apache.org/lucene/solr/.
I have added the word field with textSpell fieldtype in the
schema.xml file, as specified in the below mail.
My spelling index exist under SOLR HOME/data/ If I open my index in
Luke I can see the entries against word
field.
Thanks,
~Mukta
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Fri 1/9/2009 8:29 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?
q=documnetspellcheck=truespellch
eck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field
word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field
name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck
class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling
suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
RE: Query regarding Spelling Suggestions
I am using the example schema that comes with the Solr installation downloaded
from http://www.mirrorgeek.com/apache.org/lucene/solr/.
I have added the word field with textSpell fieldtype in the schema.xml
file, as specified in the below mail.
My spelling index exist under SOLR HOME/data/
If I open my index in Luke I can see the entries against word field.
Thanks,
~Mukta
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Fri 1/9/2009 8:29 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?q=documnetspellcheck=truespellcheck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field
name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
Re: Query regarding Spelling Suggestions
Can you send the full log?
On Jan 11, 2009, at 1:51 PM, Deshpande, Mukta wrote:
I am using the example schema that comes with the Solr installation
downloaded from http://www.mirrorgeek.com/apache.org/lucene/solr/.
I have added the word field with textSpell fieldtype in the
schema.xml file, as specified in the below mail.
My spelling index exist under SOLR HOME/data/
If I open my index in Luke I can see the entries against word
field.
Thanks,
~Mukta
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Fri 1/9/2009 8:29 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?q=documnetspellcheck=truespellcheck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field
word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field
name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
RE: Query regarding Spelling Suggestions
Hi,
Could you please send me the needful entries in log4j.properties to
enable logging, explicitly for SpellCheckComponent.
My current log4j.properties looks like:
log4j.rootLogger=INFO,console
log4j.appender.console=org.apache.log4j.ConsoleAppender
log4j.appender.console.target=System.err
log4j.appender.console.layout=org.apache.log4j.PatternLayout
log4j.appender.console.layout.ConversionPattern=%d{yy/MM/dd HH:mm:ss} %p
%c{2}: %m%n
log4j.logger.org.apache.solr=DEBUG
With these settings I can only see the INFO level logs.
I tried to change the log level for SpellCheckComponent to FINE using
the admin logging page http://localhost:8080/solr/admin/logging but did
not see any difference in logging.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Monday, January 12, 2009 3:22 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you send the full log?
On Jan 11, 2009, at 1:51 PM, Deshpande, Mukta wrote:
I am using the example schema that comes with the Solr installation
downloaded from http://www.mirrorgeek.com/apache.org/lucene/solr/.
I have added the word field with textSpell fieldtype in the
schema.xml file, as specified in the below mail.
My spelling index exist under SOLR HOME/data/ If I open my index in
Luke I can see the entries against word
field.
Thanks,
~Mukta
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Fri 1/9/2009 8:29 AM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?q=documnetspellcheck=truespellch
eck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field
word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field
name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
Re: Query regarding Spelling Suggestions
Can you put the full log (as short as possibly demonstrates the
problem) somewhere where I can take a look? Likewise, can you share
your schema?
Also, does the spelling index exist under SOLR HOME/data/index? If
you open it w/ Luke, does it have entries?
Thanks,
Grant
On Jan 8, 2009, at 11:30 PM, Deshpande, Mukta wrote:
Yes. I send the build command as:
http://localhost:8080/solr/select/?q=documnetspellcheck=truespellcheck
.build
=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params
={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field
name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
Re: Query regarding Spelling Suggestions
Did you send in the build command? See http://wiki.apache.org/solr/SpellCheckComponent On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote: Hi, I am using Wordnet dictionary for spelling suggestions. The dictionary is converted to Solr index with only one field word and stored in location solr-home/data/syn_index, using syns2Index.java program available at http://www.tropo.com/techno/java/lucene/wordnet.html I have added the word field in my schema.xml as field name=word type=textSpell indexed=true stored=true/ My application data indexes are in solr-home/data I am trying to use solr.IndexBasedSpellChecker to get spelling suggestions. My spell check component is configured as: searchComponent name=spellcheck class=solr.SpellCheckComponent str name=queryAnalyzerFieldTypetextSpell/str lst name=spellchecker str name=namedict/str str name=classnamesolr.IndexBasedSpellChecker/str str name=fieldword/str str name=characterEncodingUTF-8/str str name=spellcheckIndexDir./syn_index/str /lst /searchComponent I have added this component to my standard request handler as: requestHandler name=standard class=solr.StandardRequestHandler default=true lst name=defaults str name=echoParamsexplicit/str /lst arr name=last-components strspellcheck/str /arr /requestHandler With the above configuration, I do not get any spelling suggestions. Can somebody help ASAP. Thanks, ~Mukta -- Grant Ingersoll Lucene Helpful Hints: http://wiki.apache.org/lucene-java/BasicsOfPerformance http://wiki.apache.org/lucene-java/LuceneFAQ
RE: Query regarding Spelling Suggestions
Yes. I send the build command as:
http://localhost:8080/solr/select/?q=documnetspellcheck=truespellcheck
.build=truespellcheck.count=2spellcheck.q=parfectspellcheck.dictionar
y=dict
The Tomcat log shows:
Jan 9, 2009 9:55:19 AM org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select/
params={spellcheck=trueq=documnetspellcheck.q=parfectspellcheck.dicti
onary=dictspellcheck.count=2spellcheck.build=true} hits=0 status=0
QTime=141
Even after sending the build command I do not get any suggestions.
Can you please check.
Thanks,
~Mukta
-Original Message-
From: Grant Ingersoll [mailto:gsing...@apache.org]
Sent: Thursday, January 08, 2009 7:42 PM
To: solr-user@lucene.apache.org
Subject: Re: Query regarding Spelling Suggestions
Did you send in the build command? See
http://wiki.apache.org/solr/SpellCheckComponent
On Jan 8, 2009, at 5:14 AM, Deshpande, Mukta wrote:
Hi,
I am using Wordnet dictionary for spelling suggestions.
The dictionary is converted to Solr index with only one field word
and stored in location solr-home/data/syn_index, using
syns2Index.java program available at
http://www.tropo.com/techno/java/lucene/wordnet.html
I have added the word field in my schema.xml as field name=word
type=textSpell indexed=true stored=true/
My application data indexes are in solr-home/data
I am trying to use solr.IndexBasedSpellChecker to get spelling
suggestions.
My spell check component is configured as:
searchComponent name=spellcheck class=solr.SpellCheckComponent
str name=queryAnalyzerFieldTypetextSpell/str
lst name=spellchecker
str name=namedict/str
str name=classnamesolr.IndexBasedSpellChecker/str
str name=fieldword/str
str name=characterEncodingUTF-8/str
str name=spellcheckIndexDir./syn_index/str
/lst
/searchComponent
I have added this component to my standard request handler as:
requestHandler name=standard class=solr.StandardRequestHandler
default=true
lst name=defaults
str name=echoParamsexplicit/str
/lst
arr name=last-components
strspellcheck/str
/arr
/requestHandler
With the above configuration, I do not get any spelling suggestions.
Can
somebody help ASAP.
Thanks,
~Mukta
--
Grant Ingersoll
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
Re: Query regarding spelling suggestions
Right now, you'd have to write an implementation of a SolrSpellChecker. Seems like a reasonable thing to have, though. We could have a Chained Spell Checker that combined the others, I think. Another option that might work, would be to define two separate Search components, 1 for the file and 1 for the index, and then put them into the request handler, such that it might be possible to get both outputs. I haven't tried this, but think it should work since the component just adds to the output, and doesn't overwrite it. HTH, Grant On Dec 8, 2008, at 12:02 AM, Deshpande, Mukta wrote: Hi, I have defined a Search Component in solrconfig.xml containing two entries for spellchecker. One is the indexed field - title . Second is a text file - mywords.txt. When I enable spellchecking and query for some word, I expect that the spelling suggestions will come from both the dictionaries. But my observation is that the suggestions come from the indexed field only if some exist otherwise I do not get any suggestions. If I explicitly add spellcheck.dictionary=file to get suggestion from text file then I get suggestions from the file but in that case I do not get suggestions from the indexed field. How can I get spelling suggestions from both dictionaries. Thanks, Mukta -- Grant Ingersoll Lucene Helpful Hints: http://wiki.apache.org/lucene-java/BasicsOfPerformance http://wiki.apache.org/lucene-java/LuceneFAQ
