Re: Solr and OpenPipe
git clone https://github.com/kolstae/openpipe cd openpipe mvn install regards -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-and-OpenPipe-tp484777p4052079.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: Solr spellchecking fails on sharded query
Hi, i try solr shards configuration ( SolrCloud ) and request settings as suggested in http://wiki.apache.org/solr/SpellCheckComponent#Distributed_Search_Support for shards spelling. Suggestion is empty as Eric said. Any idea? Fabio 2012/6/19 Eric Wilson wilson.eri...@gmail.com I have a Solr application that is distributed into 11 shards, using Solr version 4.0.0.2011.07.26.16.34.16 In the solrconfig.xml for each shard, I have configured a spellcheck component: searchComponent name=spellcheck class=solr.SpellCheckComponent str name=queryAnalyzerFieldTypetextSpell/str lst name=spellchecker str name=namecn_spell/str str name=fieldcompany_name_spell/str float name=threshold0.0001/float str name=buildOnOptimizetrue/str str name=spellcheckIndexDir./spellchecker_cn_spell/str /lst /searchComponent I have built the dictionary for each shard, and verified that each shard will return suggestions for misspellings. Moreover, it is evident that a different dictionary is being used for the various shards. The problem comes when I submit a sharded query. In that case the result comes back with the following: lst name=spellcheck lst name=suggestions/ /lst In other words, the list of words for which there are suggestions is empty. Is there a trick to sharded spellchecking? I appreciate any suggestions. Eric
Re: Solr spellchecking fails on sharded query
I did as you suggest enabling spellcheck component in select RH. requestHandler name=/select class=solr.SearchHandler lst name=defaults str name=echoParamsexplicit/str int name=rows10/int /lst arr name=components strspellcheck/str /arr /requestHandler Response contains error 500 response lst name=responseHeader int name=status500/int int name=QTime29/int lst name=params str name=spellcheck.dictionaryfile/str str name=spellchecktrue/str str name=shards fc:8900/solr/commenti,fc:7500/solr/commenti,fc:8584/solr/commenti,fc:7574/solr/commenti /str str name=qpiza/str str name=spellcheck.qpiza/str /lst /lst lst name=error str name=trace java.lang.NullPointerException at org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:819) at org.apache.solr.handler.component.QueryComponent.handleRegularResponses(QueryComponent.java:626) at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:605) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:307) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1566) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111) at org.eclipse.jetty.server.Server.handle(Server.java:351) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:890) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:944) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534) at java.lang.Thread.run(Thread.java:679) /str int name=code500/int /lst /response Fabio 2012/6/22 Markus Jelsma markus.jel...@openindex.io Hi, The spellcheck component must be enabled in your default request handler otherwise your suggestions list is empty. Cheers, -Original message- From:fabio curti fabio.cu...@gmail.com Sent: Fri 22-Jun-2012 09:34 To: solr-user@lucene.apache.org Subject: Re: Solr spellchecking fails on sharded query Hi, i try solr shards configuration ( SolrCloud ) and request settings as suggested in http://wiki.apache.org/solr/SpellCheckComponent#Distributed_Search_Supportfor shards spelling. Suggestion is empty as Eric said. Any idea? Fabio 2012/6/19 Eric Wilson wilson.eri...@gmail.com I have a Solr application that is distributed into 11 shards, using Solr version 4.0.0.2011.07.26.16.34.16 In the solrconfig.xml for each shard, I have configured a spellcheck component: searchComponent name=spellcheck class=solr.SpellCheckComponent str name=queryAnalyzerFieldTypetextSpell/str lst name=spellchecker str name=namecn_spell/str str name=fieldcompany_name_spell/str float name=threshold0.0001/float str name=buildOnOptimizetrue/str str name=spellcheckIndexDir./spellchecker_cn_spell/str /lst /searchComponent I have built the dictionary for each shard, and verified that each shard will return
Re: Solr spellchecking fails on sharded query
Hi, it seems the shards suggestion working fine if i set the select RH as follow ( arr name=last-components instead of arr name=components ) requestHandler name=/select class=solr.SearchHandler lst name=defaults str name=echoParamsexplicit/str int name=rows10/int /lst arr name=last-components strspellcheck/str /arr /requestHandler Now suggestion is populated! Fabio 2012/6/22 fabio curti fabio.cu...@gmail.com I did as you suggest enabling spellcheck component in select RH. requestHandler name=/select class=solr.SearchHandler lst name=defaults str name=echoParamsexplicit/str int name=rows10/int /lst arr name=components strspellcheck/str /arr /requestHandler Response contains error 500 response lst name=responseHeader int name=status500/int int name=QTime29/int lst name=params str name=spellcheck.dictionaryfile/str str name=spellchecktrue/str str name=shards fc:8900/solr/commenti,fc:7500/solr/commenti,fc:8584/solr/commenti,fc:7574/solr/commenti /str str name=qpiza/str str name=spellcheck.qpiza/str /lst /lst lst name=error str name=trace java.lang.NullPointerException at org.apache.solr.handler.component.QueryComponent.mergeIds(QueryComponent.java:819) at org.apache.solr.handler.component.QueryComponent.handleRegularResponses(QueryComponent.java:626) at org.apache.solr.handler.component.QueryComponent.handleResponses(QueryComponent.java:605) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:307) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1566) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:442) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:263) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1337) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:484) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:119) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:524) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:233) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1065) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:413) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:192) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:999) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:117) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:250) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:149) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:111) at org.eclipse.jetty.server.Server.handle(Server.java:351) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:454) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:47) at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:890) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:944) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:634) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:230) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:66) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:254) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:599) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:534) at java.lang.Thread.run(Thread.java:679) /str int name=code500/int /lst /response Fabio 2012/6/22 Markus Jelsma markus.jel...@openindex.io Hi, The spellcheck component must be enabled in your default request handler otherwise your suggestions list is empty. Cheers, -Original message- From:fabio curti fabio.cu...@gmail.com Sent: Fri 22-Jun-2012 09:34 To: solr-user@lucene.apache.org Subject: Re: Solr spellchecking fails on sharded query Hi, i try solr shards configuration ( SolrCloud ) and request settings as suggested in http://wiki.apache.org/solr/SpellCheckComponent#Distributed_Search_Supportfor shards spelling. Suggestion is empty as Eric said. Any idea? Fabio 2012/6/19 Eric Wilson wilson.eri...@gmail.com I have a Solr application that is distributed into 11 shards, using Solr version 4.0.0.2011.07.26.16.34.16 In the solrconfig.xml for each shard, I have configured a spellcheck
Re: Solr spellchecking fails on sharded query
Hi, i found this article about your issue. http://wiki.apache.org/solr/SpellCheckComponent#Distributed_Search_Support Fabio 2012/6/19 Eric Wilson wilson.eri...@gmail.com I have a Solr application that is distributed into 11 shards, using Solr version 4.0.0.2011.07.26.16.34.16 In the solrconfig.xml for each shard, I have configured a spellcheck component: searchComponent name=spellcheck class=solr.SpellCheckComponent str name=queryAnalyzerFieldTypetextSpell/str lst name=spellchecker str name=namecn_spell/str str name=fieldcompany_name_spell/str float name=threshold0.0001/float str name=buildOnOptimizetrue/str str name=spellcheckIndexDir./spellchecker_cn_spell/str /lst /searchComponent I have built the dictionary for each shard, and verified that each shard will return suggestions for misspellings. Moreover, it is evident that a different dictionary is being used for the various shards. The problem comes when I submit a sharded query. In that case the result comes back with the following: lst name=spellcheck lst name=suggestions/ /lst In other words, the list of words for which there are suggestions is empty. Is there a trick to sharded spellchecking? I appreciate any suggestions. Eric
Multicore master-slaver replication in Solr Cloud
Hi, i tried to set a Multicore master-slaver replication in Solr Cloud found in this post http://pulkitsinghal.blogspot.it/2011/09/multicore-master-slave-replication-in.html but i get the following problem SEVERE: Error while trying to recover. org.apache.solr.client.solrj.SolrServerException: Server at http://myserver:8983/solr was not found (404). at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:372) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:192) at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:303) at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:213) Jun 19, 2012 3:17:49 PM org.apache.solr.cloud.RecoveryStrategy doRecovery SEVERE: Recovery failed - trying again... The infrastructure will look like: - Solr-Instance-A - master1 (indexes changes for shard1) - slave1-master2 (replicates changes from shard2) - slave2-master2 (replicates changes from shard2) - Solr-Instance-B - master2 (indexes changes for shard2) - slave1-master1 (replicates changes from shard1) - slave2-master1 (replicates changes from shard1) Any idea?
