Re: Facet search on a docvalue field in a multi shard collection
Hi I have created https://issues.apache.org/jira/browse/SOLR-5260 as proposed by Erick. I hope anyone working with doc values can lead me in a direction of how to solve the bug. Best regards Trym Den 23-09-2013 16:01, Erick Erickson skrev: I haven't dived into the code, but it sure looks like a JIRA to me, can you open one? Best, Erick On Mon, Sep 23, 2013 at 1:48 AM, "Trym R. Møller" wrote: Hi Erick Thanks for your input. I have retrieved and build the branch http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 Doing the same setup as in my previous post (two shard collection, fieldA af docValue type, index a single document and doing a facet search on fieldA), I now get the below exception. The cause (which is not visible from the stacktrace) is as previous: "Cannot use facet.mincount=0 on field fieldA which is not indexed" What could be my next steps from here? 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ org.apache.solr.common.SolrException: Exception during facet.field: fieldA. at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:724) Den 22-09-2013 17:09, Erick Erickson skrev: right, I think you're running into a bug I remember going by. I can't find it now, JIRA seems to be not responding. As I remember, where if a shard doesn't have a doc on it, you get an error. Although why facet.limit should figure in here is a mystery to me, maybe a coincidence? Significant work has been done about not requiring values for DocValues fields and stuff. Can you give a try on 4.x or the soon-to-be-released 4.5? Best, Erick On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" wrote: Hi I have a problem doing facet search on a doc value field in a multi shard collection. Any ideas what I may be doing wrong? My Solr schema specifies fieldA as a docvalue type and I have created a two shard collection usin
Re: Facet search on a docvalue field in a multi shard collection
I haven't dived into the code, but it sure looks like a JIRA to me, can you open one? Best, Erick On Mon, Sep 23, 2013 at 1:48 AM, "Trym R. Møller" wrote: > Hi Erick > > Thanks for your input. > > I have retrieved and build the branch > http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 > Doing the same setup as in my previous post (two shard collection, fieldA af > docValue type, index a single document and doing a facet search on fieldA), > I now get the below exception. The cause (which is not visible from the > stacktrace) is as previous: "Cannot use facet.mincount=0 on field fieldA > which is not indexed" > > What could be my next steps from here? > > 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ > org.apache.solr.common.SolrException: Exception during facet.field: fieldA. > at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) > at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) > at > org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) > at > org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) > > at > org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) > at > org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) > at > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) > at > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) > at > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) > > at > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) > at > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) > at > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) > at > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) > at > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) > at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) > at > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) > at > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) > at > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) > at > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) > at > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) > at > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) > at org.eclipse.jetty.server.Server.handle(Server.java:368) > at > org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) > at > org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) > at > org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) > at > org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) > at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) > at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) > > at > org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) > at > org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) > at > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) > at > org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) > at java.lang.Thread.run(Thread.java:724) > > Den 22-09-2013 17:09, Erick Erickson skrev: > >> right, I think you're running into a bug I remember going by. I can't >> find it now, JIRA seems to be not responding. As I remember, >> where if a shard doesn't have a doc on it, you get an error. >> >> Although why facet.limit should figure in here is a mystery to me, >> maybe a coincidence? >> >> Significant work has been done about not requiring values for >> DocValues fields and stuff. Can you give a try on 4.x or the >> soon-to-be-released 4.5? >> >> Best, >> Erick >> >> On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" wrote: >>> >>> Hi >>> >>> I have a problem doing facet search on a doc value field in a multi shard >>> collection. Any ideas what I may be doing wrong? >>> >>> My Solr schema specifies fieldA as a docvalue type and I have created a >>> two >>> shard collection using Solr
Re: Facet search on a docvalue field in a multi shard collection
Hi Erick Thanks for your input. I have retrieved and build the branch http://svn.apache.org/repos/asf/lucene/dev/branches/lucene_solr_4_5 Doing the same setup as in my previous post (two shard collection, fieldA af docValue type, index a single document and doing a facet search on fieldA), I now get the below exception. The cause (which is not visible from the stacktrace) is as previous: "Cannot use facet.mincount=0 on field fieldA which is not indexed" What could be my next steps from here? 620710 [qtp1728933440-15] ERROR org.apache.solr.core.SolrCore ▒ org.apache.solr.common.SolrException: Exception during facet.field: fieldA. at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:569) at org.apache.solr.request.SimpleFacets$2.call(SimpleFacets.java:554) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) at java.util.concurrent.FutureTask.run(FutureTask.java:166) at org.apache.solr.request.SimpleFacets$1.execute(SimpleFacets.java:508) at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:579) at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:265) at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78) at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135) at org.apache.solr.core.SolrCore.execute(SolrCore.java:1859) at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:703) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:406) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:195) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137) at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135) at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255) at org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116) at org.eclipse.jetty.server.Server.handle(Server.java:368) at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489) at org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53) at org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953) at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014) at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861) at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:240) at org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72) at org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:724) Den 22-09-2013 17:09, Erick Erickson skrev: right, I think you're running into a bug I remember going by. I can't find it now, JIRA seems to be not responding. As I remember, where if a shard doesn't have a doc on it, you get an error. Although why facet.limit should figure in here is a mystery to me, maybe a coincidence? Significant work has been done about not requiring values for DocValues fields and stuff. Can you give a try on 4.x or the soon-to-be-released 4.5? Best, Erick On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" wrote: Hi I have a problem doing facet search on a doc value field in a multi shard collection. Any ideas what I may be doing wrong? My Solr schema specifies fieldA as a docvalue type and I have created a two shard collection using Solr 4.4.0. When I do a facet search on fieldA with a "large" facet.limit then the query fails with the below exception A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) * number of shards > rows matching my query The exception does not occur when I run with a single shard collection. It can easily be reproduced by indexing a single row and queryin
Re: Facet search on a docvalue field in a multi shard collection
right, I think you're running into a bug I remember going by. I can't
find it now, JIRA seems to be not responding. As I remember,
where if a shard doesn't have a doc on it, you get an error.
Although why facet.limit should figure in here is a mystery to me,
maybe a coincidence?
Significant work has been done about not requiring values for
DocValues fields and stuff. Can you give a try on 4.x or the
soon-to-be-released 4.5?
Best,
Erick
On Sun, Sep 22, 2013 at 6:26 AM, "Trym R. Møller" wrote:
> Hi
>
> I have a problem doing facet search on a doc value field in a multi shard
> collection. Any ideas what I may be doing wrong?
>
> My Solr schema specifies fieldA as a docvalue type and I have created a two
> shard collection using Solr 4.4.0.
> When I do a facet search on fieldA with a "large" facet.limit then the query
> fails with the below exception
> A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) * number
> of shards > rows matching my query
>
> The exception does not occur when I run with a single shard collection.
> It can easily be reproduced by indexing a single row and querying it, as the
> default facet.limit is 100.
>
> The facet query received by Solr looks as follows:
> 576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
> [trym_shard2_replica1] webapp=/solr path=/select
> params={facet=true&start=0&q=*:*&distrib=true&collection=trym&facet.field=fieldA&wt=javabin&version=2&rows=0}
> status=500 QTime=20
> One of the "internal query" send by Solr to its shard looks like
> 576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
> [trym_shard1_replica1] webapp=/solr path=/select
> params={facet=true&distrib=false&collection=trym
>
> &wt=javabin&version=2&rows=0&NOW=1379855011787&shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/&df=text&fl=id,score&f.fieldA.facet.limit=160&start=0&q=*:
> *&facet.field=fieldA&isShard=true&fsv=true} hits=1 status=500 QTime=2
>
> 576784 [qtp170860084-17] ERROR org.apache.solr.servlet.SolrDispatchFilter ¦
> null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a field
> which is not indexed
> at
> org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
> at
> org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
> at
> org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
> at
> org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
> at
> org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
> at
> org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
> at
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
> at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
> at
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
> at
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
> at
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
> at
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
> at
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
> at
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
> at
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
> at
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
> at
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
> at
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
> at
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
> at
> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
> at
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
> at org.eclipse.jetty.server.Server.handle(Server.java:368)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
> at
> org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
> at
> org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
> at
> org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
> at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java
Facet search on a docvalue field in a multi shard collection
Hi
I have a problem doing facet search on a doc value field in a multi
shard collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a
two shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a "large" facet.limit then the
query fails with the below exception
A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) *
number of shards > rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as
the default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=true&start=0&q=*:*&distrib=true&collection=trym&facet.field=fieldA&wt=javabin&version=2&rows=0}
status=500 QTime=20
One of the "internal query" send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=true&distrib=false&collection=trym
&wt=javabin&version=2&rows=0&NOW=1379855011787&shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/&df=text&fl=id,score&f.fieldA.facet.limit=160&start=0&q=*:
*&facet.field=fieldA&isShard=true&fsv=true} hits=1 status=500 QTime=2
576784 [qtp170860084-17] ERROR
org.apache.solr.servlet.SolrDispatchFilter ¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
field which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
My schema.xml contains the following lines (among others :-))
docValues="true" required="tr
Facet search on a docvalue field in a multi shard collection
Hi
I have a problem doing facet search on a doc value field in a multi
shard collection. Any ideas what I may be doing wrong?
My Solr schema specifies fieldA as a docvalue type and I have created a
two shard collection using Solr 4.4.0.
When I do a facet search on fieldA with a "large" facet.limit then the
query fails with the below exception
A "large" facet.limit seems to be when (10 + (facet.limit * 1,5)) *
number of shards > rows matching my query
The exception does not occur when I run with a single shard collection.
It can easily be reproduced by indexing a single row and querying it, as
the default facet.limit is 100.
The facet query received by Solr looks as follows:
576793 [qtp170860084-18] INFO org.apache.solr.core.SolrCore ¦
[trym_shard2_replica1] webapp=/solr path=/select
params={facet=true&start=0&q=*:*&distrib=true&collection=trym&facet.field=fieldA&wt=javabin&version=2&rows=0}
status=500 QTime=20
One of the "internal query" send by Solr to its shard looks like
576783 [qtp170860084-19] INFO org.apache.solr.core.SolrCore ¦
[trym_shard1_replica1] webapp=/solr path=/select
params={facet=true&distrib=false&collection=trym
&wt=javabin&version=2&rows=0&NOW=1379855011787&shard.url=192.168.56.1:8501/solr/trym_shard1_replica1/&df=text&fl=id,score&f.fieldA.facet.limit=160&start=0&q=*:
*&facet.field=fieldA&isShard=true&fsv=true} hits=1 status=500 QTime=2
576784 [qtp170860084-17] ERROR
org.apache.solr.servlet.SolrDispatchFilter ¦
null:java.lang.IllegalStateException: Cannot use facet.mincount=0 on a
field which is not indexed
at
org.apache.solr.request.NumericFacets.getCounts(NumericFacets.java:257)
at
org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:423)
at
org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:530)
at
org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:259)
at
org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:78)
at
org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:208)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1904)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:659)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:362)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:158)
at
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
at
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
at
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:557)
at
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:231)
at
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1075)
at
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
at
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
at
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
at
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
at
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:255)
at
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:154)
at
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
at org.eclipse.jetty.server.Server.handle(Server.java:368)
at
org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
at
org.eclipse.jetty.server.BlockingHttpConnection.handleRequest(BlockingHttpConnection.java:53)
at
org.eclipse.jetty.server.AbstractHttpConnection.content(AbstractHttpConnection.java:953)
at
org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.content(AbstractHttpConnection.java:1014)
at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:861)
at
org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
at
org.eclipse.jetty.server.BlockingHttpConnection.handle(BlockingHttpConnection.java:72)
at
org.eclipse.jetty.server.bio.SocketConnector$ConnectorEndPoint.run(SocketConnector.java:264)
at
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:724)
My schema.xml contains the following lines (among others :-))
docValues="true" required="tr
