Dmitry Kan created SOLR-4903:
--------------------------------
Summary: Solr sends all doc ids to all shards in the query
counting facets
Key: SOLR-4903
URL: https://issues.apache.org/jira/browse/SOLR-4903
Project: Solr
Issue Type: Improvement
Components: search
Affects Versions: 3.4
Reporter: Dmitry Kan
Setup: front end solr and shards.
Summary: solr frontend sends all doc ids received from QueryComponent to all
shards which causes POST request buffer size overflow.
Symptoms:
The query is: http://pastebin.com/0DndK1Cs
I have omitted the shards parameter.
The router log: http://pastebin.com/FTVH1WF3
Notice the port of a shard, that is affected. That port changes all the time,
even for the same request
The log entry is prepended with lines:
SEVERE: org.apache.solr.common.SolrException: Internal Server Error
Internal Server Error
(they are not in the pastebin link)
The shard log: http://pastebin.com/exwCx3LX
Suggestion: change the data structure in FacetComponent to send only doc ids
that belong to a shard and not a concatenation of all doc ids.
Why is this important: for scaling. Adding more shards will result in
overflowing the POST request buffer at some point anyway.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
