[
https://issues.apache.org/jira/browse/SOLR-6813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247423#comment-14247423
]
Joel Bernstein edited comment on SOLR-6813 at 12/15/14 11:34 PM:
-----------------------------------------------------------------
Another thought...
We also appear to have a deep paging issue to consider with distrib.singlePass
when the ExpandComponent is in play.
The ExpandComponent will fetch groups for all documents in the docList when
distrib.singlePass is on. With distributed deep paging the docList continues to
grow as the user pages deeper into the result set. This means that more
expanded groups will be fetched, making the deep paging problems much worse.
In normal two pass distributed mode, the ExpandComponent uses the ID list to
eliminate the deep paging issue.
So, in a nutshell we may be slowing things down quite a bit when using
distrib.singlePass with the ExpandComponent.
The ExpandComponent was designed to work very effiiciently with the two pass
distributed mode. Perhaps we should consider turning off distrib.singlePass if
the ExpandComponent is in use.
was (Author: joel.bernstein):
Another thought...
We also appear to have a deep paging issue to consider with distrib.singlePass
on when the ExpandComponent is in play.
The ExpandComponent will fetch groups for all documents in the docList when
distrib.singlePass is on. With distributed deep paging the docList continues to
grow as the user pages deeper into the result set. This means that more
expanded groups will be fetched, making the deep paging problems much worse.
In normal two pass distributed mode, the ExpandComponent uses the ID list to
eliminate the deep paging issue.
So, in a nutshell we may be slowing things down quite a bit when using
distrib.singlePass with the ExpandComponent.
The ExpandComponent was designed to work very effiiciently with the two pass
distributed mode. Perhaps we should consider turning off distrib.singlePass if
the ExpandComponent is in use.
> distrib.singlePass does not work for expand-request - start/rows included
> -------------------------------------------------------------------------
>
> Key: SOLR-6813
> URL: https://issues.apache.org/jira/browse/SOLR-6813
> Project: Solr
> Issue Type: Bug
> Components: multicore, search
> Reporter: Per Steffensen
> Assignee: Joel Bernstein
> Labels: distributed_search, search
> Attachments: test_that_reveals_the_problem.patch
>
>
> Using distrib.singlePass does not work for expand-requests. Even after the
> fix provided to SOLR-6812, it does not work for requests where you add start
> and/or rows.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
