[
https://issues.apache.org/jira/browse/SOLR-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13588597#comment-13588597
]
Shawn Heisey commented on SOLR-4509:
------------------------------------
Interested user here, not anyone linked to Solr or Lucene.
Would the 100ms latency you have described here show up in QTime values or be
purely client-side? I ask because the median (not average) QTime value I see
in disributed searches (seven shards on two servers) on Solr 3.5.0 is about 10
milliseconds, and even faster on 4.2-SNAPSHOT ... and that involves the stale
check both on the client side and the seven shards. The client is SolrJ 4.1,
with max retries (2) and connection timeout (5000ms) being the only low-level
parameters that are set. SolrCloud is not involved here.
The idea of a sweeper thread makes me nervous, given the project's general
reaction to the background threads created by an intermediate SOLR-1972 patch.
Also, with 5000 milliseconds between executions of the sweeper thread and an
assumption of a server timeout of 50 milliseconds, will it be able to
effectively avoid problems in all environments? If these are not actual
worries, then I can be quiet.
> Disable Stale Check - Distributed Search (Performance)
> ------------------------------------------------------
>
> Key: SOLR-4509
> URL: https://issues.apache.org/jira/browse/SOLR-4509
> Project: Solr
> Issue Type: Improvement
> Components: search
> Environment: 5 node SmartOS cluster (all nodes living in same global
> zone - i.e. same physical machine)
> Reporter: Ryan Zezeski
> Priority: Minor
> Attachments: SOLR-4509.patch
>
>
> By disabling the Apache HTTP Client stale check I've witnessed a 2-4x
> increase in throughput and reduction of over 100ms. This patch was made in
> the context of a project I'm leading, called Yokozuna, which relies on
> distributed search.
> Here's the patch on Yokozuna: https://github.com/rzezeski/yokozuna/pull/26
> Here's a write-up I did on my findings:
> http://www.zinascii.com/2013/solr-distributed-search-and-the-stale-check.html
> I'm happy to answer any questions or make changes to the patch to make it
> acceptable.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
