[
https://issues.apache.org/jira/browse/SOLR-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251087#comment-14251087
]
Mark Miller commented on SOLR-4509:
-----------------------------------
After this patch, tests have gone from about 16-17 minutes to run for me to
10-11 minutes. I've tweaked Jetty shutdown to be faster, but most of this is
probably related to SSL tests and SOLR-5776 and SOLR-6293.
Because this change effectively lowered client idle timeouts, didn't have any
retries for a while, and perhaps my system random entropy has been low, I
really had to clamp down on how much SSL is done in a test run to be able to
consistently get clean runs with timeouts from SSL lack of random entropy
blocking. As I'm getting speed much closer to what I used to get pre SOLR-6293,
this looks like a prime suspect for that major loss.
> Disable HttpClient stale check for performance and fewer spurious connection
> errors.
> ------------------------------------------------------------------------------------
>
> Key: SOLR-4509
> URL: https://issues.apache.org/jira/browse/SOLR-4509
> Project: Solr
> Issue Type: Improvement
> Components: search
> Environment: 5 node SmartOS cluster (all nodes living in same global
> zone - i.e. same physical machine)
> Reporter: Ryan Zezeski
> Assignee: Mark Miller
> Priority: Minor
> Fix For: 5.0, Trunk
>
> Attachments: IsStaleTime.java, SOLR-4509-4_4_0.patch,
> SOLR-4509.patch, SOLR-4509.patch, SOLR-4509.patch, SOLR-4509.patch,
> SOLR-4509.patch, SOLR-4509.patch, baremetal-stale-nostale-med-latency.dat,
> baremetal-stale-nostale-med-latency.svg,
> baremetal-stale-nostale-throughput.dat, baremetal-stale-nostale-throughput.svg
>
>
> By disabling the Apache HTTP Client stale check I've witnessed a 2-4x
> increase in throughput and reduction of over 100ms. This patch was made in
> the context of a project I'm leading, called Yokozuna, which relies on
> distributed search.
> Here's the patch on Yokozuna: https://github.com/rzezeski/yokozuna/pull/26
> Here's a write-up I did on my findings:
> http://www.zinascii.com/2013/solr-distributed-search-and-the-stale-check.html
> I'm happy to answer any questions or make changes to the patch to make it
> acceptable.
> ReviewBoard: https://reviews.apache.org/r/28393/
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
