[ https://issues.apache.org/jira/browse/SOLR-4509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251087#comment-14251087 ]
Mark Miller commented on SOLR-4509: ----------------------------------- After this patch, tests have gone from about 16-17 minutes to run for me to 10-11 minutes. I've tweaked Jetty shutdown to be faster, but most of this is probably related to SSL tests and SOLR-5776 and SOLR-6293. Because this change effectively lowered client idle timeouts, didn't have any retries for a while, and perhaps my system random entropy has been low, I really had to clamp down on how much SSL is done in a test run to be able to consistently get clean runs with timeouts from SSL lack of random entropy blocking. As I'm getting speed much closer to what I used to get pre SOLR-6293, this looks like a prime suspect for that major loss. > Disable HttpClient stale check for performance and fewer spurious connection > errors. > ------------------------------------------------------------------------------------ > > Key: SOLR-4509 > URL: https://issues.apache.org/jira/browse/SOLR-4509 > Project: Solr > Issue Type: Improvement > Components: search > Environment: 5 node SmartOS cluster (all nodes living in same global > zone - i.e. same physical machine) > Reporter: Ryan Zezeski > Assignee: Mark Miller > Priority: Minor > Fix For: 5.0, Trunk > > Attachments: IsStaleTime.java, SOLR-4509-4_4_0.patch, > SOLR-4509.patch, SOLR-4509.patch, SOLR-4509.patch, SOLR-4509.patch, > SOLR-4509.patch, SOLR-4509.patch, baremetal-stale-nostale-med-latency.dat, > baremetal-stale-nostale-med-latency.svg, > baremetal-stale-nostale-throughput.dat, baremetal-stale-nostale-throughput.svg > > > By disabling the Apache HTTP Client stale check I've witnessed a 2-4x > increase in throughput and reduction of over 100ms. This patch was made in > the context of a project I'm leading, called Yokozuna, which relies on > distributed search. > Here's the patch on Yokozuna: https://github.com/rzezeski/yokozuna/pull/26 > Here's a write-up I did on my findings: > http://www.zinascii.com/2013/solr-distributed-search-and-the-stale-check.html > I'm happy to answer any questions or make changes to the patch to make it > acceptable. > ReviewBoard: https://reviews.apache.org/r/28393/ -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org