Hi Mikhail, Yes I have the timeAllowed parameter configured, still is this case it doesn't seem to prevent the stats request from blocking other normal queries. Is it possible to drop the request before solr executes it? maybe at the jetty request filter?
Thanks, Wei On Mon, Oct 7, 2019 at 1:39 PM Mikhail Khludnev <m...@apache.org> wrote: > Hello, Wei. > > Have you tried to abandon heavy queries with > > https://lucene.apache.org/solr/guide/8_1/common-query-parameters.html#CommonQueryParameters-ThetimeAllowedParameter > ? > It may or may not be able to stop stats. > > https://github.com/apache/lucene-solr/blob/25eda17c66f0091dbf6570121e38012749c07d72/solr/core/src/test/org/apache/solr/cloud/CloudExitableDirectoryReaderTest.java#L223 > can clarify it. > > On Mon, Oct 7, 2019 at 8:19 PM Wei <weiwan...@gmail.com> wrote: > > > Hi, > > > > Recently we encountered a problem when solr cloud query latency suddenly > > increase, many simple queries that has small recall gets time out. After > > digging a bit I found that the root cause is some stats queries happen at > > the same time, such as > > > > > > > /solr/mycollection/select?stats=true&stats.field=unique_ids&stats.calcdistinct=true > > > > > > > > I see unique_ids is a high cardinality field so this query is quite > > expensive. But why a small volume of such query blocks other queries and > > make simple queries time out? I checked the solr thread pool and see > there > > are plenty of idle threads available. We are using solr 7.6.2 with a 10 > > shard cloud set up. > > > > Is there a way to block certain solr queries based on url pattern? i.e. > > ignore the stats.calcdistinct request in this case. > > > > > > Thanks, > > > > Wei > > > > > -- > Sincerely yours > Mikhail Khludnev >
