[
https://issues.apache.org/jira/browse/SOLR-17058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17820424#comment-17820424
]
Mikhail Khludnev commented on SOLR-17058:
-----------------------------------------
it's getting hard
https://jenkins.thetaphi.de/job/Solr-main-Linux/16962/testReport/junit/org.apache.solr.search.stats/TestDistribIDF/testDisableDistribStats/
{code}
java.lang.AssertionError: stats cache hit
at
__randomizedtesting.SeedInfo.seed([49199A151AFC9EA9:6597E49760A04294]:0)
at org.junit.Assert.fail(Assert.java:89)
at org.junit.Assert.assertTrue(Assert.java:42)
at org.junit.Assert.assertNotNull(Assert.java:713)
at
org.apache.solr.search.stats.TestDistribIDF.testDisableDistribStats(TestDistribIDF.java:317)
2> 773102 INFO (qtp1142183320-19669-null-15135) [n:127.0.0.1:37825_solr
c:collection1 s:a r:core_node5 x:collection1_a_replica_n2 t:null-15135]
o.a.s.c.S.Request webapp=/solr path=/select
params={df=text&distrib=false&debug=track&debug=track&_stateVer_=collection1:4&fl=id&fl=score&shards.purpose=16708&start=0&fsv=true&rid=null-15135&rows=10&version=2&q=cat:electronics&omitHeader=false&requestPurpose=GET_TOP_IDS,GET_FIELDS,GET_DEBUG,SET_TERM_STATS&NOW=1708807923153&isShard=true&distrib.statsCache=true&wt=javabin}
hits=0 status=0 QTime=0
2> 773102 INFO (qtp2067979521-19695-null-15135) [n:127.0.0.1:38125_solr
c:collection1 s:c r:core_node6 x:collection1_c_replica_n4 t:null-15135]
o.a.s.c.S.Request webapp=/solr path=/select
params={df=text&distrib=false&debug=track&debug=track&_stateVer_=collection1:4&fl=id&fl=score&shards.purpose=16708&start=0&fsv=true&rid=null-15135&rows=10&version=2&q=cat:electronics&omitHeader=false&requestPurpose=GET_TOP_IDS,GET_FIELDS,GET_DEBUG,SET_TERM_STATS&NOW=1708807923153&isShard=true&distrib.statsCache=true&wt=javabin}
hits=0 status=0 QTime=0
2> 773102 INFO (qtp786513658-19680-null-15135) [n:127.0.0.1:44053_solr
c:collection1 s:b r:core_node3 x:collection1_b_replica_n1 t:null-15135]
o.a.s.c.S.Request webapp=/solr path=/select
params={df=text&distrib=false&debug=track&debug=track&_stateVer_=collection1:4&fl=id&fl=score&shards.purpose=16708&start=0&fsv=true&rid=null-15135&rows=10&version=2&q=cat:electronics&omitHeader=false&requestPurpose=GET_TOP_IDS,GET_FIELDS,GET_DEBUG,SET_TERM_STATS&NOW=1708807923153&isShard=true&distrib.statsCache=true&wt=javabin}
hits=0 status=0 QTime=0
2> 773102 INFO (qtp2067979521-19681-null-15135) [n:127.0.0.1:38125_solr
c:collection1 s:c r:core_node6 x:collection1_c_replica_n4 t:null-15135]
o.a.s.c.S.Request webapp=/solr path=/select
params={q=cat:electronics&debug=track&_stateVer_=collection1:4&fl=id,score&distrib.statsCache=true&wt=javabin&version=2}
rid=null-15135 hits=0 status=0 QTime=2
- org.apache.solr.search.stats.TestDistribIDF.testDisableDistribStats
(:solr:core)
Test output:
/home/jenkins/workspace/Solr-main-Linux/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.stats.TestDistribIDF.txt
Reproduce with: gradlew :solr:core:test --tests
"org.apache.solr.search.stats.TestDistribIDF.testDisableDistribStats"
-Ptests.jvms=6 -Ptests.haltonfailure=false
"-Ptests.jvmargs=-XX:+UseCompressedOops -XX:+UseSerialGC"
-Ptests.seed=49199A151AFC9EA9 -Ptests.multiplier=3 -Ptests.badapples=false
-Ptests.file.encoding=UTF-8
{code}
> Request param to disable distributed stats request at query time
> ----------------------------------------------------------------
>
> Key: SOLR-17058
> URL: https://issues.apache.org/jira/browse/SOLR-17058
> Project: Solr
> Issue Type: New Feature
> Components: query
> Reporter: wei wang
> Assignee: Mikhail Khludnev
> Priority: Minor
> Fix For: 9.6.0
>
> Time Spent: 3h 20m
> Remaining Estimate: 0h
>
> When distributed IDF is enabled in solr cloud by adding one of the cache
> implementations in solrconfig.xml
> [https://solr.apache.org/guide/solr/latest/deployment-guide/solrcloud-distributed-requests.html#distributedidf],
> each solr query will incur a distributed shard request to get term
> statistics
> "debug": {
> "track": {
> "rid": "-54",
> "PARSE_QUERY": {
> "http://192.168.0.34:8987/solr/shard2_replica_n1/":
> { "QTime": “2”,
>
> "ElapsedTime": "13",
>
> "RequestPurpose": "GET_TERM_STATS",
> …
>
> For queries that does not use distributed IDF information for scoring
> such as terms filter by id, the stats request is not necessary. Hence I
> propose to add a {{distrib.statsCache}} request param so that the distributed
> stats request can be disabled at query time.
> # {{distrib.statsCache}} defaults to {{{}true{}}}. When the param is not
> present, there is no change to current distributed IDF behavior.
> # When explicitly set {{{}distrib.statsCache{}}}{{{}=false{}}}, distributed
> stats call is disabled for the current query.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
