[
https://issues.apache.org/jira/browse/SOLR-17661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17959575#comment-17959575
]
Houston Putman commented on SOLR-17661:
---------------------------------------
This is failing very often on Crave for me nowadays. It turns out that the slow
model that this test uses takes 1 second to load, and the test's query timeout
is 300 ms. If the search times-out before the reranking starts, the test will
fail. So an easy fix is to increase the timeout to something just under 1s
(800ms). I'm not sure why the query is so slow on crave, but this seemed like
the easier fix that doesn't slow the test down at all.
> Flaky test:
> TestLTRQParserPlugin.ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults
> ---------------------------------------------------------------------------------------------------
>
> Key: SOLR-17661
> URL: https://issues.apache.org/jira/browse/SOLR-17661
> Project: Solr
> Issue Type: Test
> Components: contrib - LTR
> Reporter: David Smiley
> Priority: Minor
>
> TestLTRQParserPlugin.ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults
> is flaky (aka a flapper). See
> [develocity|https://develocity.apache.org/scans/tests?search.relativeStartTime=P90D&search.rootProjectNames=solr-root&search.timeZoneId=America%2FNew_York&tests.container=org.apache.solr.ltr.TestLTRQParserPlugin&tests.test=ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults]
> and
> [fucit|http://fucit.org/solr-jenkins-reports/history-trend-of-recent-failures.html#series/org.apache.solr.ltr.TestLTRQParserPlugin.ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults].
> {noformat}
> java.lang.AssertionError: mismatch: '4'!='0' @ response/numFound
> 2025-02-08T16:59:43.0317686Z at
> __randomizedtesting.SeedInfo.seed([8D9A051D8B7F602C:3DA5B3239B06B220]:0)
> 2025-02-08T16:59:43.0321872Z at org.junit.Assert.fail(Assert.java:89)
> 2025-02-08T16:59:43.0322542Z at
> org.apache.solr.util.RestTestBase.assertJsonMatches(RestTestBase.java:268)
> 2025-02-08T16:59:43.0323357Z at
> org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:210)
> 2025-02-08T16:59:43.0326697Z at
> org.apache.solr.util.RestTestBase.assertJQ(RestTestBase.java:182)
> 2025-02-08T16:59:43.0331325Z at
> org.apache.solr.ltr.TestLTRQParserPlugin.ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults(TestLTRQParserPlugin.java:160)
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
