alessandrobenedetti commented on code in PR #2348: URL: https://github.com/apache/solr/pull/2348#discussion_r1552106534
########## solr/modules/ltr/src/test/org/apache/solr/ltr/TestLTRQParserPlugin.java: ########## @@ -137,4 +140,92 @@ public void ltrNoResultsTest() throws Exception { query.add("rq", "{!ltr reRankDocs=3 model=6029760550880411648}"); assertJQ("/query" + query.toQueryString(), "/response/numFound/==0"); } + + @Test + public void ltr_expensiveFeatureRescoring_shouldTimeOutAndReturnPartialResults() + throws Exception { + /* One SolrFeature is defined: {!func}sleep(1000,999) + * It simulates a slow feature extraction, sleeping for 1000ms and returning 999 as a score when finished + * */ + + final String solrQuery = "_query_:{!edismax qf='id' v='8^=10 9^=5 7^=3 6^=1'}"; + final SolrQuery query = new SolrQuery(); + query.setQuery(solrQuery); + query.setFields("*", "score"); + query.setRows(4); + query.setTimeAllowed(300); + query.add("fv", "true"); + query.add("rq", "{!ltr model=slowModel reRankDocs=3}"); + + assertJQ( + "/query" + query.toQueryString(), + "/response/numFound/==4", + "/responseHeader/partialResults/==true", + "/responseHeader/partialResultsDetails/=='Limits exceeded! (Learning To Rank rescoring - " + + "The full reranking didn\\'t complete. " + + "If partial results are tolerated the reranking got reverted and " + + "all documents preserved their original score and ranking.)" + + ": Query limits: [TimeAllowedLimit:LIMIT EXCEEDED]'", + "/response/docs/[0]/id=='8'", + "/response/docs/[0]/score==10.0", + "/response/docs/[1]/id=='9'", + "/response/docs/[1]/score==5.0", + "/response/docs/[2]/id=='7'", + "/response/docs/[2]/score==3.0", + "/response/docs/[3]/id=='6'", + "/response/docs/[3]/score==1.0"); + } + + @Test + public void ltr_expensiveFeatureRescoringAndPartialResultsNotTolerated_shouldRaiseException() + throws Exception { + /* One SolrFeature is defined: {!func}sleep(1000,999) + * It simulates a slow feature extraction, sleeping for 1000ms and returning 999 as a score when finished + * */ + final String solrQuery = "_query_:{!edismax qf='id' v='8^=10 9^=5 7^=3 6^=1'}"; + final SolrQuery query = new SolrQuery(); + query.setQuery(solrQuery); + query.setFields("*", "score"); + query.setRows(4); + query.setTimeAllowed(300); + query.add("partialResults", "false"); + query.add("fv", "true"); + query.add("rq", "{!ltr model=slowModel reRankDocs=3}"); + + assertJQ( + "/query" + query.toQueryString(), + "/error/msg=='org.apache.solr.search.QueryLimitsExceededException: Limits exceeded! (Learning To Rank rescoring - " + + "The full reranking didn\\'t complete. " + + "If partial results are tolerated the reranking got reverted and all documents preserved their original score and ranking.)" + + ": Query limits: [TimeAllowedLimit:LIMIT EXCEEDED]'"); + } + + @Test + public void ltr_expensiveFeatureRescoringWithinTimeAllowed_shouldReturnRerankedResults() + throws Exception { + /* One SolrFeature is defined: {!func}sleep(1000,999) + * It simulates a slow feature extraction, sleeping for 1000ms and returning 999 as a score when finished + * */ + + final String solrQuery = "_query_:{!edismax qf='id' v='8^=10 9^=5 7^=3 6^=1'}"; + final SolrQuery query = new SolrQuery(); + query.setQuery(solrQuery); + query.setFields("*", "score"); + query.setRows(4); + query.setTimeAllowed(5000); + query.add("fv", "true"); Review Comment: I spent some time today on this, at the moment the reranking feature extraction is disconnected from the transformer feature extraction (org.apache.solr.ltr.response.transform.LTRFeatureLoggerTransformerFactory). For the sake of this contribution that specifically focuses on the rescoring, I won't touch that part. But I will add as an additional task, in the output list of Jiras produced by this work, among the others. Then we'll be able to tackle each of them independently. We also have some work in the backlog partially done to re-use the feature extraction between the rescorer and transformer but I had to pause the work because of a lack of funding. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@solr.apache.org For additional commands, e-mail: issues-h...@solr.apache.org