[
https://issues.apache.org/jira/browse/SOLR-16525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18018410#comment-18018410
]
David Smiley commented on SOLR-16525:
-------------------------------------
I've already started to explore executing the benchmark scripts, and even
pushed a trivial fix to your PR :)
Thanks so much for re-invigorating this important effort Jason! I loved what
you wrote; I don't have any recommendations to do differently or other things.
You've really thought about this carefully. I like that you are focusing on
starting small to increase chances of success, so you say, but you don't give
yourself enough credit for your MVP over in the sandbox ;)
One aspect of the effort you are maybe deliberately deferring is the
+publishing+ aspect. The Lucene project publishes continuous results in a
human consumable format that show changes over time of many executions. And
there's even a list of interesting commits with notes. This can come later; we
first need the benchmarks. Then it needs to run somewhere continuously
(nightly?). Then to capture the results over time, instead of only the
current/last run. Then to publish / render them for human consumption.
> Periodic performance benchmarking
> ---------------------------------
>
> Key: SOLR-16525
> URL: https://issues.apache.org/jira/browse/SOLR-16525
> Project: Solr
> Issue Type: Task
> Reporter: Ishan Chattopadhyaya
> Priority: Major
> Attachments: Screenshot from 2023-01-14 17-39-42.png, Screenshot from
> 2023-02-08 04-15-34.png, image-2022-11-09-13-23-21-131.png,
> logs-stress-facets-local.json-b9f5f9ffed8e0c1af679911db6af698d18ab8fe1.zip,
> logs-stress-facets-local.json-ebc823a599160914f7f0f2694f64a53d9cd20268.zip,
> periodic-benchmarks.odp, periodic-benchmarks.pdf
>
>
> This issue is about periodic performance testing of Solr commits against
> pre-written suites of performance tests.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
