[
https://issues.apache.org/jira/browse/SOLR-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13414803#comment-13414803
]
Mark Miller commented on SOLR-2646:
-----------------------------------
I've got a fair amount of this automated now. It's still somewhat hackey though.
Because you need to apply the benchmark patch to get things working, I count on
that checkout existing and being patched in a specific location. It drives the
benchmark, but talks to a running Solr that is started from a checkout. I use
git so that it's really cheap to flip through revs and run benchmarks.
The main driver is an ugly .sh script - it accepts a few params (name of the
chart, where to write result files, location of alg file, date range of
checkouts to run the alg against, and the interval to try between days).
For instance, you might say, run the indexing benchmark over the period of
2012-01-04 to 2012-07-15 and do it once for every 5 days.
This happens and the output of the benchmarks are dumped into a folder.
Then I have a simple java cmd line app that will process the result folder. It
takes a chart name, the location of results folder, and a list of named regexes
- each regex pointing to the pertinent data to pull from the results file. The
java app pulls out all the data, writes a csv file, and outputs a simple line
chart.
I don't know how cleaned up this will get, i won't post any of it for now - but
I may get to the point of running some stuff locally automatically and pushing
to a webserver with the charts etc, al la Lucene.
> Integrate Solr benchmarking support into the Benchmark module
> -------------------------------------------------------------
>
> Key: SOLR-2646
> URL: https://issues.apache.org/jira/browse/SOLR-2646
> Project: Solr
> Issue Type: New Feature
> Reporter: Mark Miller
> Assignee: Mark Miller
> Fix For: 4.0
>
> Attachments: Dev-SolrBenchmarkModule.pdf, SOLR-2646.patch,
> SOLR-2646.patch, SOLR-2646.patch, SOLR-2646.patch,
> SolrIndexingPerfHistory.pdf, chart.jpg
>
>
> As part of my buzzwords Solr pef talk, I did some work to allow some Solr
> benchmarking with the benchmark module.
> I'll attach a patch with the current work I've done soon - there is still a
> fair amount to clean up and fix - a couple hacks or three - but it's already
> fairly useful.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
