Hi,
I have some ideas, but also want some more input.
Probably most important is this:
Do we just want something for immediate feedback for a particular benchmark?
We run sysbench, sqlbench, and dbt2 and each is a bit different.
Sysbench / dbt2 seem like reasonably easy for something immediate.
sqlbench might take more thought.
If we want to go further, let's take sysbench and see what we record /
compare on a run (see below).
We need to define:
1) What constitutes a failure?
We need to set a threshold that will flag the run as 'failed' and ask if
we want to weight higher Conc values, etc. How do we determine this?
If we can agree on numbers/specs, we can cook something up : )
Should we consider a means of bypassing it? Perhaps a Jenkins param like
'no-fail'?
2) What do we want to do with the data on a failure? Do we want to just
remove the run? (I need to refresh my memory on how drizzle-automation
currently handles things)
sysbench reporting from drizzle-automation
TRENDING OVER LAST 5 runs
Conc TPS % Diff from Avg Diff Min Max Avg
STD
====================================================================================================
16 1559.16 -1.41% -22.32 1520.65 1648.55 1581.48
38.27
32 1607.94 +0.91% 14.53 1518.84 1647.13 1593.41
31.62
64 1661.55 +1.34% 21.91 1589.73 1670.76 1639.64
27.31
128 1628.54 +1.88% 30.13 1558.49 1637.52 1598.41
21.22
256 1449.82 +0.31% 4.43 1430.21 1455.69 1445.40
8.61
512 1256.34 -0.28% -3.48 1251.02 1269.28 1259.83
5.96
1024 896.99 +0.77% 6.87 874.78 904.07 890.13
8.86
Thanks,
Patrick
On 03/04/2012 10:01 PM, Brian Aker wrote:
Hi!
I just pushed a patch that fixed a recent performance regression. We
record performance data but currently Jenkins won't flag these issues.
Anyone want to tackle this problem?
Cheers,
-Brian
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list: https://launchpad.net/~drizzle-discuss
Post to : [email protected]
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help : https://help.launchpad.net/ListHelp
