Hi, On Mar 6, 2012, at 10:27 AM, pcrews wrote:
> 1) What constitutes a failure?
> We need to set a threshold that will flag the run as 'failed' and ask if we
> want to weight higher Conc values, etc. How do we determine this? If we can
> agree on numbers/specs, we can cook something up : )
5% :)
> Should we consider a means of bypassing it? Perhaps a Jenkins param like
> 'no-fail'?
Yes. For instance an improvement on the upper end of thread usage that hurts
the bottom usage is a good thing.
> 2) What do we want to do with the data on a failure? Do we want to just
> remove the run? (I need to refresh my memory on how drizzle-automation
> currently handles things)
I hope so, but I don't know that we do. Most of the time nothing should make it
past build. We could toss in a third tier and have randgen run before
benchmarks.
Cheers,
-Brian
signature.asc
Description: Message signed with OpenPGP using GPGMail
_______________________________________________ Mailing list: https://launchpad.net/~drizzle-discuss Post to : [email protected] Unsubscribe : https://launchpad.net/~drizzle-discuss More help : https://help.launchpad.net/ListHelp
