Re: Is it possible to fail build if test time increases by X%

[Christopher Orr]

On 01/07/2013 10:57 PM, Keith B. Perry wrote:

Hi all,
Does anyone know how to do this?  Can I fail a build if a test time
increases by a certain percentage?

For example, if a test takes 100 ms today, but tomorrow it takes 5
seconds...can I have Jenkins fail the build?


You can do this for the job as a whole, using the Build Timeout plugin 
and entering a percentage value.  But currently not for individual test 
cases.


Chris

Is it possible to fail build if test time increases by X%

[Keith B. Perry]

Hi all,
Does anyone know how to do this?  Can I fail a build if a test time 
increases by a certain percentage?

For example, if a test takes 100 ms today, but tomorrow it takes 5 
seconds...can I have Jenkins fail the build?

Re: Is it possible to fail build if test time increases by X%

[teilo]

There is no way that I currently know of, and  the company I work for have 
have a need for performance regression tests jobs (so I have looked).  I 
have not yet had time to open an IDE to look at this.
(we want to look at a rolling average rather than the last successful job, 
and also match this to individual tests - so when a new test is introduced 
it doesn't immediately mark the build as unstable!)

On Monday, 7 January 2013 21:57:29 UTC, Keith B. Perry wrote:

 Hi all,
 Does anyone know how to do this?  Can I fail a build if a test time 
 increases by a certain percentage?

 For example, if a test takes 100 ms today, but tomorrow it takes 5 
 seconds...can I have Jenkins fail the build?

Re: Is it possible to fail build if test time increases by X%

[Keith B. Perry]

@teilo - That is pretty much exactly what I am looking for.  This could be 
a fun project, but I am not sure I have time right now.  This would be an 
awesome feature.

On Monday, January 7, 2013 4:49:16 PM UTC-6, teilo wrote:

 There is no way that I currently know of, and  the company I work for have 
 have a need for performance regression tests jobs (so I have looked).  I 
 have not yet had time to open an IDE to look at this.
 (we want to look at a rolling average rather than the last successful job, 
 and also match this to individual tests - so when a new test is introduced 
 it doesn't immediately mark the build as unstable!)

 On Monday, 7 January 2013 21:57:29 UTC, Keith B. Perry wrote:

 Hi all,
 Does anyone know how to do this?  Can I fail a build if a test time 
 increases by a certain percentage?

 For example, if a test takes 100 ms today, but tomorrow it takes 5 
 seconds...can I have Jenkins fail the build?