Re: Is it possible to fail build if test time increases by X%

[Christopher Orr]

On 01/07/2013 10:57 PM, Keith B. Perry wrote:

Hi all,
Does anyone know how to do this?  Can I fail a build if a test time
increases by a certain percentage?

For example, if a test takes 100 ms today, but tomorrow it takes 5
seconds...can I have Jenkins fail the build?


You can do this for the job as a whole, using the Build Timeout plugin 
and entering a percentage value.  But currently not for individual test 
cases.


Chris

Re: Is it possible to fail build if test time increases by X%

[Keith B. Perry]

@teilo -> That is pretty much exactly what I am looking for.  This could be 
a fun project, but I am not sure I have time right now.  This would be an 
awesome feature.

On Monday, January 7, 2013 4:49:16 PM UTC-6, teilo wrote:
>
> There is no way that I currently know of, and  the company I work for have 
> have a need for performance regression tests jobs (so I have looked).  I 
> have not yet had time to open an IDE to look at this.
> (we want to look at a rolling average rather than the last successful job, 
> and also match this to individual tests - so when a new test is introduced 
> it doesn't immediately mark the build as unstable!)
>
> On Monday, 7 January 2013 21:57:29 UTC, Keith B. Perry wrote:
>>
>> Hi all,
>> Does anyone know how to do this?  Can I fail a build if a test time 
>> increases by a certain percentage?
>>
>> For example, if a test takes 100 ms today, but tomorrow it takes 5 
>> seconds...can I have Jenkins fail the build?
>>
>

Re: Is it possible to fail build if test time increases by X%

[teilo]

There is no way that I currently know of, and  the company I work for have 
have a need for performance regression tests jobs (so I have looked).  I 
have not yet had time to open an IDE to look at this.
(we want to look at a rolling average rather than the last successful job, 
and also match this to individual tests - so when a new test is introduced 
it doesn't immediately mark the build as unstable!)

On Monday, 7 January 2013 21:57:29 UTC, Keith B. Perry wrote:
>
> Hi all,
> Does anyone know how to do this?  Can I fail a build if a test time 
> increases by a certain percentage?
>
> For example, if a test takes 100 ms today, but tomorrow it takes 5 
> seconds...can I have Jenkins fail the build?
>

Is it possible to fail build if test time increases by X%

[Keith B. Perry]

Hi all,
Does anyone know how to do this?  Can I fail a build if a test time 
increases by a certain percentage?

For example, if a test takes 100 ms today, but tomorrow it takes 5 
seconds...can I have Jenkins fail the build?