Status: Untriaged
Owner: ----
CC: b...@chromium.org,  m...@chromium.org,  nsylv...@chromium.org,   
mar...@chromium.org,  p...@chromium.org,  ch...@chromium.org
Labels: Type-Feature Pri-2 OS-All Area-Infrastructure Size-Medium

New issue 18597 by da...@chromium.org: A performance regression should turn  
the buildbot red
http://code.google.com/p/chromium/issues/detail?id=18597

A performance regression should turn the buildbot red

We have lived too long being dependent on sheriffs watching the perf graphs
for regressions.  With the growing number of configurations and ports, this
simply doesn't scale.  We should find a way to automate the flagging of a
performance regression.

We should probably only do this for tests that have a reference build and  
for
which there is a variance measurement.  If the delta between the new build
and the reference build exceeds some multiple of the variance, then we can
call it a regression.

--
You received this message because you are listed in the owner
or CC fields of this issue, or because you starred this issue.
You may adjust your issue notification preferences at:
http://code.google.com/hosting/settings

--~--~---------~--~----~------------~-------~--~----~
Automated mail from issue updates at http://crbug.com/
Subscription options: http://groups.google.com/group/chromium-bugs
-~----------~----~----~----~------~----~------~--~---

Reply via email to