On Saturday 2012-12-22 09:51 -0800, Daniel Holbert wrote: > Mozilla-central TBPL has a row for "Android 4.0 opt", which isn't > available on mozilla-inbound or on Try. > > I was under the impression that all the tests that get run on > mozilla-central are supposed to also be run on Try and Inbound. Why is > this not the case for these "Android 4.0 opt" tests? > > (Context: This morning, we had a large (155 cset) merge from inbound to > central, and something in it appears to have caused major bustage on the > "Android 4.0 opt" platform. Unfortunately we didn't catch it on inbound, > and we don't have any quick-and-easy way to narrow down which of those > 155 csets in the merge caused the problem, because there are no "Android > 4.0 opt" test-runs on inbound. We also can't test a fix on Try, because > this doesn't seem to be available there. > https://bugzilla.mozilla.org/show_bug.cgi?id=824276 is tracking the issue)
I'd note that if the underlying problem is that we want to test something where we're *really* constrained in number of test devices, it might be ok to not run on Try by default and not run on inbound. But it should be *possible* to run on Try via trychooser, so that when something like this happens, it can at the very least be bisected after the fact. If we can't at least do that, then the tests shouldn't be shown on mozilla-central. -David -- 𝄞 L. David Baron http://dbaron.org/ 𝄂 𝄢 Mozilla http://www.mozilla.org/ 𝄂 _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
