L. David Baron wrote: > On Saturday 2012-12-22 09:51 -0800, Daniel Holbert wrote: >> Mozilla-central TBPL has a row for "Android 4.0 opt", which isn't >> available on mozilla-inbound or on Try. >> >> I was under the impression that all the tests that get run on >> mozilla-central are supposed to also be run on Try and Inbound. Why is >> this not the case for these "Android 4.0 opt" tests? >>
This was a concious choice with ATeam+Releng to get a number of tests running + visible with a small number of "ready" devices. It is common practice to have things on try/inbound/m-c as well. In a case like "large inbound merge breaks stuff on these tests and only these tests" the intent was that we would simply hide the suite(s) that break and try to figure out the problem out-of-band without forcing the tree closed. I recognize we may not have communicated that plan/desire well enough. [I *believe* edmorley as our paid sheriff knew] We will work to get these enabled on inbound at the least shortly after the holiday to help avoid this problem. > I'd note that if the underlying problem is that we want to test > something where we're *really* constrained in number of test > devices, it might be ok to not run on Try by default and not run on > inbound. But it should be *possible* to run on Try via trychooser, > so that when something like this happens, it can at the very least > be bisected after the fact. If we can't at least do that, then the > tests shouldn't be shown on mozilla-central. It is currently not possible to have an --all run *not* run a certain test type by default (aiui), furthermore since these tests come off of regular android builds, a simple -p android would also trigger them. I *believe* sfink is working on improvements in this are for us, but being able to default-limit and overall improve try capacity/use in ways like this is also on our radar/wanted. -- ~Justin Wood (Callek) _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
