It's technically already possible by modifying the in-tree mozharness
configs here:
https://dxr.mozilla.org/mozilla-central/source/testing/config/mozharness
However it's not easy to figure out what needs to be modified to get the
desired results. Some sort of |mach try| like command is going to be
worked on in Q2 to make pushing various test configurations to try
easier, I'm not 100% sure how it will be implemented yet though.
In the meantime, if you get stuck trying to modify the mozharness
configs, let me know and I can come up with an example patch.
-Andrew
On 31/03/15 01:06 PM, Bobby Holley wrote:
This sounds awesome! Is there an estimate of when we'll be able to use
it for try pushes?
On Tue, Mar 31, 2015 at 9:30 AM, Andrew Halberstadt
<ahalberst...@mozilla.com <mailto:ahalberst...@mozilla.com>> wrote:
As of bug 987360, you can now run all tests with a given tag for
mochitest (and variants), xpcshell and marionette based harnesses.
Tags can be applied to either individual tests, or the DEFAULT
section in manifests. Tests can have multiple tags, in which case
they should be comma delimited. To run all tests with a given tag,
pass in --tag <tag name> to the mach command.
For example, let's say we want to group all mochitest-plain tests
related to canvas together. First we'd add a 'canvas' tag to the
DEFAULT section in
https://dxr.mozilla.org/mozilla-central/source/dom/canvas/test/mochitest.ini
[DEFAULT]
tags = canvas
We notice there is also a canvas related test under dom/media, namely:
https://dxr.mozilla.org/mozilla-central/source/dom/media/test/mochitest.ini#541
Let's pretend it is already tagged with the 'media' tag, but
that's ok, we can add a second tag no problem:
[test_video_to_canvas.html]
tags = media,canvas
Repeat above for any other tests or manifests scattered in the
tree that are related to canvas. Now we can run all
mochitest-plain tests with:
./mach mochitest-plain --tag canvas
You can also run the union of two tags by specifying --tag more
than once (though the intersection of two tags is not supported):
./mach mochitest-plain --tag canvas --tag media
So far the xpcshell (./mach xpcshell-test --tag name) and
marionette (./mach marionette-test --tag name) commands are also
supported. Reftest is not supported as it has its own special
manifest format.
Applying tags to tests will not affect automation or other
people's tags. So each organization or team should feel free to
use tags in whatever creative ways they see fit. Eventually, we'll
start using tags as a foundation for some more advanced features
and analysis. For example, we may implement a way to run all tests
with a given tag across multiple different suites.
If you have any questions or things aren't working, please let me
know!
Cheers,
Andrew
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org <mailto:dev-platform@lists.mozilla.org>
https://lists.mozilla.org/listinfo/dev-platform
_______________________________________________
dev-platform mailing list
dev-platform@lists.mozilla.org
https://lists.mozilla.org/listinfo/dev-platform
