Brady Eidson <beid...@apple.com>, 2017-05-13 17:11 -0700: > > > > On May 12, 2017, at 7:43 PM, Ryosuke Niwa <rn...@webkit.org> wrote: > > > > On Fri, May 12, 2017 at 7:31 PM, Alexey Proskuryakov <a...@webkit.org> > > wrote: > >> > >> When there is a test failure that I need to communicate to others, I say > >> something "please open > >> <https://trac.webkit.org/export/216812/webkit/trunk/LayoutTests/fast/images/destroyed-image-load-event.html> > >> in Safari to reproduce". That's very easy to do, and makes it very easy for > >> others to work on the issue. > >> ... > > > > Note that W3C's web-plaform-tests are hosted on > > http://w3c-test.org/tools/runner/index.html so you can could do the > > same thing. > > Note Alexey's URL example points to a specific revision of a specific test. > > A frustration that has often come up while I've been working on > leading-edge features in WebKit is that the w3c-test.org > <http://w3c-test.org/> tests are constantly updated and therefore are a > moving target. One cannot use the same test repeatedly over some length > of time and expect it to remain consistent.
True. But of course the tests are under version control and you can always locate any specific revision of one you want to test against; e.g.: https://raw.githubusercontent.com/w3c/web-platform-tests/b2e3ab7/service-workers/service-worker/activate-event-after-install-state-change.https.html For practical reasons on w3c-test.org we can’t directly archive a runnable copy of every single revision of of every single test. But I would be very willing to look into adding a service somewhere that does something similar to what rawgit.com or whatever do—that is, (1) given a URL like the above for specific revision of a file in a github repo, then (2) load and run it. rawgit.com itself can of course already load specific revisions of WPT tests, but when you try it you’ll run into the general problem of the test files specifying a /resources/testharness.js path to the harness; e.g.: https://rawgit.com/w3c/web-platform-tests/b2e3ab7/service-workers/service-worker/activate-event-after-install-state-change.https.html ...which expects to find https://rawgit.com/resources/testharness.js. But that’s not a hard problem to solve. As I mentioned earlier, I imagine that with very little effort needed, I could get a similar service set up that’s WPT-specific and WPT-aware in that it will have the test harness available at for the /resources/testharness.js URL path. —Mike -- Michael[tm] Smith https://people.w3.org/mike
signature.asc
Description: PGP signature
_______________________________________________ webkit-dev mailing list webkit-dev@lists.webkit.org https://lists.webkit.org/mailman/listinfo/webkit-dev