Chromium already has a ton of architecture for automated runs of the PLT which I'm sure they'd be happy to share. (e.g. http://build.chromium.org/f/chromium/perf/dashboard/overview.html) The problem remains that (aside from the SVG PLT no one uses) we have no publicly available PLT content. :)
-eric On Tue, Dec 21, 2010 at 1:23 PM, Simon Fraser <simon.fra...@apple.com> wrote: > On Dec 21, 2010, at 11:14 AM, Darin Adler wrote: > >> Here’s my attempt to list the tests we currently have: >> >> - Automated regression tests (from LayoutTests directory). Many different >> types: Layout/pixel, text, script-tests, ref-tests coming soon, some >> requiring local server, some JavaScript only. Better organization needed. >> Need to replace old driver with new driver for non-Chromium platforms. Our >> #1 most critical tests. Includes copies of some entire test suites, such as >> ietestcenter and CSS 2.1 and sputnik. >> >> - Manual regression tests (in WebCore/manual-tests directory). These >> would be in the primary regression tests if we found a way to automate them. >> A good project for a contributor would be to convert these to automated >> tests one at a time to try to empty this directory. >> >> - Automated DOM binding generation regression tests (in >> WebCore/bindings/scripts/test). >> >> - JavaScript regression tests from Mozilla (in >> JavaScriptCore/tests/mozilla). We would like run-webkit-tests to know how to >> run these, but currently it does not. >> >> - SunSpider JavaScript performance test (in SunSpider). >> >> - SVG page load test performance test (in PageLoadTests/svg). I am not >> familiar with this one. >> >> - Platform-specific unit tests (in WebKit/chromium/tests, >> WebKit/gtk/tests, and WebKit/qt/tests). Not familiar with these, how they >> are run, or what their coverage are. >> >> - Python regression tests. Not sure where they are, but I see these >> failing on the bots so I know they exist. >> >> Maybe this list will give us some ideas about how we want to organize tests >> in the future. > > Plus in some shiny future: > - automatable performance tests > > Simon > > _______________________________________________ > webkit-dev mailing list > webkit-dev@lists.webkit.org > http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev > _______________________________________________ webkit-dev mailing list webkit-dev@lists.webkit.org http://lists.webkit.org/mailman/listinfo.cgi/webkit-dev