Title: [279844] trunk/Tools
Revision
279844
Author
clo...@igalia.com
Date
2021-07-12 11:56:16 -0700 (Mon, 12 Jul 2021)

Log Message

[GTK] Add a new GTK layout tester bot to build.webkit.org that runs with --skip-failing-tests switch
https://bugs.webkit.org/show_bug.cgi?id=227744

Reviewed by Jonathan Bedard.

On the EWS the layout tests run with this switch --skip-failing-tests
which changes the order in which tests are run (those expected to fail
are not scheduled). I think this may be causing different results on
other tests (like unexpected failures or unexpected flakies).
Having a bot in build.webkit.org running with this switch will help
to detect and garden those cases.

* CISupport/build-webkit-org/config.json:

Modified Paths

Diff

Modified: trunk/Tools/CISupport/build-webkit-org/config.json (279843 => 279844)


--- trunk/Tools/CISupport/build-webkit-org/config.json	2021-07-12 18:52:58 UTC (rev 279843)
+++ trunk/Tools/CISupport/build-webkit-org/config.json	2021-07-12 18:56:16 UTC (rev 279844)
@@ -113,6 +113,7 @@
                     { "name": "gtk-linux-bot-16", "platform": "gtk" },
                     { "name": "gtk-linux-bot-17", "platform": "gtk" },
                     { "name": "gtk-linux-bot-18", "platform": "gtk" },
+                    { "name": "gtk-linux-bot-19", "platform": "gtk" },
 
                     { "name": "jsconly-linux-igalia-bot-1", "platform": "jsc-only" },
                     { "name": "jsconly-linux-igalia-bot-2", "platform": "jsc-only" },
@@ -352,7 +353,8 @@
                       "name": "GTK-Linux-64-bit-Release-Build", "factory": "BuildAndGenerateJSCBundleFactory", "builddir": "gtk-linux-64-release",
                       "platform": "gtk", "configuration": "release", "architectures": ["x86_64"],
                       "triggers": ["gtk-linux-64-release-tests", "gtk-linux-64-release-tests-js", "gtk-linux-64-release-tests-webdriver",
-                                   "gtk-linux-64-release-wayland-tests", "gtk-linux-64-release-perf-tests", "gtk-linux-64-release-gtk4-tests"],
+                                   "gtk-linux-64-release-wayland-tests", "gtk-linux-64-release-perf-tests", "gtk-linux-64-release-gtk4-tests",
+                                   "gtk-linux-64-release-skip-failing-tests"],
                       "workernames": ["gtk-linux-bot-2"]
                     },
                     {
@@ -433,6 +435,12 @@
                       "workernames": ["gtk-linux-bot-18"]
                     },
                     {
+                      "name": "GTK-Linux-64-bit-Release-Skip-Failing-Tests", "factory": "TestAllButJSCFactory", "builddir": "gtk-linux-64-release-skip-failing-tests",
+                      "platform": "gtk", "configuration": "release", "architectures": ["x86_64"],
+                      "additionalArguments": ["--skip-failing-tests"],
+                      "workernames": ["gtk-linux-bot-19"]
+                    },
+                    {
                       "name": "WinCairo-64-bit-WKL-Release-Build", "factory": "BuildFactory", "builddir": "wincairo-wkl-release",
                       "platform": "wincairo", "configuration": "release", "architectures": ["x86_64"],
                       "triggers": ["wincairo-wkl-release-tests", "wincairo-jsc-release-tests"],
@@ -694,6 +702,9 @@
                     { "type": "Triggerable", "name": "gtk-linux-64-release-wayland-tests",
                       "builderNames": ["GTK-Linux-64-bit-Release-Wayland-Tests"]
                     },
+                    { "type": "Triggerable", "name": "gtk-linux-64-release-skip-failing-tests",
+                      "builderNames": ["GTK-Linux-64-bit-Release-Skip-Failing-Tests"]
+                    },
                     { "type": "Triggerable", "name": "wincairo-wkl-release-tests",
                       "builderNames": ["WinCairo-64-bit-WKL-Release-Tests"]
                     },

Modified: trunk/Tools/ChangeLog (279843 => 279844)


--- trunk/Tools/ChangeLog	2021-07-12 18:52:58 UTC (rev 279843)
+++ trunk/Tools/ChangeLog	2021-07-12 18:56:16 UTC (rev 279844)
@@ -1,3 +1,19 @@
+2021-07-12  Carlos Alberto Lopez Perez  <clo...@igalia.com>
+
+        [GTK] Add a new GTK layout tester bot to build.webkit.org that runs with --skip-failing-tests switch
+        https://bugs.webkit.org/show_bug.cgi?id=227744
+
+        Reviewed by Jonathan Bedard.
+
+        On the EWS the layout tests run with this switch --skip-failing-tests
+        which changes the order in which tests are run (those expected to fail
+        are not scheduled). I think this may be causing different results on
+        other tests (like unexpected failures or unexpected flakies).
+        Having a bot in build.webkit.org running with this switch will help
+        to detect and garden those cases.
+
+        * CISupport/build-webkit-org/config.json:
+
 2021-07-12  Jer Noble  <jer.no...@apple.com>
 
         [Cocoa] Incorrect deprecation declaration for -[WKWebView closeAllMediaPresentations:]
_______________________________________________
webkit-changes mailing list
webkit-changes@lists.webkit.org
https://lists.webkit.org/mailman/listinfo/webkit-changes

Reply via email to