Daily selenium tests https://integration.wikimedia.org/ci/view/selenium-daily/ have been running on both betacluster and catalyst, to evaluate whether Catalyst offers better reliability.
The results over the same 10 suites over the past 14 days (2026-08-13 -> 2026-08-26): Catalyst 98.1% eventually green vs betacluster 61.9% If you would like more than that tl;dr, you can see the full rundown here: https://phabricator.wikimedia.org/T435222#12259705 Because of my caveat in the full rundown above, two more weeks of reliability data will be gathered for daily runs for both environments, and then on September 15th daily selenium tests running on betacluster will be disabled. To follow along from the comfort of your own home, you can go here and sort by "BetaCluster" (descending): https://www.mediawiki.org/wiki/Wikimedia_Quality_Services#Automated_tests_available
_______________________________________________ Wikitech-l mailing list -- [email protected] To unsubscribe send an email to [email protected] https://lists.wikimedia.org/postorius/lists/wikitech-l.lists.wikimedia.org/
