Tobi_WMDE_SW added a comment.

Ok, first, please do not remove the Wikidata jobs, even if they are failing. 
There are several reasons:

1. Due to the high number of scenarios we have, there are almost every time a 
few tests that fail due to timeout or because of a problem with beta. Only if a 
scenario fails more than once in a row, we are concerned and take a detailed 
look. We could discuss of splitting the over-3-hours job into several smaller 
ones, but this is another topic.
2. sometimes when we add tests that actually fail because of a bug in the 
software. So this scenario will continue to fail until we fix the bug in the 
software (if this is in one of our components that have releases, it will only 
be fixed after we released a new version).
3. We are not ignoring failures at all and we are actively working on improving 
our browsertests. But sometimes we just don't have the resources to look at 
broken things immediately, so it could occur from time to time that jobs will 
fail for some time because they are broken.

At the moment we have indeed some problems with falsely failing scenarios - all 
are somehow related to how our selectors (snaktype-, rank-, and badgeselector) 
work. We will probably not be able to look closely at those issues before 
Easter but we will definitely have a look once we have the resources again.

So, no reason to delete those jobs, they are extremely helpful also with some 
failing scenarios. If you don't want them to be reported to the QA-list or the 
releng-channel, we could remove these notifications. Our team will be notified 
by email in any case.


TASK DETAIL
  https://phabricator.wikimedia.org/T94163

REPLY HANDLER ACTIONS
  Reply to comment or attach files, or !close, !claim, !unsubscribe or !assign 
<username>.

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Tobi_WMDE_SW
Cc: Tobi_WMDE_SW, WMDE-Fisch, zeljkofilipin, Aklapper, hashar, Wikidata-bugs, 
aude



_______________________________________________
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

Reply via email to