[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Maintenance_bot Cc: thcipriani, mmodell, alaa_wmde, Krinkle, Addshore, Aklapper, Ullas

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

gerritbot added a comment. Change #769397 **abandoned** by Addshore: [mediawiki/extensions/Wikibase@master] selenium waitforTimeout to 20 seconds Reason: https://gerrit.wikimedia.org/r/769397 TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES http

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: thcipriani, mmodell, alaa_wmde, Krinkle, Addshore, Aklapper, Fernandobacasegua34, Astuthiodit_

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Addshore added a comment. I centrally looked at these for quite some time and generally the only thing I found is that most flakiness is caused by CI being slow and us hitting timouts. If all of the timeouts were longer for CI runs (in terms of selnium tests) I expect that less flakiness /

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Addshore added a comment. Oh neat! Yeah that looks like a lovely approach. I'll run my terrible analysis one more time now and then stop, generally I think it's been useful. addshore@contint2001:~$ find /srv/jenkins/builds/*-selenium-*/*/log -maxdepth 1 -mtime -7 | grep -v apach

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, gerritbot Cc: thcipriani, mmodell, alaa_wmde, Krinkle, Addshore, Aklapper, Fernandobacasegua3

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

gerritbot added a comment. Change 769397 had a related patch set uploaded (by Addshore; author: Addshore): [mediawiki/extensions/Wikibase@master] selenium waitforTimeout to 20 seconds https://gerrit.wikimedia.org/r/769397 TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAI

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

thcipriani added a comment. I made a script that parses all Jenkins junit files and puts them in a database. The database (see here ) has about 5 million test cases at this point. A test is flaky when it runs twic

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Addshore added a comment. This is almost not worth putting in a sheet for the last week. addshore@contint2001:~$ find /srv/jenkins/builds/*-selenium-*/*/log -maxdepth 1 -mtime -7 | grep -v apache | xargs cat | grep ✖ | sort | uniq -c | sort -nr 2 npm ERR! ✖ Error: Command f

[Wikidata-bugs] [Maniphest] T277205: Centrally look for flakey browser tests

Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T277205 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Maintenance_bot Cc: alaa_wmde, Krinkle, Addshore, Aklapper, Invadibot, maantietaja, Akuckartz,