[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dalba]

Dalba added a comment.
I think it would be rather easy to add live tests to tox.ini so that Jenkins will run them. The problem is that live tests are not fully deterministic and fail from time to time due to various reasons and that will result in false -1s on patch-sets. Also, they take nearly 10-15 minutes to complete...TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.
It seems too long to me, especially for patches which does not change the code at all (doc patches...). I like we reduced Jenkins test time to 2 minutes lately. I would love the keyword option (test only on request), but #release-engineering-team seems to be busy/does not respond to my question.TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Legoktm]

Legoktm added a comment.
We have a lot of flexibility with jenkins, we could have it run the longer tests in a separate queue (so the developer will get feedback on the standard voting tests faster), post the result back to the patch, but not give it a vote based on the results of the tests. Would that meet the current needs?TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LegoktmCc: Legoktm, Framawiki, Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, Sc4s2cg, A.S.Kochergin, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.
I think it would do, yes!TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DvorapaCc: Legoktm, Framawiki, Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, Sc4s2cg, A.S.Kochergin, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Xqt]

Xqt added a comment.

In T186208#4269825, @Legoktm wrote:
Would that meet the current needs?


+1TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: XqtCc: Legoktm, Framawiki, Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, Sc4s2cg, A.S.Kochergin, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Legoktm]

Legoktm added a comment.
OK the one thing I missed...what is the command to run the slow/full test suite?TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LegoktmCc: Legoktm, Framawiki, Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, Sc4s2cg, A.S.Kochergin, God, Tbscho, MayS, Salgo60, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dalba]

Dalba added a comment.

In T186208#4270931, @Legoktm wrote:
OK the one thing I missed...what is the command to run the slow/full test suite?


Assuming that dependencies are installed and the user-config.py is generated (with a valid username and password), python -m unittest tests while the environment variable PYWIKIBOT2_TEST_WRITE=1 is set,  should run all the tests that we need.TASK DETAILhttps://phabricator.wikimedia.org/T186208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DalbaCc: Legoktm, Framawiki, Dalba, Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, A.S.Kochergin, God, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, Liudvikas, Luke081515, mys_721tx, jayvdb, Masti, zeljkofilipin, Alchimista, Rxy, hashar, greg___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  In T186208#4998959 , 
@hashar wrote:
  
  > Hello, this got raised to #release-engineering-team 
 meeting last 
Monday, thought I was busy with other random duties.
  >  This week will be easier so I gotta review the request but in short 
Wikimedia CI does not support Travis or AppVeyor at all.
  
  
  I understand. Some other devs already told me you were all busy last week and 
you are busy in general.
  
  > For Travis, it is heavily tight to github and we cant reproduce that with 
Gerrit and our CI (Jenkins/Zuul/Docker).  That being said, most of the time it 
is very straightforward to rewrite the travis logic to a Jenkins job.
  
  The basic thing why we are running Travis and Appveyor is to run unittests 
and nosetests and some others on multiple devices, like 32bit, 64bit, Win, 
Linux, Mac, Python 2.7, 3.4, 3.5, 3.6, 3.7 and 3.8. I mean various combinations 
of those and various presets (pwb env variables on/off, several Wikimedia 
wikis). The logic of both services are really close to one another, so it 
should be ok to merge the main points in Wikimedia CI. Also in my opinion there 
is no need to test py2.7, 3.4 and also perhaps 32bit anymore (as these are 
slowly ending their career).
  
  > AppVeyor I don't think I have ever heard of it. But I guess it is a third 
party closed source software and we would probably not be able to reproduce it.
  
  The config and the logs could be examined to get the idea of what these 
services are doing:
  https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/.travis.yml
  https://travis-ci.org/wikimedia/pywikibot/builds
  
  https://phabricator.wikimedia.org/diffusion/PWBC/browse/master/.appveyor.yml
  https://ci.appveyor.com/project/ladsgroup/pywikibot-g4xqx
  
  > Note: we used to have a Jenkins job that ran the pywikibot tests against 
the #beta-cluster-infrastructure 
 
(901f445d1058f55d8ceae23cff4cf7b58537a778 

 (T100903 ).
  >  ) but it was broken/never completed and I have removed it T188256 
. The job was doing:
  > 
  >   export PYWIKIBOT2_DIR=$WORKSPACE
  >   export TOX_TESTENV_PASSENV=PY_COLORS
  >   export PY_COLORS=1
  >   tox -e venv -- pip install --upgrade ndg-httpsclient
  >   tox -e venv -- python -m generate_family_file 
'http://en.wikipedia.beta.wmflabs.org/' 'wpbeta' 'y'
  >   tox -e venv -- python -m generate_user_files -dir:$WORKSPACE 
-family:wpbeta -lang:en -v
  >   echo "console_encoding='utf8'" >> $WORKSPACE/user-config.py
  >   tox -e venv -- pip install -rdev-requirements.txt
  >   tox -e venv -- python setup.py nosetests --tests tests --verbosity=2 -a 
'"family=wpbeta,code=en"'
  >
  > 
  > We can look at moving that as a script directly into `pywikibot/core.git`, 
add a new testenv in tox (eg: `integration-beta`) and then simply have a 
Jenkins job that invokes that testenv. Then move forward and fix it :)
  
  I see, the point was to test the every new MediaWiki version coming up. We 
run some beta-cluster tests on Travis and Appveyor currently, so it should be 
easy to mimick it. It should be ok to add a script or a plaintext list of 
commands into the repo.
  
  The main issue (as you can see by the priority) is this one, the formerly 
known Magul's quick Travis test. Every Gerrit patchset is tested by unittest, 
nosetest, doctest, some other similar stuff, but all on one platform with one 
exact presets. The Travis/Appveyor tests are quite heavy and time-consuming 
(They are running in several environments to compare), so there is no need to 
run them on every patchset. But if we added Magul back then into reviewers, 
he/his tool run the unittests on Travis on demand. This is what we currently 
miss the most I think as Travis and Appveyor after merge are still working for 
us (although we have no access to the Wikimedia Appveyor account and perhaps 
neither Wikimedia has), so there is no need to hurry with moving completely to 
Wikimedia CI. Also we run beta-cluster tests there, so also not a priority I 
think.
  
  The easy solution for the top priority Magul's test replacement would be 
something like this: Someone enters a magic keyword in the Gerrit patchset 
comment -> Wikimedia CI registers it and creates a pull request to GitHub with 
the code (perhaps using GH API, also closes it immediately as it wil not be 
needed on GitHub) -> and GitHub-Travis-Appveyor handles the rest of the work.
  
  The harder solution would be to mimick Travis/Appveyor in Wikimedia CI as you 
said, then when someone enters a magic keyword in the Gerrit patchset comment 
or someone +2 the patchset -> Wikimedia CI registers it and runs the tox on 
predefined

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  Currently running:
  
  | When| What  
  | Where| 
status  |
  | on every patchset and on +2 | nose, nose32, style and doctest   
  | Jenkins CI   | 
ok  |
  | postmerge   | doctest, generates docs   
  | Jenkins CI   | 
ok  |
  | postmerge   | nose, style, doc, unittest on various wikis, 
py versions, environments, platforms and architectures | Travis, Appveyor | 
ok with some smaller issues |
  | postmerge   | coverage and redundancy   
  | Codecov, Codeclimate | 
ok with some smaller issues |
  |
  
  Wishes and broken:
  
  | When   | What   
| Where 
  | status|
  | on demand for one patchset | nose and unittest on various wikis, py 
versions, environments, platforms and architectures | Magul's tool activating 
Travis CI   | down, high priority   |
  | postmerge  | nose and unittest on various wikis, py 
versions, environments, platforms and architectures | Wikimedia CI instead of 
Travis/Appveyor | wish, lowest priority |
  |
  
  Bypassed partially:
  
  | When   | What   
 | Where| status|
  | before new MediaWiki version comes out | nose and unittest of current 
master on beta-cluster | anywhere | wish, medium priority |
  | postmerge  | nose and unittest on beta-cluster  
 | Travis, Appveyor | ok|

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar, Dvorapa
Cc: hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, Magul, 
Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  In T186208#408 , 
@hashar wrote:
  
  > The Wikimedia CI uses a Docker container that runs tox. It recently got 
support for python 2.7, 3.4, 3.5, 3.6 and 3.7 T191764 
. We should be able to add them 
right now in `tox.ini` and add CI jobs for them.
  
  
  Amazing! I didn't know about this. That makes things much easier.

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar, Dvorapa
Cc: hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, Magul, 
Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  Other tests we are running:
  
  | When  | What



| Where 

| status |
  | on every patchset and on +2   | style 
, nose 
, 
nose34 
 
and doctest 
 | 
Jenkins CI  
  | ok |
  | postmerge | doctest and doc generation 
  


 | Jenkins CI   

 | ok |
  | postmerge | coverage and redundancy test



| Codecov 
 and Codeclimate 
 | 
ok |
  | on every patchset for novices | styletest   



| Jenkins CI

| ok |

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar, Dvorapa
Cc: hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, Magul, 
Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[hashar]

hashar added a comment.


  From the `.travis.yml` file. Some global environment variables:
  
env:
  global:
- TEST_TIMEOUT=300
- PYWIKIBOT_NO_L10N_TESTS=1
  
  Then there are two set of globals:
  
env:
  matrix:
- LANGUAGE=en FAMILY=wikipedia PYWIKIBOT_TEST_PROD_ONLY=1
- LANGUAGE=zh FAMILY=wikisource PYSETUP_TEST_EXTRAS=1 
PYWIKIBOT_TEST_PROD_ONLY=1 PYWIKIBOT_TEST_NO_RC=1
  
  Then there are 13 entries in the matrix, one of them is allowing to fail 
(python 3.8-dev). The huge combination of 26 axis ends up being:
  
  | python| FAMILY  | LANGUAGE | OAUTH_DOMAIN   
 | PYSETUP_TEST_EXTRAS | NO_L10N_TESTS | SITE_ONLY | TEST_NO_RC | 
PROD_ONLY | TEST_TIMEOUT |
  | - | --- |  | 
--- | --- | - | 
- | -- | - |  |
  | 2.7_with_system_site_packages | wikipedia   | nb   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 2.7   | wpbeta  | en   | 
"en.wikipedia.beta.wmflabs.org" | None| 1 | 1   
  | None   | 1 | 300  |
  | 3.6   | wpbeta  | zh   | 
"zh.wikipedia.beta.wmflabs.org" | None| 1 | 1   
  | None   | 1 | 300  |
  | 3.4   | wsbeta  | en   | None   
 | None| 0 | 1 | None   | 1 
| 300  |
  | 2.7   | wikia   | wikia| None   
 | None| 1 | None  | 1  | 1 
| 300  |
  | 3.5   | musicbrainz | en   | None   
 | None| 1 | 1 | None   | 1 
| 300  |
  | 3.4   | wikipedia   | test | 
"test.wikipedia.org"| None| 1 | 1   
  | None   | 1 | 300  |
  | 3.4   | wikidata| test | None   
 | None| 1 | 1 | None   | 1 
| 300  |
  | 3.4   | wiktionary  | ar   | None   
 | None| 1 | None  | 1  | 1 
| 300  |
  | 3.6   | wikidata| wikidata | None   
 | None| 1 | 1 | None   | 1 
| 300  |
  | 3.7   | wikipedia   | de   | None   
 | None| 1 | None  | None   | 1 
| 300  |
  | 3.8-dev   | wikipedia   | test | None   
 | None| 1 | 1 | None   | 1 
| 300  |
  | 3.8-dev(failling) | wikipedia   | test | None   
 | None| 1 | 1 | None   | 1 
| 300  |
  | 2.7_with_system_site_packages | wikipedia   | nb   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 2.7   | wpbeta  | en   | 
"en.wikipedia.beta.wmflabs.org" | 1   | 1 | 1   
  | 1  | 1 | 300  |
  | 3.6   | wpbeta  | zh   | 
"zh.wikipedia.beta.wmflabs.org" | 1   | 1 | 1   
  | 1  | 1 | 300  |
  | 3.4   | wsbeta  | en   | None   
 | 1   | 0 | 1 | 1  | 1 
| 300  |
  | 2.7   | wikia   | wikia| None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 3.5   | musicbrainz | en   | None   
 | 1   | 1 | 1 | 1  | 1 
| 300  |
  | 3.4   | wikipedia   | test | 
"test.wikipedia.org"| 1   | 1 | 1   
  | 1  | 1 | 300  |
  | 3.4   | wikidata| test | None   
 | 1   | 1 | 1 | 1  | 1 
| 300  |
  | 3.4   | wiktionary  | ar   | None   
 | 1   | 1  

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[hashar]

hashar added a comment.


  A few things that are worth investigating and probably could use to be 
simplified.
  
  sudo
  
  
  The default is `sudo: false`, a few environments do have `sudo: require` when 
they have `dist: xenial`:
  
include:
- python: '2.7_with_system_site_packages'
  env: LANGUAGE=nb FAMILY=wikipedia PYSETUP_TEST_EXTRAS=1 
PYWIKIBOT_TEST_NO_RC=1
  dist: xenial
  sudo: required
  addons:
apt:
  packages:
- djvulibre-bin
- graphviz
- liblua5.1-0-dev
- python-ipaddr
- python: '3.7'
  env: LANGUAGE=de FAMILY=wikipedia
  dist: xenial
  sudo: required
- python: '3.8-dev'
  env: LANGUAGE=test FAMILY=wikipedia PYWIKIBOT_SITE_ONLY=1
  dist: xenial
  sudo: required
  allow_failures:
- python: '3.8-dev'
  env: LANGUAGE=test FAMILY=wikipedia PYWIKIBOT_SITE_ONLY=1
  dist: xenial
  sudo: required
  
  One sure thing, we can't right know support the env 
'2.7_with_system_site_packages' since the CI job do not have sudo access to 
install extra packages. For the others, I am not sure why sudo is required on 
xenial? Maybe to get python 3.7 or 3.8 dev to be installed?
  
  global env
  ==
  
env:
  global:
- TEST_TIMEOUT=300
- PYWIKIBOT_NO_L10N_TESTS=1

  matrix:
- LANGUAGE=en FAMILY=wikipedia PYWIKIBOT_TEST_PROD_ONLY=1
- LANGUAGE=zh FAMILY=wikisource PYSETUP_TEST_EXTRAS=1 
PYWIKIBOT_TEST_PROD_ONLY=1 PYWIKIBOT_TEST_NO_RC=1
  
  The global env matrix sets `LANGUAGE` and `FAMILY` but they are always set in 
the matrix below. I would drop them from the global and have the `script:` part 
to fail immediately when either is not set.
  
  `PYWIKIBOT_TEST_PROD_ONLY=1` is always set, could be moved up in 
`env.global`. Note the environment variable is only listed in 
`tests.aspects.py`:
  
for data in cls.sites.values():
if ('code' in data and data['code'] in ('test', 'mediawiki')
and 'PYWIKIBOT_TEST_PROD_ONLY' in os.environ and not dry):
raise unittest.SkipTest(
'Site code "{}" and PYWIKIBOT_TEST_PROD_ONLY is set.'
.format(data['code']))
  
  Which seems to indicate tests are skipped when they are marked with 
`code=test` or `code=mediawiki`. Seems to me the variable can be set when 
`LANGUAGE` is set to `test` or `mediawiki` instead of always setting it.
  
  The second global matrix sets `PYWIKIBOT_TEST_NO_RC=1`, seems to be set 
because the test suite does not accommodate for some customization made on 
sites.
  
  `PYSETUP_TEST_EXTRAS` seems to be a huge hack that affects the build a lot 
with a few hacks all other the place.
  
  script
  ==
  
  The super long yaml script is not convenient. It would be nicer to have all 
the logic extracted to a standalone file and just invoke that. Eg:
  
script:
  - citestrunner.sh

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar
Cc: hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, Magul, 
Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  Here is the fixed axis of 20 tests, that are run actually:
  
  | python| FAMILY  | LANGUAGE | OAUTH_DOMAIN   
 | PYSETUP_TEST_EXTRAS | NO_L10N_TESTS | SITE_ONLY | TEST_NO_RC | 
PROD_ONLY | TEST_TIMEOUT |
  | - | --- |  | 
--- | --- | - | 
- | -- | - |  |
  | 2.7   | wikipedia   | en   | None   
 | None| 1 | None  | None   | 1 
| 300  |
  | 3.4   | wikipedia   | en   | None   
 | None| 1 | None  | None   | 1 
| 300  |
  | 3.5   | wikipedia   | en   | None   
 | None| 1 | None  | None   | 1 
| 300  |
  | 3.6   | wikipedia   | en   | None   
 | None| 1 | None  | None   | 1 
| 300  |
  | 2.7   | wikisource  | zh   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 3.4   | wikisource  | zh   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 3.5   | wikisource  | zh   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 3.6   | wikisource  | zh   | None   
 | 1   | 1 | None  | 1  | 1 
| 300  |
  | 2.7_with_system_site_packages | wikipedia   | nb   | None   
 | 1   | 1 | None  | 1  | 
None  | 300  |
  | 2.7   | wpbeta  | en   | 
"en.wikipedia.beta.wmflabs.org" | None| 1 | 1   
  | None   | None  | 300  |
  | 3.6   | wpbeta  | zh   | 
"zh.wikipedia.beta.wmflabs.org" | None| 1 | 1   
  | None   | None  | 300  |
  | 3.4   | wsbeta  | en   | None   
 | None| 0 | 1 | None   | 
None  | 300  |
  | 2.7   | wikia   | wikia| None   
 | None| 1 | None  | 1  | 
None  | 300  |
  | 3.5   | musicbrainz | en   | None   
 | None| 1 | 1 | None   | 
None  | 300  |
  | 3.4   | wikipedia   | test | 
"test.wikipedia.org"| None| 1 | 1   
  | None   | None  | 300  |
  | 3.4   | wikidata| test | None   
 | None| 1 | 1 | None   | 
None  | 300  |
  | 3.4   | wiktionary  | ar   | None   
 | None| 1 | None  | 1  | 
None  | 300  |
  | 3.6   | wikidata| wikidata | None   
 | None| 1 | 1 | None   | 
None  | 300  |
  | 3.7   | wikipedia   | de   | None   
 | None| 1 | None  | None   | 
None  | 300  |
  | 3.8-dev (allowed failure) | wikipedia   | test | None   
 | None| 1 | 1 | None   | 
None  | 300  |

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar, Dvorapa
Cc: zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, 
Magul, Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Dvorapa]

Dvorapa added a comment.


  Let's describe it better:
  
  - first there is a matrix of supported py versions and two wikis with 
different settings
  - then no pip package installed - only system side packages
  - then a matrix of multiple wikis in the lowest supported py version 
(enwpbeta, zhwpbeta, enwsbeta, wikia, musicbrainz, testwiki, testwd, arwikt, 
wd), sometimes other py version or different environment to make it interesting 
:D + three oauth tests
  - then py3.7 and failing 3.8-dev
  
  Note: py3.7 perhaps should be added into the original matrix instead of 
having a special entry

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hashar, Dvorapa
Cc: zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, Dvorapa, 
Magul, Aklapper, Xqt, pywikibot-bugs-list, Redabr4, Zanziii, Sadisticturd, 
NebulousIris, Wenyi, A.S.Kochergin, Tbscho, MayS, Mdupont, JJMC89, Avicennasis, 
Liudvikas, mys_721tx, jayvdb, dduvall, Masti, Alchimista, Rxy, greg
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[gerritbot]

gerritbot added a comment.


  Change 513700 had a related patch set uploaded (by Dvorapa; owner: Dvorapa):
  [pywikibot/core@master] [TEST] Test Pywikibot in Wikimedia CI (1/2)
  
  https://gerrit.wikimedia.org/r/513700

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: greg, zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, 
Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, darthmon_wmde, Redabr4, 
Ferenczy, Zanziii, sarhan.alaa, Sadisticturd, Samuditha24, IM3847, Viztor, 
DannyS712, NebulousIris, Wenyi, kostajh, A.S.Kochergin, Jayprakash12345, 
Chicocvenancio, MichaelSchoenitzer_WMDE, Tbscho, MayS, Mdupont, JJMC89, 
Jogi_don, D3r1ck01, Avicennasis, Liudvikas, mys_721tx, Jdlrobson, jayvdb, 
dduvall, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[gerritbot]

gerritbot added a comment.


  Change 510927 had a related patch set uploaded (by Dvorapa; owner: Dvorapa):
  [integration/config@master] [WIP] Test Pywikibot in Wikimedia CI (2/2)
  
  https://gerrit.wikimedia.org/r/510927

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: greg, zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, 
Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, E.S.A-Sheild, 
darthmon_wmde, Redabr4, Ferenczy, Zanziii, sarhan.alaa, Sadisticturd, 
Samuditha24, IM3847, joker88john, Viztor, DannyS712, CucyNoiD, NebulousIris, 
Wenyi, kostajh, Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, 
Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, 
Lordiis, Adik2382, Jayprakash12345, Chicocvenancio, Th3d3v1ls, Ramalepe, 
MichaelSchoenitzer_WMDE, Liugev6, Tbscho, MayS, WSH1906, Lewizho99, Mdupont, 
JJMC89, Maathavan, Jogi_don, D3r1ck01, Avicennasis, Liudvikas, mys_721tx, 
Jdlrobson, jayvdb, dduvall, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-cloud) [2020-05-10T08:58:46Z]  
requested Pywikibot-gerritbot account on Toolforge - T186208 


TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Stashbot
Cc: greg, zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, 
Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, JohnsonLee01, Blissjay007, 
Dijkstra, Oblanco79, Alter-paule, Beast1978, Un1tY, Totolinototo3, Zkhalido, 
Hook696, Daryl-TTMG, RomaAmorRoma, E.S.A-Sheild, darthmon_wmde, Redabr4, 
Kent7301, Ferenczy, Zanziii, sarhan.alaa, Sadisticturd, Samuditha24, IM3847, 
Meekrab2012, joker88john, Viztor, CucyNoiD, NebulousIris, Wenyi, kostajh, 
Gaboe420, A.S.Kochergin, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, 
Cpaulf30, Af420, Darkminds3113, Bsandipan, Lordiis, Adik2382, Jayprakash12345, 
Chicocvenancio, Th3d3v1ls, Ramalepe, MichaelSchoenitzer_WMDE, Liugev6, Tbscho, 
MayS, WSH1906, Lewizho99, Mdupont, JJMC89, Maathavan, Jogi_don, D3r1ck01, 
Altostratus, Avicennasis, Liudvikas, mys_721tx, Jdlrobson, jayvdb, Masti, 
Alchimista, jayantanth, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T186208: Magul's quick tests doesn't run anymore

[gerritbot]

gerritbot added a comment.


  Change 513700 **abandoned** by Xqt:
  [pywikibot/core@master] [WIP][TEST] Test Pywikibot in Wikimedia CI (1/2)
  
  Reason:
  deeptest is already activated
  
  https://gerrit.wikimedia.org/r/513700

TASK DETAIL
  https://phabricator.wikimedia.org/T186208

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: greg, zhuyifei1999, hashar, Liuxinyu970226, Legoktm, Framawiki, Dalba, 
Dvorapa, Magul, Aklapper, Xqt, pywikibot-bugs-list, Jyoo1011, JohnsonLee01, 
SHEKH, Dijkstra, Alter-paule, Beast1978, Un1tY, Khutuck, Mgagat, Totolinototo3, 
Zkhalido, Hook696, darthmon_wmde, Redabr4, Kent7301, Ferenczy, Zanziii, 
sarhan.alaa, Sadisticturd, Samuditha24, IM3847, joker88john, Viztor, CucyNoiD, 
NebulousIris, Wenyi, kostajh, Gaboe420, A.S.Kochergin, Giuliamocci, Cpaulf30, 
Af420, Bsandipan, Jayprakash12345, Chicocvenancio, MichaelSchoenitzer_WMDE, 
Tbscho, MayS, Lewizho99, Mdupont, JJMC89, Maathavan, Jogi_don, xSavitar, 
Altostratus, Avicennasis, Liudvikas, thcipriani, mys_721tx, jayvdb, Masti, 
Alchimista, jayantanth, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs