Re: [pywikibot] WikiData read constraints

2020-05-22 Thread info 

I have no glue whether or not wmf has any solution shortly. The maxlag is 
exceeded over several hours every day an the value is about 8 then.

I made a proposal in 
https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/576813/ to enforce any 
response after some wait cycles by increasing the maxlag parameter step by step.

Unfortunately our CI test also found wrong data response from time to time and 
haven't a solution for this issue on pwb side.

Probably the put_throttle should not be higher than 12 which is double of the 
default but I guess that most bot have a very fast edit rate of 1 per second or 
so which may be a reason for the maxlag problem. Another parameter we could 
play with is the minthrottle for read operation. This is an old compat 
parameter and is set to 0 in core.

All these parameters are useless if bot owners follow them more ore less; The 
higher you increase the edit rates for you bots the lower is it for the others. 
And fear that there are differences in bots settings outside of the default 
values. Therefore I guess wmf is working on a server side pool throttling. 
After 4 months of this problem I think we should have a solution very quickly.

Best
xqt

> Am 22.05.2020 um 15:10 schrieb masti :
> 
> Is there any outlook about when WikiData API will be working again?
> I can understand throttling write operations but my bots are struggling to 
> get simple info lie a template interwikis :(
> 
> Retrieving 1 pages from wikipedia:pl.
> Treating: Szablon:CEE Spring 2020
> Sleeping for 5.0 seconds, 2020-05-22 15:05:42
> Sleeping for 5.0 seconds, 2020-05-22 15:05:47
> Sleeping for 5.0 seconds, 2020-05-22 15:05:52
> Sleeping for 6.5 seconds, 2020-05-22 15:05:58
> Sleeping for 7.1 seconds, 2020-05-22 15:06:04
> Sleeping for 8.6 seconds, 2020-05-22 15:06:12
> Sleeping for 10.0 seconds, 2020-05-22 15:06:20
> Sleeping for 11.4 seconds, 2020-05-22 15:06:31
> Sleeping for 12.9 seconds, 2020-05-22 15:06:42
> Sleeping for 14.3 seconds, 2020-05-22 15:06:56
> 
> masti
> 
> ___
> pywikibot mailing list
> pywikibot@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/pywikibot
___
pywikibot mailing list
pywikibot@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot

[Pywikipedia-bugs] [Maniphest] [Commented On] T216015: Massive image upload with pywikibot

2020-05-22 Thread Dominicbm 
Dominicbm added a comment.


  You can upload at a faster rate with a bot account. See 
https://commons.wikimedia.org/wiki/Commons:Bots

TASK DETAIL
  https://phabricator.wikimedia.org/T216015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Dominicbm
Cc: Dominicbm, Framawiki, Aklapper, pywikibot-bugs-list, Discasto, 
JohnsonLee01, Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, 
Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[pywikibot] WikiData read constraints

2020-05-22 Thread masti 

Is there any outlook about when WikiData API will be working again?
I can understand throttling write operations but my bots are struggling 
to get simple info lie a template interwikis :(


Retrieving 1 pages from wikipedia:pl.
Treating: Szablon:CEE Spring 2020
Sleeping for 5.0 seconds, 2020-05-22 15:05:42
Sleeping for 5.0 seconds, 2020-05-22 15:05:47
Sleeping for 5.0 seconds, 2020-05-22 15:05:52
Sleeping for 6.5 seconds, 2020-05-22 15:05:58
Sleeping for 7.1 seconds, 2020-05-22 15:06:04
Sleeping for 8.6 seconds, 2020-05-22 15:06:12
Sleeping for 10.0 seconds, 2020-05-22 15:06:20
Sleeping for 11.4 seconds, 2020-05-22 15:06:31
Sleeping for 12.9 seconds, 2020-05-22 15:06:42
Sleeping for 14.3 seconds, 2020-05-22 15:06:56

masti

___
pywikibot mailing list
pywikibot@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot

[Pywikipedia-bugs] [Maniphest] [Updated] T252306: PAWS gives API-errors on some cases

2020-05-22 Thread matej_suchanek 
matej_suchanek added a comment.


  May be related to T226157 .

TASK DETAIL
  https://phabricator.wikimedia.org/T252306

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: matej_suchanek
Cc: matej_suchanek, Xqt, RhinosF1, pywikibot-bugs-list, Chicocvenancio, 
Edoderoo, JohnsonLee01, Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, 
Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, 
Ricordisamoa, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T252306: PAWS gives API-errors on some cases

2020-05-22 Thread Xqt 
Xqt added a comment.


  > **Edoderoo** wrote:
  > I learned on Telegram that PAWS was updated today
  
  What was updated there?

TASK DETAIL
  https://phabricator.wikimedia.org/T252306

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: matej_suchanek, Xqt, RhinosF1, pywikibot-bugs-list, Chicocvenancio, 
Edoderoo, JohnsonLee01, Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, 
Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, 
Ricordisamoa, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T252306: PAWS gives API-errors on some cases

2020-05-22 Thread Xqt 
Xqt updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T252306

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Xqt
Cc: matej_suchanek, Xqt, RhinosF1, pywikibot-bugs-list, Chicocvenancio, 
Edoderoo, JohnsonLee01, Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, 
Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, mys_721tx, jayvdb, 
Ricordisamoa, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T253378: pywikibot transitive dependency on crypto

2020-05-22 Thread Seppl2013 
Seppl2013 added a comment.


  see https://pypi.org/project/py-3rdparty-mediawiki/0.0.2/

TASK DETAIL
  https://phabricator.wikimedia.org/T253378

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Seppl2013
Cc: pywikibot-bugs-list, Aklapper, Seppl2013, JohnsonLee01, Dijkstra, Zkhalido, 
Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Dvorapa, Altostratus, 
Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T253378: pywikibot transitive dependency on crypto

2020-05-22 Thread Seppl2013 
Seppl2013 added a comment.


  Looks like this is a general pip problem with transitive dependencies. The 
pycrypto library is also explcitly mentioned in the requirements.txt file for 
py-3rdparty-mediawiki. I'll try to release that library on pypi to see if that 
fixes the issue.

TASK DETAIL
  https://phabricator.wikimedia.org/T253378

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Seppl2013
Cc: pywikibot-bugs-list, Aklapper, Seppl2013, JohnsonLee01, Dijkstra, Zkhalido, 
Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Dvorapa, Altostratus, 
Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Closed] T253378: pywikibot transitive dependency on crypto

2020-05-22 Thread Aklapper 
Aklapper closed this task as "Invalid".
Aklapper added a project: Pywikibot.
Aklapper added a comment.
Restricted Application edited subscribers, added: pywikibot-bugs-list; removed: 
Liuxinyu970226.


  @Seppl2013: Assuming this task is about the #Pywikibot 
 code project, hence adding 
that project tag so other people can find this task. Please set appropriate 
project tags when possible. Thanks!
  
  The line `from wikibot.crypt import Crypt` seems to come from 
https://github.com/WolfgangFahl/py-3rdparty-mediawiki/blob/master/wikibot/wikibot.py
 and is not included in Pywikibot itself.
  
  Regarding Pywikibot, see T203435  
and related https://gerrit.wikimedia.org/r/#/c/pywikibot/core/+/458823/

TASK DETAIL
  https://phabricator.wikimedia.org/T253378

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Aklapper
Cc: pywikibot-bugs-list, Aklapper, Seppl2013, JohnsonLee01, Dijkstra, Zkhalido, 
Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Dvorapa, Altostratus, 
Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy, Liuxinyu970226
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T248471: login() with retry=True might delete correct password if unknown APIError occurs

2020-05-22 Thread Seppl2013 
Seppl2013 added a comment.


  I have tried today with pywikibot>=3.0.20200508 and on my local machine the 
tests run. I am having some trouble in the  travis environment of a project I 
am using things now - I'll create a separate issue for that.

TASK DETAIL
  https://phabricator.wikimedia.org/T248471

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Seppl2013
Cc: Dvorapa, Xqt, Mpaa, Aklapper, Seppl2013, pywikibot-bugs-list, JohnsonLee01, 
Dijkstra, Zkhalido, Viztor, Wenyi, Tbscho, MayS, Mdupont, JJMC89, Altostratus, 
Avicennasis, mys_721tx, jayvdb, Masti, Alchimista, Rxy
___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[pywikibot] Instantiaton warning fixed

2020-05-22 Thread John Bray 
Changing

mylang = 'fancyclopedia'

as xqt suggested worked. Thanks for your help

___
pywikibot mailing list
pywikibot@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot