TheSandDoctor created this task.
TheSandDoctor added projects: MediaWiki-API, Operations, Pywikibot.
Restricted Application added subscribers: pywikibot-bugs-list, Aklapper.
Restricted Application added a project: Core Platform Team.
TASK DESCRIPTION
Pywikibot keeps attempting to access non-existent files when running with
allimages().
2020-02-14 06:43:34,471 corruptBackwards: DEBUG Skipping check on File:ＪＲ久慈
駅 - panoramio (1).jpg
Traceback (most recent call last):
File "fullscan_reversed.py", line 23, in <module>
scan.process_file() # Do the work
File "/home/ccc/Commons-image-corruption-detector/base_scan.py", line 65,
in process_file
for image_page in pwb_wrappers.allimages(reverse=self.reverse):
File "/usr/local/lib/python3.8/site-packages/pywikibot/data/api.py", line
2808, in __iter__
self.data = self.request.submit()
File "/usr/local/lib/python3.8/site-packages/pywikibot/data/api.py", line
1985, in submit
rawdata, use_get = self._http_request(use_get, uri, body, headers,
File "/usr/local/lib/python3.8/site-packages/pywikibot/data/api.py", line
1767, in _http_request
self.wait()
File "/usr/local/lib/python3.8/site-packages/pywikibot/data/api.py", line
2088, in wait
raise TimeoutError('Maximum retries attempted without success.')
pywikibot.exceptions.TimeoutError: Maximum retries attempted without
success.
@AntiCompositeNumber got pywikibot to fail attempting to access
https://commons.wikimedia.org/w/api.php?gaifrom=%F0%A9%B5%8F&prop=info%7Cimageinfo%7Ccategoryinfo&inprop=protection&iiprop=timestamp%7Cuser%7Ccomment%7Curl%7Csize%7Csha1%7Cmetadata&iilimit=max&generator=allimages&action=query&indexpageids=&continue=gaicontinue%7C%7Cuserinfo&gaidir=descending&gailimit=500&meta=userinfo&uiprop=blockinfo%7Chasmsg&maxlag=5&format=json&gaicontinue=%EF%BC%90%EF%BC%97%E5%BC%8F%E6%A9%9F%E5%8B%95%E6%94%AF%E6%8F%B4%E6%A9%8B%EF%BC%88%E8%A3%85%E5%82%99%E5%93%81%E5%B1%95%E7%A4%BA%E3%83%BB%E6%96%BD%E8%A8%AD%E5%AD%A6%E6%A0%A1%EF%BC%89_%284%29.jpg
Without the percent-encoding, that's
https://commons.wikimedia.org/w/api.php?gaifrom=𩵏&prop=info|imageinfo|categoryinfo&inprop=protection&iiprop=timestamp|user|comment|url|size|sha1|metadata&iilimit=max&generator=allimages&action=query&indexpageids=&continue=gaicontinue||userinfo&gaidir=descending&gailimit=500&meta=userinfo&uiprop=blockinfo|hasmsg&maxlag=5&format=json&gaicontinue=０７式機動支援橋（装備品展示・施設学校）_(4).jpg
Pywikibot is using POST and not GET, but it fails the same. Most recent
attempt resulted in
{"error":{"code":"internal_api_error_WMFTimeoutException","info":"[XknCBQpAAEsAAJ7w@woAAACH]
Caught exception of type
WMFTimeoutException","errorclass":"WMFTimeoutException"},"servedby":"mw1280"}
Could someone with logstash access can look into what's going on with the
media-wiki end?
TASK DETAIL
https://phabricator.wikimedia.org/T245374
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: TheSandDoctor
Cc: TheSandDoctor, Aklapper, AntiCompositeNumber, pywikibot-bugs-list,
Zkhalido, WDoranWMF, holger.knust, EvanProdromou, Viztor, Legado_Shulgin,
DannyS712, Wenyi, Amorymeltzer, Davinaclare77, Qtn1293, Techguru.pc, Th3d3v1ls,
Hfbn0, Tbscho, MayS, Sethakill, Zppix, Mdupont, JJMC89, dg711, Dvorapa,
Agabi10, Altostratus, Avicennasis, Pchelolo, Wong128hk, mys_721tx, jayvdb,
Anomie, faidon, Masti, Alchimista, Rxy, Jay8g, fgiunchedi, Legoktm
_______________________________________________
pywikibot-bugs mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs
