[Wikidata-bugs] [Maniphest] T343936: Handle timing out SPARQL endpint in Pywikibot
Maintenance_bot added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T343936 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: Aklapper, pywikibot-bugs-list, Multichill, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, PotsdamLamb, Jyoo1011, maantietaja, JohnsonLee01, SHEKH, Dijkstra, ItamarWMDE, Khutuck, Akuckartz, Zkhalido, Viztor, Nandana, Wenyi, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Tbscho, MayS, merbst, LawExplorer, Mdupont, JJMC89, Dvorapa, _jensen, rosalieper, Altostratus, Avicennasis, Scott_WUaS, Jonas, Xmlizer, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Xqt, aude, Tobias1984, Manybubbles, jayvdb, Ricordisamoa, Masti, Alchimista, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T343936: Handle timing out SPARQL endpint in Pywikibot
Multichill added a comment. With the increased time out I was able to update https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Property_statistics ( https://github.com/multichill/toollabs/blob/master/bot/wikidata/painting_property_statistics.py ) TASK DETAIL https://phabricator.wikimedia.org/T343936 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Multichill Cc: Aklapper, pywikibot-bugs-list, Multichill, AWesterinen, PotsdamLamb, Jyoo1011, JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, EBjune, Tbscho, MayS, merbst, Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, Jonas, Xmlizer, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Xqt, aude, Tobias1984, Manybubbles, jayvdb, Ricordisamoa, Masti, Alchimista ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T343936: Handle timing out SPARQL endpint in Pywikibot
Multichill created this task. Multichill added projects: Pywikibot, Pywikibot-Wikidata, Wikidata-Query-Service. Restricted Application added subscribers: pywikibot-bugs-list, Aklapper. TASK DESCRIPTION I have some bots that are not doing their reporting. Looking at the logs I noticed I hit the default socket timeout of 45 seconds. The Wikidata SPARQL endpoint at https://query.wikidata.org/ has a server side time out of 60 seconds. That extra 15 seconds might just be enough. **Steps to replicate the issue** (include links if applicable): I added this to my user-config.py: socket_timeout = 90 And ran a bot that does some heavy SPARQL queries ( https://github.com/multichill/toollabs/blob/master/bot/wikidata/painting_external-id_property_statistics.py ). **What happens?**: Not enough extra time so I'm hitting the server side time out: File "/home///pywikibot/pywikibot/comms/http.py", line 356, in error_handling_callback raise ServerError( pywikibot.exceptions.ServerError: 500 Server Error: Internal Server Error CRITICAL: Exiting due to uncaught exception ServerError: 500 Server Error: Internal Server Error **What should have happened instead?**: We should probably handle the 500 error as a recoverable error (just like the socket time out) and retry. **Software version** (skip for WMF-hosted wikis like Wikipedia): Recent (but not latest) git version **Other information** (browser name/version, screenshots, etc.): TASK DETAIL https://phabricator.wikimedia.org/T343936 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Multichill Cc: Aklapper, pywikibot-bugs-list, Multichill, AWesterinen, PotsdamLamb, Jyoo1011, JohnsonLee01, SHEKH, Dijkstra, Khutuck, Zkhalido, Viztor, Wenyi, Namenlos314, Gq86, Lucas_Werkmeister_WMDE, EBjune, Tbscho, MayS, merbst, Mdupont, JJMC89, Dvorapa, Altostratus, Avicennasis, Jonas, Xmlizer, mys_721tx, jkroll, Wikidata-bugs, Jdouglas, Xqt, aude, Tobias1984, Manybubbles, jayvdb, Ricordisamoa, Masti, Alchimista ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
