[Wikidata-bugs] [Maniphest] [Created] T240376: Maxlag=5 for LogainmBot
Pintoch created this task. Pintoch added a project: Wikidata. TASK DESCRIPTION LogainmBot edits go through even if maxlag is higher than 5, we should fix the code to ensure it complies with the maxlag policy on Wikimedia wikis <https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or a lower value) on all editing API queries. TASK DETAIL https://phabricator.wikimedia.org/T240376 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: kscanne, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T240369: Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T240369 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T240377: Maxlag=5 for Reinheitsgebot
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T240377 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Magnus, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T240375: Maxlag=5 for LargeDatasetBot
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T240375 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T240376: Maxlag=5 for LogainmBot
Pintoch added a comment. If you have not changed anything in `user-config.py` then you should be good to go, it might have been a false positive on my side. Sorry for the noise! TASK DETAIL https://phabricator.wikimedia.org/T240376 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: kscanne, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Assigned] T240370: Maxlag=5 for Petscan
Pintoch assigned this task to Magnus. TASK DETAIL https://phabricator.wikimedia.org/T240370 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Magnus, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T240374: Maxlag=5 for BotMultichill
Pintoch created this task. Pintoch added a project: Wikidata. TASK DESCRIPTION BotMultichill edits go through even if maxlag is higher than 5, we should fix the code to ensure it complies with the maxlag policy on Wikimedia wikis <https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or a lower value) on all editing API queries. TASK DETAIL https://phabricator.wikimedia.org/T240374 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Multichill, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T240377: Maxlag=5 for Reinheitsgebot
Pintoch created this task. Pintoch added a project: Wikidata. TASK DESCRIPTION Reinheitsgebot edits go through even if maxlag is higher than 5, we should fix the code to ensure it complies with the maxlag policy on Wikimedia wikis <https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or a lower value) on all editing API queries. TASK DETAIL https://phabricator.wikimedia.org/T240377 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Magnus, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T240371: Maxlag=5 for Author Disambiguator
Pintoch added a comment. Matching pull request: https://github.com/arthurpsmith/author-disambiguator/pull/107 TASK DETAIL https://phabricator.wikimedia.org/T240371 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: ArthurPSmith, Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T240369: Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5
Pintoch added a comment. @Bugreporter yes indeed! I was off by one hour there. Thanks for your help! Feel free to add more bots which match that period. TASK DETAIL https://phabricator.wikimedia.org/T240369 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Bugreporter, Pintoch, Aklapper, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T236619: Workflow to create special properties and items at boot stage
Pintoch created this task. Pintoch added a project: Wikibase-Containers. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION **Problem** Some components (either Wikibase itself or some extensions) rely on special properties or items which have a special behavior. For instance, Wikibase has a `$formatterUrlProperty` configuration variable which expects a PID. This property is then used to render values for external identifiers. The Quality Constraints extension relies on bazillions of special PIDs and QIDs to define the constraints. The OpenRefine reconciliation interface also relies on some (instance of, subclass of…). We need a workflow to set up these magic properties. **Currently** - Boot your Wikibase with Docker - Manually login as WikibaseAdmin and create the properties / items - Put the properties / ids of these entities in the various config files of the various components that require them - Reboot these. **Ideally** As the docker-compose config grows and integrates more services (such as the ones mentioned above), it will become quite inconvenient to create all these special entities manually. It seems hard to do this process completely automatically as part of the Docker boot process (since we can't really avoid restarting Wikibase after `formatterUrlProperty` has been set), but there could be a maintenance script that creates all these special entities and store their ids in a file that is accessible to all relevant Docker containers, which would then feed these ids into their own config files. TASK DETAIL https://phabricator.wikimedia.org/T236619 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, Jelabra, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Asahiko, Wikidata-bugs, aude, Addshore, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T236619: Workflow to create special properties and items at boot stage
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T236619 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Aklapper, Pintoch, darthmon_wmde, Jelabra, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Asahiko, Wikidata-bugs, aude, Addshore, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T220696: [Story] Create better edit summaries for wbeditentity API endpoint
Pintoch added a comment. Here is a diff where one of the new fallback summaries failed to be translated to a human-readable form: https://www.wikidata.org/w/index.php?title=Property:P571=1040450905=1038877052 TASK DETAIL https://phabricator.wikimedia.org/T220696 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Lea_Lacroix_WMDE, NicoScribe, Rosalie_WMDE, alaa_wmde, Lucas_Werkmeister_WMDE, Lydia_Pintscher, Aklapper, Lea_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Jonas, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. OK! If you have ways to check what sort of maxlag values are used it would be great! I will try to implement a responsible throttling strategy in OpenRefine, hoping that others will do the same. TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. Actually, some tools seem to be doing something like that already, since edits are still going through despite max lag being above 5 for more than an hour now (Author Disambiguator does this, QuickStatements too probably, Edoderoobot too). So these tools use higher (more agressive) maxlag values than 5. I will therefore follow their example and publish a new version of OpenRefine which does that. It might be worth updating the official recommendations about this: if the rule is never to set maxlag higher than 5, then it looks like not many are actually following it… TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. One problem with the current policy (requesting all automated editing processes to use `maxlag=5`) is that this creates a binary threshold: either the query service lag is under the threshold, in which case bots will edit at full speed, or the query service lag is above the threshold, in which case they should all stop editing entirely. This is likely to create an oscillating behaviour, where all bots start and stop periodically. This is probably not ideal neither for the infrastructure nor for the users. Not all automated edits are long-running tasks where stopping for an hour is acceptable: many QuickStatements or OpenRefine batches are under 10 edits for instance. As a user of these tools, I would expect them to slow down when lag is high, but stopping entirely should be extremely rare, as it breaks workflows. I think it would be preferable to get a continuous throttling behaviour: the higher the lag, the slower the edits. This can already be achieved by clients by using a small maxlag parameter and increasing it gradually as they retry. For instance, start with maxlag=2, which fails, retry in 1 sec with maxlag=3, which fails, retry in 4 seconds with maxlag=4, which fails, retry in 8 seconds with maxlag=5, which fails, retry in 16 seconds with maxlag=6, which succeeds. Would such a behaviour be acceptable? TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension
Pintoch added a comment. Sure, I hope you don't mind us having this discussion here anyway, since this is still at a very early stage. (unless you are already planning to work on this exact architecture?) TASK DETAIL https://phabricator.wikimedia.org/T203557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension
Pintoch added a comment. Here are a few issues with the current tool: - If the tool goes down, this creates millions of dead links in edit summaries (which cannot be changed). Users who ran batches with the assumption that they could be undone if something goes wrong find themselves having to clean things up manually. - As a user, I can easily game EditGroups by imitating the edit summary of any tool, attributing edits to batches they are not actually part of (there are some protections against this, but they are not fully bullet-proof. For instance an edit will only be added to a batch if it was made under the account of the user who first created the batch) - Bot/tool authors are reluctant to add grouping support for their bots since EditGroups is not officially part of the Wikidata infrastructure. The community is unlikely to systematically enforce edit grouping in requests for bot approvals as long as it relies on an external tool, which does not come with any sustainability guarantees, SLA, etc. - Reverting relies on OAuth, and OAuth tokens can expire while a large edit group is being reverted. That being said, I am still not sure if all of EditGroups' functionality can reasonably be hoped to be supported in a MediaWiki extension directly: is it doable to have long-running tasks to undo a batch of edits? We do have Special:Nuke which deletes many pages at once, but this is done synchronously, the number of pages affected might be capped? TASK DETAIL https://phabricator.wikimedia.org/T203557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. Thanks for the notification! I would be happy to release a new version of OpenRefine with a patch applied - I can do this in the coming days. The exponential back-off suggested by @Multichill makes sense intuitively - could WMDE confirm that this is the policy they recommend? Happy to adapt the policy as required. TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T241029: EditGroups tool: Unstable connection to SQL database on Toollabs
Pintoch created this task. Pintoch added projects: Toolforge, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION The EditGroups tool <https://tools.wmflabs.org/editgroups/> listens to the EventStream <https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams> for Wikidata edits and stores their metadata in its own SQL database. The listener process is a Python program which runs in Kubernetes. It connects to the SQL database (`s53685__editgroups`) via Django's ORM and performs the ingestion by batches of edits. Over the past few weeks, the listener has started to die a lot more frequently, generally because its SQL connection vanishes: django.db.utils.OperationalError: (2006, 'MySQL server has gone away') (full stack trace available in the corresponding GitHub issue <https://github.com/Wikidata/editgroups/issues/28>). These repeated failures (about one every hour currently) mean that the listener is accumulating lag (currently 7 hours behind). Has labsdb become more unstable recently? Is there any way to prevent these disconnections? Could perhaps the database be moved to a more reliable host? TASK DETAIL https://phabricator.wikimedia.org/T241029 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, darthmon_wmde, Nandana, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, srodlund, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T240442: Design a continuous throttling policy for Wikidata bots
Pintoch added a comment. It is actually possible to retrieve the current maxlag value from the API without making any edit (see @Addshore's comment above). So, just retrieve the current maxlag value and compute your desired edit rate for this maxlag with the function plotted above. Then sleep for the appropriate amount of time between any two edits to achieve this rate. Refresh the maxlag value from the server periodically. TASK DETAIL https://phabricator.wikimedia.org/T240442 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: ArthurPSmith, Addshore, Aklapper, Pintoch, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. I don't know - I stopped working on this task and T240369 <https://phabricator.wikimedia.org/T240369> since T240374 <https://phabricator.wikimedia.org/T240374> was declined. I don't think I can contribute to solving this problem in the current state of affairs, sorry! TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: ArthurPSmith, Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag
Pintoch added a comment. This does not have anything to do with you indeed! I was just trying to explain that I stopped trying to help solve this issue (therefore unsubscribing from this). TASK DETAIL https://phabricator.wikimedia.org/T221774 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Pintoch Cc: ArthurPSmith, Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T241422: Wikidata forms without statements use empty JSON array instead of empty JSON object
Pintoch created this task. Pintoch added projects: Lexicographical data, Wikidata. TASK DESCRIPTION It looks like this was missed in the resolution of T138104 <https://phabricator.wikimedia.org/T138104>: statements in forms seem to be still affected by the misuse of empty JSON arrays in place of empty JSON objects. For instance, https://www.wikidata.org/w/api.php?action=wbgetentities=json=L3872 returns: `"claims":[]` in the serialization of `L3872-F2`. TASK DETAIL https://phabricator.wikimedia.org/T241422 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, darthmon_wmde, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T241422: Wikidata forms without statements use empty JSON array instead of empty JSON object
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T241422 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, darthmon_wmde, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T249680: Wikidata password login via MediaWiki API fails
Pintoch created this task.
Pintoch added projects: Wikidata, OpenRefine.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
Over the past 48 hours, there seems to have been a change in the behaviour of
MediaWiki login API for Wikidata. This causes all logins from Wikidata-Toolkit
(Java library) to fail. Among others, this affects OpenRefine users.
To reproduce:
- Fetch a login token with
https://www.wikidata.org/w/api.php?action=query=tokens=login=json
- Perform a POST query to login using this token and valid credentials:
curl -X POST "https://www.wikidata.org/w/api.php; -d
"action=login=MY_USERNAME=MY_PASSWORD=MY_TOKEN=json"
which gives the following response:
{
"warnings": {
"main": {
"*": "Subscribe to the mediawiki-api-announce mailing list at
<https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce> for
notice of API deprecations and breaking changes. Use
[[Special:ApiFeatureUsage]] to see usage of deprecated features by your
application."
},
"login": {
"*": "Fetching a token via \"action=login\" is deprecated. Use
\"action=query=tokens=login\" instead."
}
},
"login": {
"result": "NeedToken",
"token": "dda68bc218a252765816dca9570ec6755e8d6462+\\"
}
}
This bug can be observed for existing releases of Wikidata-Toolkit (and
therefore OpenRefine), so this issue cannot come from a client-side change. One
can observe that no data imports have been made through OpenRefine for about 48
hours: https://tools.wmflabs.org/editgroups/?tool=OR
This seems to depend on subtle details of cookie handling according to this
pull request <https://github.com/Wikidata/Wikidata-Toolkit/pull/490>.
While we can of course fix things on Wikidata-Toolkit's side, it would be
great if the change on Wikidata's side could be reverted at least temporarily,
since fixing this on our side requires making new releases of Wikidata-Toolkit
and OpenRefine.
OR issue: https://github.com/OpenRefine/OpenRefine/issues/2526
TASK DETAIL
https://phabricator.wikimedia.org/T249680
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Pintoch
Cc: Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic,
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude,
Nikerabbit, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T249680: Wikidata password login via MediaWiki API fails
Pintoch added a comment. So, if we can track down which MediaWiki commit started to introduce "set-cookie" headers (instead of "Set-Cookie"), we could hopefully submit a patch to capitalize it. The root of the problem lies in the fact that Wikidata-Toolkit uses a very low-level Java API to make HTTP requests <https://github.com/Wikidata/Wikidata-Toolkit/issues/492>, which is therefore quite brittle. TASK DETAIL https://phabricator.wikimedia.org/T249680 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T249680: Wikidata password login via MediaWiki API fails
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T249680 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, WDoranWMF, holger.knust, EvanProdromou, DannyS712, Nandana, Amorymeltzer, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Sethakill, dg711, _jensen, rosalieper, Agabi10, Scott_WUaS, Pchelolo, Wikidata-bugs, aude, jayvdb, Anomie, Nikerabbit, Mbch331, Rxy, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T249680: Wikidata password login via MediaWiki API fails
Pintoch added a comment. It appears from T249526 <https://phabricator.wikimedia.org/T249526> that this is caused by https://gerrit.wikimedia.org/r/586448 TASK DETAIL https://phabricator.wikimedia.org/T249680 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, WDoranWMF, holger.knust, EvanProdromou, DannyS712, Nandana, Amorymeltzer, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Sethakill, dg711, _jensen, rosalieper, Agabi10, Scott_WUaS, Pchelolo, Wikidata-bugs, aude, jayvdb, Anomie, Nikerabbit, Mbch331, Rxy, Legoktm ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T249680: Wikidata password login via MediaWiki API fails
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T249680 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added a comment. Another outage today: T262553 <https://phabricator.wikimedia.org/T262553> (Toolforge-wide ticket: T262550 <https://phabricator.wikimedia.org/T262550>). TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Addshore, Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262550: Toolforge returns HTTP 502 error
Pintoch lowered the priority of this task from "Unbreak Now!" to "High". Pintoch added a comment. Lowering the priority since the outage seems to have disappeared. Looking at the #wikimedia-cloud freenode channel this was likely due to a failure to reach the Kubernetes cluster due to a DNS misconfiguration. TASK DETAIL https://phabricator.wikimedia.org/T262550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: tfmorris, aborrero, RhinosF1, Bugreporter, Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262553: Wikidata reconciliation service unreacheable (HTTP 502 error), unable to restart the service
Pintoch added a parent task: T262550: Toolforge returns HTTP 502 error. TASK DETAIL https://phabricator.wikimedia.org/T262553 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262550: Toolforge returns HTTP 502 error
Pintoch added a subtask: T262553: Wikidata reconciliation service unreacheable (HTTP 502 error), unable to restart the service. TASK DETAIL https://phabricator.wikimedia.org/T262550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: aborrero, RhinosF1, Bugreporter, Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262553: Wikidata reconciliation service unreacheable (HTTP 502 error), unable to restart the service
Pintoch added a comment. Probably! TASK DETAIL https://phabricator.wikimedia.org/T262553 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: RhinosF1, Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262550: EditGroups tool unreachable (HTTP 502 error), unable to restart the service
Pintoch added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T262550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262553: Wikidata reconciliation service unreacheable (HTTP 502 error), unable to restart the service
Pintoch created this task. Pintoch added projects: Toolforge, Wikidata, OpenRefine. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION The Wikidata reconciliation tool currently returns a "502 Bad Gateway" when requesting its main page: https://wdreconcile.toolforge.org/ (or in fact any other page, as far as I can tell). In my experience this happens regularly (not sure why). When the error is consistent I generally try to restart the service with `webservice --backend kubernetes python3.7 restart`. This command runs as usual but does not fix the 502 error (unlike T262550 <https://phabricator.wikimedia.org/T262550>). Therefore I am unable to fix this outage. Note: I have been trying to encourage users to switch to another instance of this service hosted outside of Toolforge because of recurrent stability issues. However, this service still sees more traffic than the new instance, hence filing this ticket. TASK DETAIL https://phabricator.wikimedia.org/T262553 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T262550: Toolforge returns HTTP 502 error
Pintoch added a comment. It looks like the services can be reached again now, at least for me. TASK DETAIL https://phabricator.wikimedia.org/T262550 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: RhinosF1, Bugreporter, Pintoch, Aklapper, Nintendofan885, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T264566: Redirected entity still present in search results after 6 months
Pintoch created this task. Pintoch added a project: Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION In March 2020, the entity Black Girl (Q70778234) <https://www.wikidata.org/w/index.php?title=Q70778234=no> was redirected to Black Girl (Q3211102) <https://www.wikidata.org/wiki/Q3211102>. Today, if I search for "Black Girl" <https://www.wikidata.org/w/index.php?search=Black+Girl=Black+Girl=Special%3ASearch=Go=1=1> on Wikidata, I can still see both entities as separate search results. The redirected entity appears with its former English description, "Senegalese film". This sounds like the corresponding search index update was missed in ElasticSearch, perhaps? I do not know if this is an isolated case or if there could be more cases like this. This was originally reported by @tfmorris as an issue with the OpenRefine reconciliation endpoint: https://github.com/wetneb/openrefine-wikibase/issues/91 TASK DETAIL https://phabricator.wikimedia.org/T264566 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, tfmorris, Aklapper, Akuckartz, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances
Pintoch added a project: Wikibase - Automated Configuration Detection (WikibaseManifest). Pintoch added a comment. Excited to see the Wikibase team picking up this issue. I am tagging this ticket with the corresponding project, hoping that this is appropriate? TASK DETAIL https://phabricator.wikimedia.org/T197588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: tfmorris, Samantha_Alipio_WMDE, Afkbrb, Abbe98, Theklan, Nikerabbit, Salgo60, Aklapper, Gstupp, Lucas_Werkmeister_WMDE, Pintoch, Akuckartz, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T261042: Discoverability of federation scenarios
Pintoch created this task.
Pintoch added projects: Wikibase - Automated Configuration Detection
(WikibaseManifest), Wikibase - Federated Properties, SDC General, OpenRefine.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.
TASK DESCRIPTION
tldr: As a Wikibase API user, given a Wikibase API endpoint such as
https://www.wikidata.org/w/api.php or https://commons.wikimedia.org/w/api.php,
I would like to be able to determine via the API if and how this Wikibase
instance is federated with another one.
**Why this is needed**
1. I want to retrieve data from Wikibase with `wbgetentities`, for instance
action=wbgetentities=M74698470
<https://commons.wikimedia.org/w/api.php?action=wbgetentities=M74698470>.
To make sense of the properties and values I get, I need to be able to retrieve
their content. This is already possible with `wbgetentities` on the federating
instance:
https://commons.wikimedia.org/w/api.php?action=wbgetentities=Q192465
returns the contents of the target item. This is all nice and transparent so
far!
2. What if I want to edit Q192465? I can try to edit it with the API, for
instance with `wbsetlabel`. But if I do that through the Commons API, this will
fail
(`{"error":{"code":"internal_api_error_DBQueryError","info":"[66591293-262e-4410-81d5-b35d6bf0bea2]
Caught exception of type
Wikimedia\\Rdbms\\DBQueryError","errorclass":"Wikimedia\\Rdbms\\DBQueryError"},"servedby":"mw1343"}`)
3. I should have edited it on Wikidata instead obviously. But how do I
discover that? There is nothing in
https://commons.wikimedia.org/w/api.php?action=wbgetentities=Q192465 that
indicates that this entity actually comes from Wikidata.
**What I would expect**
In some API action (say a fictional `action=getfederationsettings`), I should
be able to get some sort of description of the federation in place in the
instance.
This could be inspired from the MediaWiki configuration used by the Federated
Properties project, which might be more suitable for public exposure since it
refers to MediaWiki endpoints (rather than federation through the database
cluster).
**Context**
Perhaps the right place for this information could be the Automated
Configuration Detection feature?
Such a discoverability would be of great help to make an OpenRefine-Commons
integration in a generic way.
I wrote up a description of the issue here:
https://hackmd.io/ZYWPoLrZSUSE9paRnXe7hg?view
TASK DETAIL
https://phabricator.wikimedia.org/T261042
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Pintoch
Cc: Aklapper, Pintoch, CBogen, Akuckartz, darthmon_wmde, Nandana, JKSTNK,
lucamauri, Lahi, PDrouin-WMF, Gq86, E1presidente, Ramsey-WMF, Cparle, Anooprao,
SandraF_WMF, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Salgo60,
Silverfish, _jensen, rosalieper, Scott_WUaS, Susannaanas, Jane023,
Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius,
Lydia_Pintscher, Fabrice_Florin, Raymond, Nikerabbit, Steinsplitter, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added a comment. Thanks @Lydia_Pintscher and sorry for forgetting to tag the issue for Wikidata. On my side, I would be keen to transform the wrapper into a Wikibase extension, but lack the skills to develop in the MediaWiki environment. It is also a significant risk to invest energy into this without being reasonably confident that it will end up being deployed on Wikidata and Commons. Would you know of contractors who you would trust to develop an extension to the quality and security standards required in Wikimedia production settings? I think it would be interesting to start a preliminary discussion about the overall feasibility of this: there might be aspects of the API specs that do not fit well with the sort of APIs that MediaWiki exposes (URL format, for instance), or that your production settings require (CORS headers, constraints on the timing of HTTP requests…) If we can identify such hurdles early, we could adapt the specs accordingly (assuming the rest of the community agrees), or convince ourselves that we will really have to stick to the wrapper-based system. TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added a comment. There is also the simpler idea of hosting the existing wrapper as an official Wikidata service (just like `query.wikidata.org` is an official Wikidata service, even though Blazegraph is not part of the MediaWiki instance, nor is maintained by WMDE). Comparing my tiny wrapper to Blazegraph is perhaps a bit bold (in terms of maturity), but I am just trying to explore all the ways in which Wikidata could officially offer a reconciliation service. TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T261292: Seed test system with data useful for toolbuilder validation
Pintoch added a comment. Oh I see, sorry for the misunderstanding! Concerning the items and properties in this Wikibase instance, I think that looks good. I see you have added items and properties for the constraint system - that's great! But it is not clear to me if the quality constraints extension has been installed accordingly? TASK DETAIL https://phabricator.wikimedia.org/T261292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Tarrow, Pintoch Cc: Pintoch, Aklapper, Samantha_Alipio_WMDE, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
Pintoch added a comment. I realized today that I have uptime statistics for this service since I have been monitoring it for a few years (with downnotifier.com). | Year | Nb of outages | Uptime| | 2018 | 67| 99.79%| | 2019 | 324 | 99.09%| | 2020 | 241 so far| 98.02% so far | | These are obtained by polling the service every 10 minutes with the same query (and retrying every minute in case of failure). The large majority of the outages detected by this polling strategy are 502 errors which last for a few minutes. In comparison, a simple deployment of the service on https://wikidata.reconci.link/ (with just Apache as a reverse proxy to the tool) achieves 99.99+% availability so far (the only outage registered so far is when the service was initially set up). So perhaps the complexity of the deployment in toolforge comes at a performance price? I would not be able to pin down where sadly… TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Thadguidry, Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T263527: Create separate key for local entities
Pintoch added a comment. @Samantha_Alipio_WMDE that sounds perfect! TASK DETAIL https://phabricator.wikimedia.org/T263527 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Tarrow, Pintoch Cc: Samantha_Alipio_WMDE, Aklapper, Pintoch, Silvan_WMDE, Alter-paule, Beast1978, Un1tY, Akuckartz, Hook696, darthmon_wmde, Kent7301, joker88john, CucyNoiD, Nandana, Gaboe420, Giuliamocci, Cpaulf30, Lahi, Gq86, Af420, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T261292: Seed test system with data useful for toolbuilder validation
Pintoch added a comment. It looks great! Here are a few comments: - I assume the constraint ids don't appear there because the quality constraints extension is not installed on this wiki, but would appear otherwise? - In the manifests that we use, we have currently added a `maxlag` setting (to know which `maxlag=` is recommended when making edits). I don't know if that is worth including in your version or if it is actually always going to be 5 in all deployments… Also, there will inevitably be things that will need to be added to the manifest, as the tools ecosystem and the core platform evolves. For instance, say OpenRefine wants to display a note about the license used on the target Wikibase instance, to make sure users are aware of it. Assuming the WikibaseManifest extension has already been deployed on Wikidata and other Wikibase instances, what sort of process should we follow to add this? I imagine we need to file a Phabricator ticket to propose a syntax for the new field, submit a Gerrit patch to add it to the extension, wait for a new release and deployment? Do you already have some ideas about the sort of policy you would apply to these changes? I assume it would be legitimate for you to be reluctant to add fields which are overly tool-specific and therefore outside the scope of this project. With that in mind, what is your expectation for tool builders: - We rely entirely on the manifest exposed by Wikibase: users can configure a Wikibase instance just by adding the corresponding URL. It is clean, but relies on the assumption that all configuration parameters we will ever need will be available there (and puts pressure on the release and deployment process on your side to get new fields shipped quickly) - We still use our own configuration format, which is stripped of all information we can extract from the Wikibase instance via the new extension. This is more flexible, but still requires users to write manifests manually (although they would be much smaller). TASK DETAIL https://phabricator.wikimedia.org/T261292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Tarrow, Pintoch Cc: Pintoch, Aklapper, Samantha_Alipio_WMDE, Akuckartz, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
Pintoch added a comment. It does use tools-redis indeed! TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Bstorm, Thadguidry, Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
Pintoch added a comment. Yesterday the `https://wdreconcile.toolforge.org/` service returned 504 errors for all URLs (after a waiting time - they did not appear "cached" as in this ticket). Restarting the service seems to temporarily mitigate the issue, so it's probably a different sort of outage. I do not commit to restarting the service when this happens - I no longer receive notifications when the service is down. If people want to volunteer to do it, I can give them access to the tool. To restart the service, a single command is needed: `webservice --backend kubernetes python3.7 restart`. It is very simple! TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Thadguidry, Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T266212: improve Wikidata autocomplete service
Pintoch removed a project: Wikidata-Query-Service. TASK DETAIL https://phabricator.wikimedia.org/T266212 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Aklapper, VladimirAlexiev, Akuckartz, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, CBogen, Namenlos314, Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Jdouglas, Tobias1984, Manybubbles ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unassigned] T207839: Batch add WO II war memorials to Wikidata
Pintoch removed Pintoch as the assignee of this task. Pintoch added a comment. (just removing myself as assignee as I am not expected to work on this task, I was just available to help during the event) TASK DETAIL https://phabricator.wikimedia.org/T207839 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Ecritures, Jane023, Multichill, Footech, Elvalente, Pintoch, RonnieV, SIryn, MxLucy, Dat_doris, Phofx, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331, Ainali ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
Pintoch added a comment. Thanks a lot @Lydia_Pintscher ! I have also used this opportunity to optimize the service and deploy it with ASGI, which Toolforge does not support as far as I know. Perhaps this is an indication that this should rather be a Cloud VPS project, where we would be more in control of the deployment. But this would still live behind an HTTPS proxy. At the moment my priority is to make sure there is one reliable instance out there, where I can fix any issue directly. TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added a comment. Thanks a lot @Mvolz! The new endpoint running at https://wikidata.reconci.link/ is much more stable but I assume that it is even harder for you to rely on something that is outside the WMF ecosystem (compared to a toolforge project). TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: WMDE-leszek, Addshore, Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Akuckartz, darthmon_wmde, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, SandraF_WMF, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] T237899: Wikidata item ID changes caused by merges do not update entities on Structured data on Commons
Pintoch added a comment. If someone takes the initiative to run a bot to propagate Wikidata redirects in Commons, they might be interested in integrating that bot with the EditGroups instance for Commons (https://editgroups-commons.toolforge.org/, that I just deployed) so that the effect of a bad merge can be reverted on Commons too (just like KrBot is integrated with the Wikidata instance of the tool: https://editgroups.toolforge.org/?tool=KrBotResolvingRedirect TASK DETAIL https://phabricator.wikimedia.org/T237899 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Multichill, Lucas_Werkmeister_WMDE, Ramsey-WMF, LucasWerkmeister, Cparle, Keegan, Tacsipacsi, Aklapper, Jarekt, toberto, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached
Pintoch added a comment. @Spinster I'd rather keep this open since this is a problem that is likely to be relevant to other tools and still has not been solved as far as I can tell. It seems similar to T282732 <https://phabricator.wikimedia.org/T282732> which is current apparently. TASK DETAIL https://phabricator.wikimedia.org/T257405 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Fuzheado, Spinster, wolfgang8741, Bstorm, Thadguidry, Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, Invadibot, Devnull, maantietaja, Akuckartz, Nandana, skpuneethumar, Zylc, 1978Gage2001, Lahi, Operator873, Gq86, Bsandipan, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, Nattes, QZanden, Tbscho, Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, Mbch331, Krenair ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T266344: OpenRefine integration feedback for the Wikibase manifests
Pintoch added a comment. Ok, I think I still don't understand it fully, but I trust you do and won't stand in the way ^^ TASK DETAIL https://phabricator.wikimedia.org/T266344 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Abbe98, Pintoch, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T266344: OpenRefine integration feedback for the Wikibase manifests
Pintoch added a comment. > For OpenRefine(and other tools) the benefit would be that RDF ontologies can be extended very easily so that tools can define their own (namespaced) properties. Where would those namespaced properties be published? - If it is in the document served by WikibaseManifest, then as a tool author I have the same problem as currently: if I wanted to make sure that all of my tool's configuration can be derived from the contents of the WikibaseManifest, then whenever I need to introduce a configuration parameter to implement a new feature in my tool, I first need to submit a patch to WikibaseManifest for it to expose this information (be it namespaced or not), get it merged, get a new version of the extension be released and deployed on the wikis I want to interact with. - If it is in a separate file, hosted somewhere else, then how does OpenRefine discover it? If we need to point OpenRefine to it, then it's the same situation as the current manifests, just with a different format. Or is there some other way I am not aware of? TASK DETAIL https://phabricator.wikimedia.org/T266344 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Abbe98, Pintoch, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T266344: OpenRefine integration feedback for the Wikibase manifests
Pintoch added a comment. Thanks for reviving this thread I had forgotten about ^^ I don't think I fully understand your vision here, because it's not clear to me what problem we would solve by using an ontology in this case. To me, the main problem is that the information OpenRefine requires to offer upload functionality for a Wikibase instance is a mixture of things that can be discovered automatically (via the WikibaseManifest extension) and other tool-specific fields (such as the EditGroups template summary, or more recently the predefined schemas to offer to the user) which don't make sense for other tools and therefore don't really make sense to include in something served by the Wikibase instance itself. So, even if we are assuming that the WikibaseManifest extension serves its information by following some particular ontology, the tool-specific information will not be available there. That means we cannot make it possible to just set up a Wikibase instance in OpenRefine just by providing the URL of the Wikibase instance and letting OpenRefine discover the configuration there. Or how would OpenRefine discover this additional information it requires? In my opinion, the WikibaseManifest extension already provides a valuable help in that it exposes generic configuration information in the Wikibase instance already. OpenRefine could adapt its own manifest format to make it smaller, only containing information that cannot be derived from the WikibaseManifest (https://github.com/OpenRefine/OpenRefine/issues/4258). If some of those generic fields change, this could also make it easier for OpenRefine to update its own configuration dynamically (since those fields would be fetched directly from the Wikibase instance). TASK DETAIL https://phabricator.wikimedia.org/T266344 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Abbe98, Pintoch, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T150290: add CORS to all redirects in chain from https://www.wikidata.org/entity/{Q...}
Pintoch added subscribers: SebastianHellmann, Pintoch. Pintoch added a comment. This bug was mentioned today at LSWT'22 <https://dataweek.de/lswt2022/> by @SebastianHellmann as a blocker for integrating Wikidata in linked data applications. Fetching a URI with content negotiation is the standard way to retrieve information about an entity in the linked open data movement, so it does feel like this would be worth solving. TASK DETAIL https://phabricator.wikimedia.org/T150290 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, SebastianHellmann, Lucas_Werkmeister_WMDE, thiemowmde, gerritbot, hoo, daniel, Aklapper, elf-pavlik, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, lucamauri, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: GFontenelle_WMF, jdtoy, SandraF_WMF, JeanFred, Fuzheado, Eugene233, PabloCastellano, Loz.ross, RShigapov, Spinster, Samantha_Alipio_WMDE, WMDE-leszek, Addshore, Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Thadguidry, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, GoranSMilovanovic, Nattes, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added subscribers: Tarrow, VladimirAlexiev. Pintoch added a comment. Here is the current status of this issue: The team at TIB (headed by @Loz.ross) is now maintaining the current wrapper and has contributed improvements to deploy it on other Wikibase instances: https://gitlab.com/nfdi4culture/ta1-data-enrichment/openrefine-wikibase Thank you to them! The endpoint "https://wikidata.reconci.link/; is now served by a Wikimedia Cloud VPS (although it is running behind a proxy to retain the original domain name), which improves performance slightly by virtue of being closer to the Wikidata infrastructure. Thank you @Tarrow for suggesting it! The Cloud VPS project is `wikidata-reconciliation`. Getting rid of the proxy should be doable too, if I could find the time. Prompted by the bad performance of this endpoint, Ontotext offers alternate endpoints for certain entity types, powered by their own search index over Wikidata. This video explains their approach <https://www.ontotext.com/knowledgehub/videos/kgf21-talks-reconciliation-server-demonstration-against-wikidata/>. The endpoints are: - https://reconcile.ontotext.com/people - https://reconcile.ontotext.com/organizations - https://reconcile.ontotext.com/locations Thank you Ontotext (@VladimirAlexiev among others). That's all I am aware of for now. TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: VladimirAlexiev, Tarrow, Michael, GFontenelle_WMF, jdtoy, SandraF_WMF, JeanFred, Fuzheado, Eugene233, PabloCastellano, Loz.ross, RShigapov, Spinster, Samantha_Alipio_WMDE, WMDE-leszek, Addshore, Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Thadguidry, Tore_Danielsson_WMSE, Nandana, Lahi, Gq86, GoranSMilovanovic, Nattes, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T203557: Create a Edit group extension
Pintoch added a comment. A feature request came in: handling changes of username on the wiki <https://www.wikidata.org/w/index.php?title=Wikidata:Project_chat=1787084712=1787082920>. I suspect this is a feature that would likely come "for free" in any reimplementation of the current tool as a MediaWiki extension, because it would rely on the existing SQL tables in MediaWiki to represent users. This is a good occasion for an update about the status of the current tool <https://www.wikidata.org/w/index.php?title=Wikidata:Project_chat=1787390676=1787331365>. In short, I am not working on it anymore but am available to hand over the maintainership to others. The most pressing issues are (in my opinion): - in the current tool, support ingesting edits via other sources than the Wikimedia Event Stream, so that the tool can be deployed on non-Wikimedia MediaWiki instances; - investigate the instability of the Wikimedia Commons instance of this tool <https://editgroups-commons.toolforge.org>; - build a MediaWiki extension to replace it, to solve the problems mentioned above <https://phabricator.wikimedia.org/T203557#5626325>. TASK DETAIL https://phabricator.wikimedia.org/T203557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Spinster, taavi, Addshore, David_Haskiya_WMSE, SandraF_WMF, Lokal_Profil, Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, Pintoch, Framawiki, Aklapper, Bugreporter, Astuthiodit_1, karapayneWMDE, Invadibot, GFontenelle_WMF, Md_Tanbir_Islam, maantietaja, FRomeo_WMF, CBogen, ItamarWMDE, Nintendofan885, Akuckartz, Tore_Danielsson_WMSE, DannyS712, Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Samwilson, Susannaanas, Fuzheado, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Daniel_Mietchen, Dinoguy1000, Ricordisamoa, Wesalius, Raymond, Steinsplitter, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T194767: Set up OpenRefine on Cloud VPS
Pintoch added a comment. Agreed, I would say PAWS replaces this task. TASK DETAIL https://phabricator.wikimedia.org/T194767 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Spinster, Nattes, LucasWerkmeister, yuvipanda, CennoxX, Aklapper, Abbe98, Pintoch, Lucas_Werkmeister_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Culex, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T330859: MWException: Wikibase\Lib\LanguageWithConversion::validateLanguageCode: invalid language code core-recon/wd-recon-lang
Pintoch added a comment. Thanks for the heads up, I have opened an issue about it on OpenRefine's side: https://github.com/OpenRefine/OpenRefine/issues/5658 TASK DETAIL https://phabricator.wikimedia.org/T330859 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Pintoch, Michael, I, Aklapper, Lucas_Werkmeister_WMDE, jnuche, Themindcoder, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, 786, Biggs657, karapayneWMDE, Invadibot, Func, maantietaja, Juan90264, Alter-paule, Beast1978, ItamarWMDE, Un1tY, Akuckartz, Winston_Sung, Hook696, darthmon_wmde, Rosalie_WMDE, Kent7301, VulpesVulpes825, joker88john, CucyNoiD, Nandana, Gaboe420, AbdellahSADIQUI, Giuliamocci, Cpaulf30, Lahi, Willy1018, Gq86, Af420, Biblbroks, Bsandipan, GoranSMilovanovic, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, rosalieper, Taiwania_Justo, Neuronton, Scott_WUaS, LNDDYL, Verdy_p, Wikidata-bugs, aude, ssastry, Jdforrester-WMF, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T327062: Show entity labels in parsed edit summaries in API requests as well
Pintoch added a comment. Thank you both, this should simplify the EditGroups tool quite a bit! Here is an example of page where I had to render entity links manually, with some Javascript post-processing code: https://editgroups.toolforge.org/b/CB/3683873dde8d/. (I guess I will keep this logic for a while, for all the revisions fetched already, but it could be dropped in some years) TASK DETAIL https://phabricator.wikimedia.org/T327062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, Pintoch Cc: Pintoch, Bene, ItamarWMDE, HasanAkgun_WMDE, Lydia_Pintscher, Lectrician1, Michael, karapayneWMDE, Lucas_Werkmeister_WMDE, Aklapper, Astuthiodit_1, Invadibot, maantietaja, Akuckartz, Nandana, lucamauri, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T244847: Future of the OpenRefine Wikidata reconciliation interface
Pintoch added a comment. @Addshore wrote a blog post summarizing the options around this problem and I think it's a very worthy read: https://addshore.com/2023/07/wikibase-and-reconciliation/ TASK DETAIL https://phabricator.wikimedia.org/T244847 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: EBernhardson, Sj, VladimirAlexiev, Tarrow, Michael, GFontenelle_WMF, jdtoy, SandraF_WMF, JeanFred, Fuzheado, Eugene233, PabloCastellano, Loz.ross, RShigapov, Spinster, Samantha_Alipio_WMDE, WMDE-leszek, Addshore, Lydia_Pintscher, Abbe98, tfmorris, David_Haskiya_WMSE, Lokal_Profil, Mvolz, Alicia_Fagerving_WMSE, Regisrob, Pintoch, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Thadguidry, Tore_Danielsson_WMSE, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Nattes, QZanden, EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Nikerabbit, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T339920: [ES-M2]: Return EntitySchema as `entityschemaid` through the Action API
Pintoch added a comment. Yes, if it was unclear from my comments I can try to clarify again here. From an API user perspective my preferences are (from most preferred to least preferred): 1. `wikibase-entityid` datavalue type, for consistency with the targeted user experience (EntitySchemas being entities themselves) 2. `string` datavalue type, which is inconsistent with the UX but has the benefit of being an established datavalue type, which any existing API client library is bound to support already (Wikidata-Toolkit, Wikibase-SDK, pywikibot, …) 3. A new datavalue type, which will likely require some light changes in most API client libraries, and perhaps lead to failures of various severities until those changes are made (for those which have not anticipated the introduction of new datavalue types) TASK DETAIL https://phabricator.wikimedia.org/T339920 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Tpt, WMDE-leszek, Michael, Lucas_Werkmeister_WMDE, Arian_Bozorg, Pintoch, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, pdehaye, Nandana, Lahi, Gq86, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, LawExplorer, Salgo60, _jensen, rosalieper, Scott_WUaS, MisterSynergy, abian, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T327062: Show entity labels in parsed edit summaries in API requests as well
Pintoch added a comment. If it's not too difficult, it would be helpful to have that behavior in `list=recentchanges` too, typically for tools which do recent changes polling. (EditGroups sadly uses the EventStreams <https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams> service and not RC polling directly - not sure if changing `list=recentchanges` would also impact the EventStreams as well?) TASK DETAIL https://phabricator.wikimedia.org/T327062 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, Pintoch Cc: Arian_Bozorg, Pintoch, Bene, ItamarWMDE, HasanAkgun_WMDE, Lydia_Pintscher, Lectrician1, Michael, karapayneWMDE, Lucas_Werkmeister_WMDE, Aklapper, Astuthiodit_1, Invadibot, maantietaja, Akuckartz, Nandana, lucamauri, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331 ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T358644: Invalid qualifier snak in Form preventing correct JSON serialization and editing
Pintoch created this task.
Pintoch added projects: Wikidata, Wikidata Lexicographical data.
TASK DESCRIPTION
**Steps to replicate the issue** (include links if applicable):
- Go to https://www.wikidata.org/wiki/Lexeme:L1259271
**What happens?**:
- A qualifier is rendered as "The value is invalid and cannot be displayed."
in red.
- The entity cannot be edited (no edit button on any claims)
- In the JSON serialization of the entity
(https://www.wikidata.org/w/api.php?action=wbgetentities=L1259271), I see
the serialization of the qualifier as:
{
"snaktype": "value",
"property": "P898",
"hash": "e49ad5fcdc05da78bac23b8373d04a80fecf16aa",
"datavalue": {
"value": null,
"type": "string",
"error": "Can only construct StringValue from strings"
},
"datatype": "string"
}
- In my browser's console, I see an error:
Error: The undeserializable structure has to be a plain object.
UnDeserializableValue UnDeserializableValue.js:29
createFunction util.inherit.js:37
deserialize SnakDeserializer.js:38
addSerializedSnaksToSnakList SnakListDeserializer.js:17
deserialize SnakListDeserializer.js:76
deserialize ClaimDeserializer.js:31
deserialize StatementDeserializer.js:25
deserialize StatementListDeserializer.js:28
**What should have happened instead?**:
None of those errors.
**Software version** (skip for WMF-hosted wikis like Wikipedia): Wikidata, in
production
**Other information** (browser name/version, screenshots, etc.):
F42205384: image.png <https://phabricator.wikimedia.org/F42205384>
TASK DETAIL
https://phabricator.wikimedia.org/T358644
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Pintoch
Cc: Pintoch, Danny_Benjafield_WMDE, Astuthiodit_1, karapayneWMDE, Invadibot,
maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic,
Mahir256, QZanden, KimKelting, LawExplorer, _jensen, rosalieper, Scott_WUaS,
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
[Wikidata-bugs] [Maniphest] T203557: Create a Edit group extension
Pintoch added a comment. Quick update on this: undoing edit batches on Wikidata via the current EditGroups has been broken for about two months now and the few hours I have spent trying to fix it have not been sufficient so far. On the surface it seems related to the instability of the shared Redis instance on Toolforge: T318479 <https://phabricator.wikimedia.org/T318479> (the timing seems to match, but not sure if it's really the root cause). Discussion about the outage has been happening at Wikidata_talk:Edit_groups <https://www.wikidata.org/wiki/Wikidata_talk:Edit_groups#Not_working?> and in Project chat <https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2024/05#Ability_to_revert_batch_edits_appears_broken>. Arguably it's a pretty bad situation because it leaves bad edits in the wiki (unless people find other ways to undo, but I am not aware of any alternative so far). Since March 25th (approximate start of the outage), people have tried undoing batches 105 times (for 74 distinct batches totaling 93,735 edits) in EditGroups and it only succeeded for three of those batches. Beyond the long-term approach proposed by this ticket (which I wholeheartedly support), there would be room for other approaches: - one could try to fix the current tool, for instance by migrating it to a Cloud VPS instance (as sketched in Wikidata_talk:Edit_groups <https://www.wikidata.org/wiki/Wikidata_talk:Edit_groups#Not_working?>) - one could develop a separate tool (user script? other toolforge tool? command-line tool?) to undo a batch given its id. Given that the current EditGroups tool is still able to track edits and list them via an API, it could perhaps still be used for this purpose, with the auxiliary tool only having to issue a series of `undo` API requests for each edit in the batch. - or perhaps a more generic tool which would be able to undo all edits matching certain conditions (not necessarily coupled to the batch ids)? Given that the presence of the tool gives the false impression that batches can be undone, I also wonder if any steps should be taken to advertise the problem to the wider community, adding notices in batch editing tools to warn people that their imports cannot be undone easily anymore, and so on? I am not sure it would encourage anyone to change anything in what they are doing though. I would welcome any opinion on this problem, whether or not it is accompanied by more concrete help. TASK DETAIL https://phabricator.wikimedia.org/T203557 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Pintoch Cc: Dringsim, Mormegil, RPI2026F1, Spinster, taavi, David_Haskiya_WMSE, SandraF_WMF, Lokal_Profil, Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, Pintoch, Aklapper, Bugreporter, Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, karapayneWMDE, Invadibot, GFontenelle_WMF, Md_Tanbir_Islam, maantietaja, FRomeo_WMF, ItamarWMDE, Nintendofan885, Akuckartz, Tore_Danielsson_WMSE, DannyS712, Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, GoranSMilovanovic, QZanden, KimKelting, Tramullas, Acer, LawExplorer, Salgo60, Silverfish, _jensen, rosalieper, Scott_WUaS, Samwilson, Susannaanas, Fuzheado, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Daniel_Mietchen, Dinoguy1000, Ricordisamoa, Wesalius, Raymond, Steinsplitter, Mbch331, Jay8g ___ Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org
