[Wikidata-bugs] [Maniphest] [Updated] T92961: [Story] Versioning in JSON output

[Pintoch]

Pintoch added a comment.


  Concerning the dumps, it should be possible to add versioning information on 
a per-entity basis, for instance by adding the revision id in the JSON 
serialization of the entity, as is currently done in Special:EntityData. This 
would arguably be more useful than a per-dump versioning, given that the dump 
generation process is not atomic. It would also be less of a breaking change: 
it would just amount to make JSON serialization of entities more uniform. This 
is debated in T87283 <https://phabricator.wikimedia.org/T87283>.

TASK DETAIL
  https://phabricator.wikimedia.org/T92961

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Pfps, aude, Smalyshev, Ricordisamoa, Addshore, Lydia_Pintscher, 
adrianheine, JanZerebecki, daniel, Tobi_WMDE_SW, Aklapper, alaa_wmde, Nandana, 
Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, 
Wikidata-bugs, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

[Pintoch]

Pintoch added a comment.


  I am wondering what is the status of this: is more discussion needed about 
what version information to include, or are we simply waiting for a patch? I 
vote for the revision id to serve as version id (possibly with other metadata 
such as timestamp, as in Special:EntityData). If there is consensus for that, 
and if directed to the relevant part of the code, I could contribute patch.

TASK DETAIL
  https://phabricator.wikimedia.org/T87283

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Addshore, Ivan_A_Krestinin, TorbenRahbekKoch, Ricordisamoa, 
Denis.bykov, Jimkont, Magnus, mkroetzsch, JanZerebecki, daniel, hoo, Aklapper, 
Smalyshev, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T94019: Generate RDF from JSON

[Pintoch]

Pintoch added a comment.


  I think Wikidata-Toolkit could be used for that:
  
https://github.com/Wikidata/Wikidata-Toolkit/blob/master/wdtk-rdf/src/main/java/org/wikidata/wdtk/rdf/RdfSerializer.java
  Obviously it would mean making sure the RDF serialization produced by it is 
consistent with what is being fed in WDQS at the moment.

TASK DETAIL
  https://phabricator.wikimedia.org/T94019

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Smalyshev, hoo, Liuxinyu970226, mkroetzsch, Aklapper, daniel, 
alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

[Pintoch]

Pintoch added a comment.


  @Smalyshev okay! Sorry if this is not the right place: I would be happy to 
migrate the patch to another ticket. Indeed this only adds entity-level 
metadata, not dump-level metadata. I think this would be less of a breaking 
change, given that it does not require changing the dump structure (and of 
course it is more useful to me, haha!)

TASK DETAIL
  https://phabricator.wikimedia.org/T87283

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Addshore, Ivan_A_Krestinin, TorbenRahbekKoch, Ricordisamoa, 
Denis.bykov, Jimkont, Magnus, mkroetzsch, JanZerebecki, daniel, hoo, Aklapper, 
Smalyshev, alaa_wmde, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, 
Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, 
rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T216160: Update wikidata-entities dump generation to fixed day-of-month instead of fixed weekday

[Pintoch]

Pintoch added a comment.


  I agree with @Nicolastorzec above.
  
  I suspect that the entity dumps are more popular and cheaper to generate than 
the full SQL/XML dumps, so I would argue that they should be generated more 
often.
  
  Even if the entity dumps and the SQL/XML dumps were generated "at the same 
time", it would probably be hard to give guarantees about their relatedness: 
some revisions will always be included in one but not the other given the 
different time frames for the generation, no?
  
  I have proposed a patch 
<https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/Wikibase/+/500806/> to 
add the revision id for each entity in the JSON dumps. This way, users have at 
least a way to compare the freshness of the data from different sources.

TASK DETAIL
  https://phabricator.wikimedia.org/T216160

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Rosiestep, Lea_Lacroix_WMDE, WMDE-leszek, Mvolz, notconfusing, 
Envlh, Melderick, Nicolastorzec, hoo, Smalyshev, Addshore, ArielGlenn, 
JAllemandou, alaa_wmde, CucyNoiD, Nandana, NebulousIris, Akovalyov, Gaboe420, 
Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Zambujo, Lahi, 
Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Lunewa, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, 
Lewizho99, Maathavan, _jensen, rosalieper, gnosygnu, Wikidata-bugs, aude, 
Daniel_Mietchen, jayvdb, Mbch331, jeremyb
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T204440: analyze and visualize the identifier landscape of Wikidata

[Pintoch]

Pintoch added a comment.


  This is nice! However, when visualizing properties by category, it seems that 
subclasses are not taken into account: only the properties bearing that exact 
category as P31 <https://phabricator.wikimedia.org/P31> value are listed. This 
gives a pretty inaccurate view: it is crucial to respect this hierarchy, just 
like the prop-explorer tool does:
  https://tools.wmflabs.org/prop-explorer/
  
  For instance, when browsing the category Wikidata property to identify 
organisations <https://www.wikidata.org/wiki/Q21745557>, I want to see 
Corporate Number (Japan) <https://www.wikidata.org/wiki/Property:P3225>, 
because it is marked as a Wikidata property to identify organizations in 
company registers <https://www.wikidata.org/wiki/Q26235166>, which is a 
subclass.
  
  I believe that might be the issue that confused @connorshea above: they might 
have looked for their property in a super-class of the classes explicitly 
declared on it.

TASK DETAIL
  https://phabricator.wikimedia.org/T204440

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GoranSMilovanovic, Pintoch
Cc: Pintoch, Daniel_Mietchen, connorshea, Moebeus, Multichill, Hjfocs, 
RazShuty, GoranSMilovanovic, Aklapper, Lydia_Pintscher, alaa_wmde, Nandana, 
Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T87283: Wikidata dumps should have revision ID or other sequence mark

[Pintoch]

Pintoch added a subscriber: Lydia_Pintscher.
Pintoch added a comment.


  @Lydia_Pintscher we would need your thoughts about this.
  
  In a nutshell, the proposal is to add the `lastrevid` field currently exposed 
in `Special:EntityData` and in the API (`action=wbgetentities`) to the JSON 
dumps too. This field stores the id of the revision which contains the entity 
as serialized. Currently, no revision information is included in the dumps at 
all. Because this only adds an extra field to JSON objects, without changing 
the rest of the structure, this should not break any reasonable consumer, 
especially if they are able to parse JSON representations from the API as well.
  
  The patch is here: https://gerrit.wikimedia.org/r/500806 (I'll fix the issues 
picked up by Jenkins if you think the change is useful)

TASK DETAIL
  https://phabricator.wikimedia.org/T87283

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Lydia_Pintscher, Pintoch, Addshore, Ivan_A_Krestinin, TorbenRahbekKoch, 
Ricordisamoa, Denis.bykov, Jimkont, Magnus, mkroetzsch, JanZerebecki, hoo, 
Aklapper, Smalyshev, alaa_wmde, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, 
Maathavan, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

[Pintoch]

Pintoch added a comment.


  Ok great! I'll move the field to the end and try to make Jenkins happy then.

TASK DETAIL
  https://phabricator.wikimedia.org/T87283

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Lydia_Pintscher, Pintoch, Addshore, Ivan_A_Krestinin, TorbenRahbekKoch, 
Ricordisamoa, Denis.bykov, Jimkont, Magnus, mkroetzsch, JanZerebecki, hoo, 
Aklapper, Smalyshev, alaa_wmde, joker88john, CucyNoiD, Nandana, NebulousIris, 
Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, 
Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, 
Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, WSH1906, 
Lewizho99, Maathavan, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T87283: Wikidata dumps should have revision ID or other sequence mark

[Pintoch]

Pintoch added a comment.


  Thanks all for your patience for this! Excited to see my first commit making 
it into Wikibase \o/

TASK DETAIL
  https://phabricator.wikimedia.org/T87283

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Lydia_Pintscher, Pintoch, Addshore, Ivan_A_Krestinin, TorbenRahbekKoch, 
Ricordisamoa, Denis.bykov, Jimkont, Magnus, mkroetzsch, JanZerebecki, hoo, 
Aklapper, Smalyshev, darthmon_wmde, alaa_wmde, joker88john, CucyNoiD, Nandana, 
NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, 
Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, 
LawExplorer, WSH1906, Lewizho99, Maathavan, _jensen, rosalieper, Wikidata-bugs, 
aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T223776: Create Wikidata autocomplete gadget for external entities

[Pintoch]

Pintoch added a comment.


  That's great! Is there a list of the supported external ids?

TASK DETAIL
  https://phabricator.wikimedia.org/T223776

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Danmichaelo, Pintoch
Cc: Pintoch, Lea_Lacroix_WMDE, Aklapper, Danmichaelo, darthmon_wmde, alaa_wmde, 
Ferenczy, sarhan.alaa, Samuditha24, IM3847, Nandana, kostajh, Lahi, Gq86, 
GoranSMilovanovic, Jayprakash12345, Chicocvenancio, MichaelSchoenitzer_WMDE, 
QZanden, dachary, LawExplorer, Jogi_don, _jensen, rosalieper, D3r1ck01, 
Wikidata-bugs, Jdlrobson, aude, Ricordisamoa, Sjoerddebruin, Mbch331, Rxy
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T191963: New constraint: properties with identical values

[Pintoch]

Pintoch added a comment.


  On a similar note, we also have some properties whose value is expected to be 
the subject entity id:
  
  - https://www.wikidata.org/wiki/Property:P6482
  - https://www.wikidata.org/wiki/Property:P6413

TASK DETAIL
  https://phabricator.wikimedia.org/T191963

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: abian, Hsarrazin, Pigsonthewing, Liuxinyu970226, Pintoch, Aklapper, 
darthmon_wmde, Premeditated, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, 
GoranSMilovanovic, QZanden, merbst, LawExplorer, _jensen, rosalieper, Agabi10, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T194767: Set up OpenRefine on Cloud VPS

[Pintoch]

Pintoch added a project: OpenRefine.

TASK DETAIL
  https://phabricator.wikimedia.org/T194767

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Abbe98, Pintoch, Lucas_Werkmeister_WMDE, darthmon_wmde, 
Premeditated, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
Culex, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances

[Pintoch]

Pintoch added a project: OpenRefine.

TASK DETAIL
  https://phabricator.wikimedia.org/T197588

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Nikerabbit, Salgo60, Aklapper, Gstupp, Lucas_Werkmeister_WMDE, Pintoch, 
darthmon_wmde, Premeditated, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  I am first getting in touch with people who seem to be running bots with 
maxlag greater than 5 or no maxlag parameter at all, to see if they would 
accept to follow @Addshore's advice never to use maxlag greater than 5 at all.

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, 
Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240369: Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  To ensure that Wikidata bot edits slow down when lag is high, we should 
ensure that bot operators follow the guidelines which recommend to use the 
`maxlag` parameter with a value no higher than 5.
  
  This task tracks efforts towards getting in touch with tool and bot operators 
to request compliance with this policy.

TASK DETAIL
  https://phabricator.wikimedia.org/T240369

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Aklapper, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240370: Maxlag=5 for Petscan

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  Petscan edits go through even if maxlag is higher than 5, we should fix the 
code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240370

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240371: Maxlag=5 for Author Disambiguator

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  Author Disambiguator edits go through even if maxlag is higher than 5, we 
should fix the code to ensure it complies with the maxlag policy on Wikimedia 
wikis <https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using 
maxlag=5 (or a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240371

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArthurPSmith, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Assigned] T240370: Maxlag=5 for Petscan

[Pintoch]

Pintoch assigned this task to Magnus.

TASK DETAIL
  https://phabricator.wikimedia.org/T240370

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240373: Maxlag=5 for Edoderoobot

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  Edoderoobot edits go through even if maxlag is higher than 5, we should fix 
the code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.
  
  Discussion on-wiki: https://www.wikidata.org/wiki/Topic:Vcp3k439ptb0ob0q

TASK DETAIL
  https://phabricator.wikimedia.org/T240373

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Edoderoo, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240374: Maxlag=5 for BotMultichill

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  BotMultichill edits go through even if maxlag is higher than 5, we should fix 
the code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240374

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Multichill, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240375: Maxlag=5 for LargeDatasetBot

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  LargeDatasetBot edits go through even if maxlag is higher than 5, we should 
fix the code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240375

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240376: Maxlag=5 for LogainmBot

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  LogainmBot edits go through even if maxlag is higher than 5, we should fix 
the code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240376

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: kscanne, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240377: Maxlag=5 for Reinheitsgebot

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.

TASK DESCRIPTION
  Reinheitsgebot edits go through even if maxlag is higher than 5, we should 
fix the code to ensure it complies with the maxlag policy on Wikimedia wikis 
<https://www.mediawiki.org/wiki/Manual:Maxlag_parameter> by using maxlag=5 (or 
a lower value) on all editing API queries.

TASK DETAIL
  https://phabricator.wikimedia.org/T240377

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T240369: Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T240369

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Aklapper, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T240375: Maxlag=5 for LargeDatasetBot

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T240375

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Bugreporter, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T240377: Maxlag=5 for Reinheitsgebot

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T240377

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240376: Maxlag=5 for LogainmBot

[Pintoch]

Pintoch added a comment.


  If you have not changed anything in `user-config.py` then you should be good 
to go, it might have been a false positive on my side. Sorry for the noise!

TASK DETAIL
  https://phabricator.wikimedia.org/T240376

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: kscanne, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240371: Maxlag=5 for Author Disambiguator

[Pintoch]

Pintoch added a comment.


  Matching pull request: 
https://github.com/arthurpsmith/author-disambiguator/pull/107

TASK DETAIL
  https://phabricator.wikimedia.org/T240371

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: ArthurPSmith, Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240369: Chase up bot operators whose bot keeps running when the dispatch lag is higher than 5

[Pintoch]

Pintoch added a comment.


  @Bugreporter yes indeed! I was off by one hour there. Thanks for your help! 
Feel free to add more bots which match that period.

TASK DETAIL
  https://phabricator.wikimedia.org/T240369

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Bugreporter, Pintoch, Aklapper, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240370: Maxlag=5 for Petscan

[Pintoch]

Pintoch added a comment.


  I've had a quick look at the code to see if I could submit a patch for this 
myself but it is not clear to me where the edits are done - I have looked in 
petscan_rs and wikibase_rs to no avail. Petscan edits might be done in the 
browser by sending them to some Widar-like interface?

TASK DETAIL
  https://phabricator.wikimedia.org/T240370

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Bugreporter, Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances

[Pintoch]

Pintoch added a comment.


  @Theklan let's move your issue to a different ticket as your issue does not 
seem to be related: T240436 <https://phabricator.wikimedia.org/T240436>

TASK DETAIL
  https://phabricator.wikimedia.org/T197588

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Theklan, Nikerabbit, Salgo60, Aklapper, Gstupp, Lucas_Werkmeister_WMDE, 
Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240370: Maxlag=5 for Petscan

[Pintoch]

Pintoch added a comment.


  @Bugreporter have you got details of where this behaviour is currently 
implemented in PetScan? In particular, how do you request the current maxlag 
with the MediaWiki API?

TASK DETAIL
  https://phabricator.wikimedia.org/T240370

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Bugreporter, Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T240442: Design a continuous throttling policy for Wikidata bots

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  With the introduction of the WDQS lag in Wikidata's maxlag computation 
(T221774 <https://phabricator.wikimedia.org/T221774>), we are now seeing the 
behaviour I feared: bots start and stop brutally as the lag rises and falls.
  
  F31469424: maxlag.png <https://phabricator.wikimedia.org/F31469424>
  
https://grafana.wikimedia.org/dashboard/snapshot/mbbjQjo7FMnDAath4tuRyP7F9300Wj2S?orgId=1
  
  This morning, bots which used `maxlag=5` for their edits (as advised) could 
only edit about half of the time. This start and stop behaviour is not 
desirable: bots should slow down gradually as the lag increases instead of 
running at full speed until the lag reaches 5.
  
  We should agree on a better throttling policy and implement it in most bot 
editing frameworks (QuickStatements, Pywikibot, OpenRefine, …) to improve 
everyone's experience with the service.
  
  The current policy looks like this, assuming a default rate of 1 edit/sec:
  F31469546: currentpolicy.png <https://phabricator.wikimedia.org/F31469546>
  
  We could instead try something like this, with a gradual slowdown as soon as 
maxlag goes above 2.5 sec (half the threshold where it should stop), for 
instance:
  F31469548: proposedpolicy.png <https://phabricator.wikimedia.org/F31469548>
  
  Would this be a sensible throttling policy to encourage? I believe this 
should avoid the start/stop behaviour shown above, once such a behaviour is 
adopted by most bots (which should not be super hard: by patching the most 
popular editing backends, we should cover most of it).

TASK DETAIL
  https://phabricator.wikimedia.org/T240442

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240442: Design a continuous throttling policy for Wikidata bots

[Pintoch]

Pintoch added a comment.


  If clients are able to retrieve the current lag periodically (through some 
MediaWiki API call? which one?), then this should not require any server-side 
change. Clients can continue to use `maxlag=5` but to also throttle themselves 
using the smoothed function proposed.

TASK DETAIL
  https://phabricator.wikimedia.org/T240442

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240370: Maxlag=5 for Petscan

[Pintoch]

Pintoch added a comment.


  Thanks for the analysis! Whether this is a breaking change or not is not my 
concern: Petscan and other mass-editing tools based on Widar should play by the 
book. I can provide a simple patch which ensures maxlag=5 is applied to all 
Widar edits: if someone wants to do a refined version which allows specific 
user-triggered edits to go through without a maxlag parameter, that is great. 
@Magnus, what is your take on this?

TASK DETAIL
  https://phabricator.wikimedia.org/T240370

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Magnus, Pintoch
Cc: Bugreporter, Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240442: Design a continuous throttling policy for Wikidata bots

[Pintoch]

Pintoch added a comment.


  Thanks! I think dynamically changing the maxlag value is likely to still 
introduce some thresholds, whereas a continuous slowdown (by retrieving the lag 
and compute one's edit rate based on it) should in theory reach an equilibrium 
point.
  
  In the meantime, Wikidata is really unusable with mass-editing tools at the 
moment. It is hard to convince people to respect maxlag=5 when that prevents 
them from editing half of the time, so I think it would be worth raising the 
WDQS factor again. We have identified which tools need to comply better, and 
having a small factor was useful for that. We probably do not want to stay in 
this state for weeks (Widar is likely to take a long time to get fixed). We 
might not want to punish the polite ones too hard!

TASK DETAIL
  https://phabricator.wikimedia.org/T240442

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Addshore, Aklapper, Pintoch, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T241029: EditGroups tool: Unstable connection to SQL database on Toollabs

[Pintoch]

Pintoch created this task.
Pintoch added projects: Toolforge, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  The EditGroups tool <https://tools.wmflabs.org/editgroups/> listens to the 
EventStream <https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams> 
for Wikidata edits and stores their metadata in its own SQL database.
  
  The listener process is a Python program which runs in Kubernetes. It 
connects to the SQL database (`s53685__editgroups`) via Django's ORM and 
performs the ingestion by batches of edits.
  
  Over the past few weeks, the listener has started to die a lot more 
frequently, generally because its SQL connection vanishes:
  
django.db.utils.OperationalError: (2006, 'MySQL server has gone away')
  
  (full stack trace available in the corresponding GitHub issue 
<https://github.com/Wikidata/editgroups/issues/28>).
  
  These repeated failures (about one every hour currently) mean that the 
listener is accumulating lag (currently 7 hours behind).
  
  Has labsdb become more unstable recently? Is there any way to prevent these 
disconnections? Could perhaps the database be moved to a more reliable host?

TASK DETAIL
  https://phabricator.wikimedia.org/T241029

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Aklapper, darthmon_wmde, Nandana, Zylc, 1978Gage2001, Lahi, 
aborrero, Gq86, GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, Freddy2001, 
LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, srodlund, Luke081515, 
Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, scfc, coren, Mbch331, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T241422: Wikidata forms without statements use empty JSON array instead of empty JSON object

[Pintoch]

Pintoch created this task.
Pintoch added projects: Lexicographical data, Wikidata.

TASK DESCRIPTION
  It looks like this was missed in the resolution of T138104 
<https://phabricator.wikimedia.org/T138104>: statements in forms seem to be 
still affected by the misuse of empty JSON arrays in place of empty JSON 
objects.
  
  For instance, 
https://www.wikidata.org/w/api.php?action=wbgetentities&format=json&ids=L3872 
returns:
  `"claims":[]` in the serialization of `L3872-F2`.

TASK DETAIL
  https://phabricator.wikimedia.org/T241422

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, darthmon_wmde, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T241422: Wikidata forms without statements use empty JSON array instead of empty JSON object

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T241422

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, darthmon_wmde, Nandana, Mringgaard, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T240442: Design a continuous throttling policy for Wikidata bots

[Pintoch]

Pintoch added a comment.


  It is actually possible to retrieve the current maxlag value from the API 
without making any edit (see @Addshore's comment above).
  So, just retrieve the current maxlag value and compute your desired edit rate 
for this maxlag with the function plotted above. Then sleep for the appropriate 
amount of time between any two edits to achieve this rate. Refresh the maxlag 
value from the server periodically.

TASK DETAIL
  https://phabricator.wikimedia.org/T240442

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: ArthurPSmith, Addshore, Aklapper, Pintoch, darthmon_wmde, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  I don't know - I stopped working on this task and T240369 
<https://phabricator.wikimedia.org/T240369> since T240374 
<https://phabricator.wikimedia.org/T240374> was declined. I don't think I can 
contribute to solving this problem in the current state of affairs, sorry!

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: ArthurPSmith, Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, 
Magnus, Tpt, Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  This does not have anything to do with you indeed! I was just trying to 
explain that I stopped trying to help solve this issue (therefore unsubscribing 
from this).

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: ArthurPSmith, Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, 
Magnus, Tpt, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T207484: API to efficiently format large numbers of entity IDs

[Pintoch]

Pintoch added a comment.
@Lucas_Werkmeister_WMDE thank you very much for that!TASK DETAILhttps://phabricator.wikimedia.org/T207484EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, PintochCc: Pintoch, Addshore, Lydia_Pintscher, Lea_Lacroix_WMDE, gerritbot, Aklapper, LucasWerkmeister, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, _jensen, D3r1ck01, Jonas, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T139898: New gadget to aid property creation process

[Pintoch]

Pintoch added a comment.
I currently use my own custom hacky script to create properties, but having something stable and usable by anyone would be highly beneficial.TASK DETAILhttps://phabricator.wikimedia.org/T139898EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, ChristianKl, Micru, Lydia_Pintscher, Josve05a, Edgars2007, Aklapper, Zppix, Bugreporter, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, dachary, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T213012: Enable the Watchlist Messages gadget in Wikidata

[Pintoch]

Pintoch created this task.Pintoch added a project: Wikidata-Gadgets.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata.
TASK DESCRIPTIONSome other Wikimedia sites have a gadget which makes it possible to display dynamic watchlist messages (above the actual content of the watchlist).

Wikidata currently displays a static content there, which is updated mostly manually by admins. This content is often stale, takes a lot of space on small screens, and users have no simple way to hide it once they have read it.

Enwiki has two gadgets (watchlist messages and geonotices) which adds a button enabling users to dismiss messages displayed there. Commonswiki has one gadget (called WatchlistMessages) which merges the functionality of both gadgets into one gadget (which allows the community to advertise particular events to a very narrow geographical audience). Other wikis probably have similar gadgets.

The template used by enwiki's gadget already exists in Wikidata but is not functional without the gadget (the dismiss button will not appear, even if the message is rendered in the watchlist).

Therefore I request the activation of such a gadget (probably the one from commons as it looks more advanced) in Wikidata. After a trial period we probably want to consider enabling it by default given that the code is already well tested in sister projects (where it is also enabled by default).

The move was discussed on wiki:


https://www.wikidata.org/wiki/Template_talk:Watchlist_summary#Changing_the_format_of_this_summary_to_use_{{Display/watchlist}}
https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2018/12#Watchlist_notices:_let_users_dismiss_these_notifications
https://www.wikidata.org/wiki/Wikidata:Project_chat/Archive/2018/11#Watchlist_UI_squalor


This move requires both the activation of one of these gadgets and also changes in the messages themselves. The migration to the relevant templates can be done first: although users will not be able to dismiss the messages, they will still expire by themselves after a set delay.TASK DETAILhttps://phabricator.wikimedia.org/T213012EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, dachary, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T205017: Investigation: Look at what gadgets it might make sense to pull into Wikibase

[Pintoch]

Pintoch added a comment.
Related:


T213012: Enable the Watchlist Messages gadget in Wikidata
TASK DETAILhttps://phabricator.wikimedia.org/T205017EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Addshore, Aklapper, Tarrow, Nandana, LJ, Lahi, Gq86, SandraF_WMF, Andrawaag, GoranSMilovanovic, QZanden, YULdigitalpreservation, dachary, Gstupp, LawExplorer, _jensen, Jneubert, D3r1ck01, Wikidata-bugs, aude, Daniel_Mietchen, Ricordisamoa, Lydia_Pintscher, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T213012: Enable the Watchlist Messages gadget in Wikidata

[Pintoch]

Pintoch added a comment.
Oh can they? Sorry I had no idea! Thanks, I will try to enable it myself.TASK DETAILhttps://phabricator.wikimedia.org/T213012EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Lydia_Pintscher, Pintoch, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, dachary, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T213012: Enable the Watchlist Messages gadget in Wikidata

[Pintoch]

Pintoch added a comment.
I have pinged a few interface admins on wiki to enable this.TASK DETAILhttps://phabricator.wikimedia.org/T213012EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Lydia_Pintscher, Pintoch, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, dachary, LawExplorer, _jensen, D3r1ck01, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T206392: Redesign rank icons for better visibility

[Pintoch]

Pintoch added a comment.
Useful solution from Nikki: add in your common.css:

/* from [[User:Nikki/common.css]] */

.wb-preferred { background-color: lavender }
.wb-deprecated { background-color: mistyrose }TASK DETAILhttps://phabricator.wikimedia.org/T206392EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Lydia_Pintscher, MichaelSchoenitzer, Aklapper, Nandana, A.S.Kochergin, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, JGirault, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T57755: Allow time values more precise than day

[Pintoch]

Pintoch added a comment.
I have updated the Wikibase data model docs, which incorrectly mentioned precisions of hours, minutes and seconds. I assume that they were there because they were part of an earlier design?TASK DETAILhttps://phabricator.wikimedia.org/T57755EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Abit, Magnus, Ramsey-WMF, Addshore, valerio.bozzolan, Sabas88, Sannita, Paucabot, MisterSynergy, Lea_Lacroix_WMDE, Realworldobject, Marsupium, robbi5, Andrei_Stroe, Jklamo, sladen, Liuxinyu970226, Esc3300, Edgars2007, ChristianKl, Saehrimnir, Jc3s5h, Mike_Peel, Thryduulf, Jobu0101, Laddo, Aklapper, MGChecker, Yair_rand, Apsdehal, Wikidata-bugs, Ricordisamoa, Lydia_Pintscher, Ltrlg, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T206392: Redesign rank icons for better visibility

[Pintoch]

Pintoch added a comment.


  What is the protocol to go forward on this? Should we hold a RFC on-wiki to 
let people choose among the possible solutions above?

TASK DETAIL
  https://phabricator.wikimedia.org/T206392

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Lydia_Pintscher, MichaelSchoenitzer, Aklapper, Nandana, 
A.S.Kochergin, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, 
JGirault, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T217239: Expose the graph of language fallbacks in an API

[Pintoch]

Pintoch added a subscriber: Mvolz.
Pintoch added a comment.


  > As a tool developer, it would be very useful to access the language 
fallback graph from an API.
  
  I would use the resulting graph in 
https://tools.wmflabs.org/openrefine-wikidata/ . This tool is basically a 
wrapper over the Wikibase API (and a bit of SPARQL) to comply with OpenRefine's 
reconciliation API. The tool can be configured to work in any language and 
would benefit from knowing about the language fallback graph to retrieve 
labels, descriptions and aliases. The current code that does that is here:
  
https://github.com/wetneb/openrefine-wikibase/blob/master/wdreconcile/language.py
  (it's a crude approximation, where every language falls back on English).
  I will let @Mvolz comment about her own use case.
  
  Concerning performance, of course this would be only retrieved quite rarely 
and cached on my side. So maybe a web API is overkill for that - but it would 
ideally be good to be able to download that structured graph from somewhere. It 
does not have to be served by the MediaWiki instance itself.

TASK DETAIL
  https://phabricator.wikimedia.org/T217239

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Mvolz, Anomie, Lucas_Werkmeister_WMDE, Pintoch, Aklapper, Nandana, Lahi, 
Gq86, Baloch007, GoranSMilovanovic, QZanden, LawExplorer, Sethakill, dg711, 
_jensen, MuhammadShuaib, LNDDYL, Psychoslave, Wikidata-bugs, aude, jayvdb, 
Arrbee, KartikMistry, Mbch331, Jay8g, Legoktm
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T217258: Language handling for adding citations with citoid in wikidata

[Pintoch]

Pintoch added a comment.


  If you need a mapping from ISO language codes to Wikimedia ones, 
Wikidata-Toolkit has such a mapping: 
https://github.com/Wikidata/Wikidata-Toolkit/blob/3e62f93b137c25961c5a12172c7f213a720ecb67/wdtk-datamodel/src/main/java/org/wikidata/wdtk/datamodel/interfaces/WikimediaLanguageCodes.java
  
  It might not be the most up to date mapping you can get though (I would be 
interested in updating it but I haven't investigated how to do that)

TASK DETAIL
  https://phabricator.wikimedia.org/T217258

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Mvolz, Pintoch
Cc: Pintoch, Aklapper, Mvolz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, Shangkuanlc, mobrovac, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T217768: The entity suggester should return properties

[Pintoch]

Pintoch created this task.
Pintoch added projects: Discovery-Search, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  The entity suggester only returns items, not properties. This is 
counter-intuitive as Special:Search returns both items and properties by 
default. For consistency, the entity suggester should include properties too 
(for instance, searching for P17 should return 
https://www.wikidata.org/wiki/Property:P17 as first result).
  
  As a user, when looking for a property, I usually go to a random item and 
pretend I want to add a statement there: this is the only way I can think of to 
get a property suggester. This does not feel very natural. Using Special:Search 
can work too of course, but because of the different way the data is indexed 
there, results can be quite different.

TASK DETAIL
  https://phabricator.wikimedia.org/T217768

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Aklapper, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, EBjune, LawExplorer, _jensen, rosalieper, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T218779: Exposed structured diffs in Wikibase API

[Pintoch]

Pintoch added a parent task: T56328: Provide intraline diff format in API 
action=compare.

TASK DETAIL
  https://phabricator.wikimedia.org/T218779

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T218779: Exposed structured diffs in Wikibase API

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikidata-Campsite.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  As an API user, I would like to be able to access diffs between revisions of 
items (or properties, lexemes). Currently, the API only exposes the HTML 
rendition of these diffs, via the `compare` action:
  https://www.wikidata.org/w/api.php?action=help&modules=compare
  
  It would be great to have a JSON representation of these diffs as well. 
Currently, I can parse the HTML to extract the information I need, but this is 
brittle as any change in diff rendering could potentially break my consumer.
  
  There is already a task T56328 <https://phabricator.wikimedia.org/T56328> 
about this in MediaWiki, but given that there is an even stronger case for this 
in Wikidata, I am creating a specific ticket for it. This could potentially be 
implemented by a dedicated API action given the different data format.
  
  I do not have a particular JSON format to propose: anything that is easy to 
produce by the underlying PHP implementation would be great to have.

TASK DETAIL
  https://phabricator.wikimedia.org/T218779

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T218779: Exposed structured diffs in Wikibase API

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T218779

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Retitled] T218779: Expose structured diffs in Wikibase API

[Pintoch]

Pintoch renamed this task from "Exposed structured diffs in Wikibase API" to 
"Expose structured diffs in Wikibase API".

TASK DETAIL
  https://phabricator.wikimedia.org/T218779

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, alaa_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Jonas, Wikidata-bugs, aude, 
Lydia_Pintscher, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T218779: Expose structured diffs in Wikibase API

[Pintoch]

Pintoch added a comment.


  @Lydia_Pintscher Sure! I have just deployed a demonstration of this use case 
on EditGroups <https://tools.wmflabs.org/editgroups/>.
  
  The goal is to index all Wikidata edit groups by the properties that they 
change (as statements or qualifiers, added or removed by the edit group). This 
can be useful to get an overview of the data imports that happened in a 
particular domain. For instance, the list of all edit groups using P50 (author) 
<https://tools.wmflabs.org/editgroups/?tags=prop-P50> gives you an overview of 
the ongoing author disambiguation effort in Wikicite.
  
  Some editing actions (such as `wbeditentity-create` or `wbeditentity-update`) 
allow users to perform big changes on items, and therefore do not expose the 
properties used in the edit summary. So, to make sure these edits are also 
indexed, we need to analyze their diffs. Hence the need for this API.
  
  One alternative would be to retrieve the JSON representation of the entities 
for all revisions involved and compute the diff manually, client-side. This is 
potentially more scalable as we could retrieve 25 diffs in one API call (25*2 
revisions). But implementing the diff logic is probably a bit more involved.
  
  Relevant code: 
  https://github.com/Wikidata/editgroups/blob/master/tagging/diffinspector.py

TASK DETAIL
  https://phabricator.wikimedia.org/T218779

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Lydia_Pintscher, Aklapper, Pintoch, alaa_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Jonas, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T236619: Workflow to create special properties and items at boot stage

[Pintoch]

Pintoch created this task.
Pintoch added a project: Wikibase-Containers.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.

TASK DESCRIPTION
  **Problem**
  
  Some components (either Wikibase itself or some extensions) rely on special 
properties or items which have a special behavior. For instance, Wikibase has a 
`$formatterUrlProperty` configuration variable which expects a PID. This 
property is then used to render values for external identifiers. The Quality 
Constraints extension relies on bazillions of special PIDs and QIDs to define 
the constraints. The OpenRefine reconciliation interface also relies on some 
(instance of, subclass of…).
  
  We need a workflow to set up these magic properties.
  
  **Currently**
  
  - Boot your Wikibase with Docker
  - Manually login as WikibaseAdmin and create the properties / items
  - Put the properties / ids of these entities in the various config files of 
the various components that require them
  - Reboot these.
  
  **Ideally**
  
  As the docker-compose config grows and integrates more services (such as the 
ones mentioned above), it will become quite inconvenient to create all these 
special entities manually. It seems hard to do this process completely 
automatically as part of the Docker boot process (since we can't really avoid 
restarting Wikibase after `formatterUrlProperty` has been set), but there could 
be a maintenance script that creates all these special entities and store their 
ids in a file that is accessible to all relevant Docker containers, which would 
then feed these ids into their own config files.

TASK DETAIL
  https://phabricator.wikimedia.org/T236619

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, Jelabra, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Asahiko, 
Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T236619: Workflow to create special properties and items at boot stage

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T236619

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Aklapper, Pintoch, darthmon_wmde, Jelabra, DannyS712, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Asahiko, 
Wikidata-bugs, aude, Addshore, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T220696: [Story] Create better edit summaries for wbeditentity API endpoint

[Pintoch]

Pintoch added a comment.


  Here is a diff where one of the new fallback summaries failed to be 
translated to a human-readable form: 
https://www.wikidata.org/w/index.php?title=Property:P571&diff=1040450905&oldid=1038877052

TASK DETAIL
  https://phabricator.wikimedia.org/T220696

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Lea_Lacroix_WMDE, NicoScribe, Rosalie_WMDE, alaa_wmde, 
Lucas_Werkmeister_WMDE, Lydia_Pintscher, Aklapper, Lea_WMDE, darthmon_wmde, 
DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Jonas, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension

[Pintoch]

Pintoch added a comment.


  Here are a few issues with the current tool:
  
  - If the tool goes down, this creates millions of dead links in edit 
summaries (which cannot be changed). Users who ran batches with the assumption 
that they could be undone if something goes wrong find themselves having to 
clean things up manually.
  - As a user, I can easily game EditGroups by imitating the edit summary of 
any tool, attributing edits to batches they are not actually part of (there are 
some protections against this, but they are not fully bullet-proof. For 
instance an edit will only be added to a batch if it was made under the account 
of the user who first created the batch)
  - Bot/tool authors are reluctant to add grouping support for their bots since 
EditGroups is not officially part of the Wikidata infrastructure. The community 
is unlikely to systematically enforce edit grouping in requests for bot 
approvals as long as it relies on an external tool, which does not come with 
any sustainability guarantees, SLA, etc.
  - Reverting relies on OAuth, and OAuth tokens can expire while a large edit 
group is being reverted.
  
  That being said, I am still not sure if all of EditGroups' functionality can 
reasonably be hoped to be supported in a MediaWiki extension directly: is it 
doable to have long-running tasks to undo a batch of edits? We do have 
Special:Nuke which deletes many pages at once, but this is done synchronously, 
the number of pages affected might be capped?

TASK DETAIL
  https://phabricator.wikimedia.org/T203557

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, 
Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, 
JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, 
Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension

[Pintoch]

Pintoch added a comment.


  Sure, I hope you don't mind us having this discussion here anyway, since this 
is still at a very early stage. (unless you are already planning to work on 
this exact architecture?)

TASK DETAIL
  https://phabricator.wikimedia.org/T203557

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, 
Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, 
JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, 
Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension

[Pintoch]

Pintoch added a comment.


  Great point! I did not think about that in this way. It sounds like a very 
sensible route to follow.

TASK DETAIL
  https://phabricator.wikimedia.org/T203557

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, 
Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, 
JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, 
Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T203557: Create a Edit group extension

[Pintoch]

Pintoch added a comment.


  I thought for a moment that there was an issue with the fact that at the 
moment, filtering by tags only works for Special:RecentChanges (which only 
contain the most recent changes, not all of them). But Lucas pointed out that 
it is also supported by Special:Contributions, which is uncapped in time. 
EditGroups currently assumes that all edits in a given group are made by the 
same user, which I think makes sense as a constraint. So, in the current 
situation, if you had an edit group which corresponded to a single tag, it 
would be possible to retrieve all edits in it via Special:Contributions 
(assuming you know the user in the first place).
  
  This suggests that an approach along the lines of what Lucas describes above 
is viable. Perhaps "sub-tags" should be attached to a parent user rather than a 
parent tag (or possibly both) given this observation.

TASK DETAIL
  https://phabricator.wikimedia.org/T203557

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Abit, Ramsey-WMF, Jony, Lydia_Pintscher, JeanFred, LucasWerkmeister, 
Pintoch, Framawiki, Aklapper, Bugreporter, darthmon_wmde, DannyS712, Nandana, 
JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, SandraF_WMF, 
GoranSMilovanovic, Jayprakash12345, QZanden, Tramullas, Acer, LawExplorer, 
Salgo60, Silverfish, _jensen, rosalieper, Susannaanas, Jane023, Wikidata-bugs, 
Base, matthiasmullie, aude, Dinoguy1000, Ricordisamoa, Wesalius, 
Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T220696: [Story] Create better edit summaries for wbeditentity API endpoint

[Pintoch]

Pintoch added a comment.


  Exciting developments! I am wondering if that `comment_data` could be (or 
already is) exposed in any public API? Exposing such diffs would also solve 
T106306 <https://phabricator.wikimedia.org/T106306> in the same go.
  
  As an API consumer I would have a great appetite for such diffs, for instance 
in the EditGroups <https://tools.wmflabs.org/editgroups/> tool (see 
T218779#5049167 <https://phabricator.wikimedia.org/T218779#5049167> for the 
motivation).

TASK DETAIL
  https://phabricator.wikimedia.org/T220696

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Jakob_WMDE, Addshore, rosalieper, Pintoch, Lea_Lacroix_WMDE, NicoScribe, 
Rosalie_WMDE, alaa_wmde, Lucas_Werkmeister_WMDE, Lydia_Pintscher, Aklapper, 
Lea_WMDE, darthmon_wmde, DannyS712, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, Scott_WUaS, Jonas, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T238003: Delete openrefine01 instance

[Pintoch]

Pintoch added a comment.


  Thanks! I am working on making OpenRefine easier to host, but it's a long 
term project indeed (exciting announcement about that soon).

TASK DETAIL
  https://phabricator.wikimedia.org/T238003

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Lucas_Werkmeister_WMDE, Aklapper, darthmon_wmde, DannyS712, 
Nandana, JKSTNK, Fheredia, Jony, Zylc, 1978Gage2001, Lahi, aborrero, Gq86, 
GoranSMilovanovic, Chicocvenancio, QZanden, Tbscho, LawExplorer, JJMC89, 
_jensen, rosalieper, Scott_WUaS, srodlund, Wikidata-bugs, Jitrixis, aude, 
Gryllida, Nikerabbit, scfc, Mbch331, Jay8g, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  Thanks for the notification! I would be happy to release a new version of 
OpenRefine with a patch applied - I can do this in the coming days. The 
exponential back-off suggested by @Multichill makes sense intuitively - could 
WMDE confirm that this is the policy they recommend? Happy to adapt the policy 
as required.

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Liridon, Bugreporter, Magnus, Tpt, Pintoch, Lydia_Pintscher, 
Matthias_Geisler_WMDE, Simon_Villeneuve, Lea_Lacroix_WMDE, Tarrow, alaa_wmde, 
Andrawaag, Multichill, Ladsgroup, Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, 
MisterSynergy, Addshore, Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, 
Hook696, Daryl-TTMG, RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, 
darthmon_wmde, Meekrab2012, joker88john, DannyS712, CucyNoiD, Nandana, 
NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, 
Cpaulf30, Lahi, Gq86, Af420, Darkminds3113, Bsandipan, Lordiis, 
GoranSMilovanovic, Adik2382, Chicocvenancio, Th3d3v1ls, Ramalepe, Liugev6, 
QZanden, EBjune, merbst, LawExplorer, WSH1906, Lewizho99, Volans, Maathavan, 
_jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, jkroll, Wikidata-bugs, 
Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  So this is what we get with an exponential back-off (1.5 factor), at the 
moment:
  
22:37:27.148 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 1000 milliseconds. (19338ms)
22:37:28.729 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 1500 milliseconds. (1581ms)
22:37:33.809 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 2250 milliseconds. (5080ms)
22:37:37.931 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 3375 milliseconds. (4122ms)
22:37:42.663 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 5062 milliseconds. (4732ms)
22:37:49.437 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 7593 milliseconds. (6774ms)
22:37:58.429 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
5.49167 seconds lagged. -- pausing for 11389 milliseconds. (8992ms)
22:38:18.217 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 6 
seconds lagged. -- pausing for 17083 milliseconds. (19788ms)
22:38:36.461 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 6 
seconds lagged. -- pausing for 25624 milliseconds. (18244ms)
22:39:05.013 [..baseapi.WbEditingAction] [maxlag] Waiting for all: 
6.46667 seconds lagged. -- pausing for 38436 milliseconds. (28552ms)
  
  So it looks like this means no OpenRefine edits at all with these new rules, 
in the current situation.

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, 
Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  One problem with the current policy (requesting all automated editing 
processes to use `maxlag=5`) is that this creates a binary threshold: either 
the query service lag is under the threshold, in which case bots will edit at 
full speed, or the query service lag is above the threshold, in which case they 
should all stop editing entirely. This is likely to create an oscillating 
behaviour, where all bots start and stop periodically. This is probably not 
ideal neither for the infrastructure nor for the users.
  
  Not all automated edits are long-running tasks where stopping for an hour is 
acceptable: many QuickStatements or OpenRefine batches are under 10 edits for 
instance. As a user of these tools, I would expect them to slow down when lag 
is high, but stopping entirely should be extremely rare, as it breaks workflows.
  
  I think it would be preferable to get a continuous throttling behaviour: the 
higher the lag, the slower the edits.
  This can already be achieved by clients by using a small maxlag parameter and 
increasing it gradually as they retry. For instance, start with maxlag=2, which 
fails, retry in 1 sec with maxlag=3, which fails, retry in 4 seconds with 
maxlag=4, which fails, retry in 8 seconds with maxlag=5, which fails, retry in 
16 seconds with maxlag=6, which succeeds.
  
  Would such a behaviour be acceptable?

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, 
Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  Actually, some tools seem to be doing something like that already, since 
edits are still going through despite max lag being above 5 for more than an 
hour now (Author Disambiguator does this, QuickStatements too probably, 
Edoderoobot too). So these tools use higher (more agressive) maxlag values than 
5.
  
  I will therefore follow their example and publish a new version of OpenRefine 
which does that. It might be worth updating the official recommendations about 
this: if the rule is never to set maxlag higher than 5, then it looks like not 
many are actually following it…

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, 
Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T221774: Add Wikidata query service lag to Wikidata maxlag

[Pintoch]

Pintoch added a comment.


  OK! If you have ways to check what sort of maxlag values are used it would be 
great!
  
  I will try to implement a responsible throttling strategy in OpenRefine, 
hoping that others will do the same.

TASK DETAIL
  https://phabricator.wikimedia.org/T221774

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Pintoch
Cc: Envlh, Gstupp, Sebotic, Tagishsimon, Liridon, Bugreporter, Magnus, Tpt, 
Pintoch, Lydia_Pintscher, Matthias_Geisler_WMDE, Simon_Villeneuve, 
Lea_Lacroix_WMDE, Tarrow, alaa_wmde, Andrawaag, Multichill, Ladsgroup, 
Smalyshev, fgiunchedi, hoo, Daniel_Mietchen, MisterSynergy, Addshore, 
Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, Hook696, Daryl-TTMG, 
RomaAmorRoma, 0010318400, E.S.A-Sheild, Iflorez, darthmon_wmde, Meekrab2012, 
joker88john, DannyS712, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, 
Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Af420, 
Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Chicocvenancio, 
Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, WSH1906, 
Lewizho99, Volans, Maathavan, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T193875: Improving Wikidata reconciliation in OpenRefine

[Pintoch]

Pintoch closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T193875EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: DarTar, Spinster, PeterTheOne, Lucas_Werkmeister_WMDE, Tpt, Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Culex, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Closed] T194952: Introducing the EditGroups tool

[Pintoch]

Pintoch closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T194952EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Rfarrand, bcampbell, Halfak, Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Culex, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195258: [weird] Wikidata SPARQL query results not the same when exported

[Pintoch]

Pintoch added a comment.
I have observed this bug multiple times now (also using Firefox).TASK DETAILhttps://phabricator.wikimedia.org/T195258EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, hoo, Seb35, abian, Lucas_Werkmeister_WMDE, VIGNERON, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T195615: handle use of statements linking to Lexemes (and Forms?) more gracefully on client

[Pintoch]

Pintoch added a comment.
Just noting that this prevents us from adding examples on lexeme-related properties, such as https://www.wikidata.org/wiki/Property:P5244.TASK DETAILhttps://phabricator.wikimedia.org/T195615EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, PintochCc: Pintoch, Stashbot, gerritbot, WMDE-leszek, Tractopelle-jaune, Addshore, Aklapper, Lydia_Pintscher, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T197587: Add WikibaseQualityConstraints to the docker image

[Pintoch]

Pintoch created this task.Pintoch added a project: Wikibase-Containers.Herald added a subscriber: Aklapper.Herald added a project: Wikidata.
TASK DESCRIPTIONIt would be fabulous if we could just say "yes I want quality constraints in my own wikibase" and automatically populate the instance with all the necessary items and properties to define the constraints.TASK DETAILhttps://phabricator.wikimedia.org/T197587EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Aklapper, Pintoch, Lahi, Gq86, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Abbe98, Wikidata-bugs, aude, Addshore, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances

[Pintoch]

Pintoch created this task.Pintoch added a project: Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONBackground: we want to make it possible for OpenRefine users to upload statements to arbitrary Wikibase instances.
Idea: the user should be able to specify which instance they want to push to just with a single URI. That URI should contain a "manifest" file which would describe everything we need to know about this instance (such as: URL of the MediaWiki API, query service, and so on).

We have drafted the necessary information as far as OpenRefine is concerned:
https://etherpad.wikimedia.org/p/wm_modelling_Wikibase
Of course the idea is that manifest file could also be consumed by other tools which could be adapted to various Wikibase instances - so there might be other sensible things to add there.

We need input about:


the format and typical URI of that file?
which information to include (what is redundant, what did we forget, …)?
TASK DETAILhttps://phabricator.wikimedia.org/T197588EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T197587: Add WikibaseQualityConstraints to the docker image

[Pintoch]

Pintoch added a project: Wikibase-Quality-Constraints.
TASK DETAILhttps://phabricator.wikimedia.org/T197587EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Aklapper, Pintoch, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, Gstupp, LawExplorer, Abbe98, Agabi10, Wikidata-bugs, aude, Addshore, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances

[Pintoch]

Pintoch added a comment.
A sample of what such a manifest could look like is here:
https://gist.github.com/despens/d6ae4110c4e97944ddba29f23d78899f
It could be served at a predictable location for each wikibase instance - such as, for instance, 
https://www.wikidata.org/manifest-v0.1.json
or something similarTASK DETAILhttps://phabricator.wikimedia.org/T197588EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T197588: Agree on a "manifest" format to expose the configuration of Wikibase instances

[Pintoch]

Pintoch added a comment.
One other approach to this problem would be to consider that these manifest files are not expected to be necessarily hosted by the Wikibase instance itself - these configuration files could be user-contributed and hosted anywhere (or derived automatically from the Wikibase Registry). The downside is that this requires more work from the community (users need to maintain these manifest files themselves) but it could be necessary if we want to include things like URLs of external tools like QuickStatements.TASK DETAILhttps://phabricator.wikimedia.org/T197588EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193728: Solve legal uncertainty of Wikidata

[Pintoch]

Pintoch added a comment.
Etalab (who runs the open data portal of the French government) have released a statement (in French) concerning the attribution requirement of their "licence ouverte", confirming that it only applies to the first re-user.
https://github.com/etalab/wiki-data-gouv#point-juridique

Therefore it is possible for a license to require attribution and still be fully compatible with Wikidata. So we should really stop asserting that we can only import CC0 data in Wikidata, I think.TASK DETAILhttps://phabricator.wikimedia.org/T193728EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Aklapper, Huji, ArthurPSmith, SimonPoole, Scott_WorldUnivAndSch, Micru, lisong, Lofhi, Nemo_bis, TomT0m, jrbs, EgonWillighagen, sarojdhakal, Agabi10, NMaia, Simon_Villeneuve, Jarekt, Rspeer, OhKayeSierra, AndrewSu, Mateusz_Konieczny, Maxlath, Glrx, Realworldobject, Ltrlg, Papapep, Tgr, Ayack, Gnom1, MichaelMaggs, MisterSynergy, Pasleim, Cirdan, 0x010C, Sylvain_WMFr, Denny, Ivanhercaz, Pintoch, Lydia_Pintscher, Lea_Lacroix_WMDE, Psychoslave, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, ZhouZ, Mpaulson, Wikidata-bugs, aude, jayvdb, Slaporte, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T249680: Wikidata password login via MediaWiki API fails

[Pintoch]

Pintoch created this task.
Pintoch added projects: Wikidata, OpenRefine.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  Over the past 48 hours, there seems to have been a change in the behaviour of 
MediaWiki login API for Wikidata. This causes all logins from Wikidata-Toolkit 
(Java library) to fail. Among others, this affects OpenRefine users.
  
  To reproduce:
  
  - Fetch a login token with 
https://www.wikidata.org/w/api.php?action=query&meta=tokens&type=login&format=json
  - Perform a POST query to login using this token and valid credentials:
  
curl -X POST "https://www.wikidata.org/w/api.php"; -d 
"action=login&lgname=MY_USERNAME&lgpassword=MY_PASSWORD&lgtoken=MY_TOKEN&format=json"
  
  which gives the following response:
  
{
  "warnings": {
"main": {
  "*": "Subscribe to the mediawiki-api-announce mailing list at 
<https://lists.wikimedia.org/mailman/listinfo/mediawiki-api-announce> for 
notice of API deprecations and breaking changes. Use 
[[Special:ApiFeatureUsage]] to see usage of deprecated features by your 
application."
},
"login": {
  "*": "Fetching a token via \"action=login\" is deprecated. Use 
\"action=query&meta=tokens&type=login\" instead."
}
  },
  "login": {
"result": "NeedToken",
"token": "dda68bc218a252765816dca9570ec6755e8d6462+\\"
  }
}
  
  This bug can be observed for existing releases of Wikidata-Toolkit (and 
therefore OpenRefine), so this issue cannot come from a client-side change. One 
can observe that no data imports have been made through OpenRefine for about 48 
hours: https://tools.wmflabs.org/editgroups/?tool=OR
  
  This seems to depend on subtle details of cookie handling according to this 
pull request <https://github.com/Wikidata/Wikidata-Toolkit/pull/490>.
  While we can of course fix things on Wikidata-Toolkit's side, it would be 
great if the change on Wikidata's side could be reverted at least temporarily, 
since fixing this on our side requires making new releases of Wikidata-Toolkit 
and OpenRefine.
  
  OR issue: https://github.com/OpenRefine/OpenRefine/issues/2526

TASK DETAIL
  https://phabricator.wikimedia.org/T249680

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Nikerabbit, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T249680: Wikidata password login via MediaWiki API fails

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T249680

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Nikerabbit, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T249680: Wikidata password login via MediaWiki API fails

[Pintoch]

Pintoch added a comment.


  So, if we can track down which MediaWiki commit started to introduce 
"set-cookie" headers (instead of "Set-Cookie"), we could hopefully submit a 
patch to capitalize it.
  
  The root of the problem lies in the fact that Wikidata-Toolkit uses a very 
low-level Java API to make HTTP requests 
<https://github.com/Wikidata/Wikidata-Toolkit/issues/492>, which is therefore 
quite brittle.

TASK DETAIL
  https://phabricator.wikimedia.org/T249680

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Nikerabbit, Mbch331
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T249680: Wikidata password login via MediaWiki API fails

[Pintoch]

Pintoch updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T249680

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, WDoranWMF, holger.knust, 
EvanProdromou, DannyS712, Nandana, Amorymeltzer, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, Sethakill, dg711, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Pchelolo, Wikidata-bugs, aude, jayvdb, Anomie, Nikerabbit, Mbch331, 
Rxy, Legoktm
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T249680: Wikidata password login via MediaWiki API fails

[Pintoch]

Pintoch added a comment.


  It appears from  T249526 <https://phabricator.wikimedia.org/T249526> that 
this is caused by https://gerrit.wikimedia.org/r/586448

TASK DETAIL
  https://phabricator.wikimedia.org/T249680

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Afkbrb, Pintoch, Aklapper, darthmon_wmde, WDoranWMF, holger.knust, 
EvanProdromou, DannyS712, Nandana, Amorymeltzer, Lahi, Gq86, GoranSMilovanovic, 
QZanden, LawExplorer, Sethakill, dg711, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Pchelolo, Wikidata-bugs, aude, jayvdb, Anomie, Nikerabbit, Mbch331, 
Rxy, Legoktm
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Unassigned] T207839: Batch add WO II war memorials to Wikidata

[Pintoch]

Pintoch removed Pintoch as the assignee of this task.
Pintoch added a comment.


  (just removing myself as assignee as I am not expected to work on this task, 
I was just available to help during the event)

TASK DETAIL
  https://phabricator.wikimedia.org/T207839

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Ecritures, Jane023, Multichill, Footech, Elvalente, Pintoch, RonnieV, 
SIryn, MxLucy, Dat_doris, Phofx, darthmon_wmde, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Nikerabbit, Mbch331, Ainali
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached

[Pintoch]

Pintoch added a comment.


  Thanks a lot @Lydia_Pintscher !
  
  I have also used this opportunity to optimize the service and deploy it with 
ASGI, which Toolforge does not support as far as I know. Perhaps this is an 
indication that this should rather be a Cloud VPS project, where we would be 
more in control of the deployment. But this would still live behind an HTTPS 
proxy. At the moment my priority is to make sure there is one reliable instance 
out there, where I can fix any issue directly.

TASK DETAIL
  https://phabricator.wikimedia.org/T257405

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Pintoch
Cc: Lydia_Pintscher, Nemo_bis, Nintendofan885, bd808, Pintoch, Aklapper, 
Akuckartz, darthmon_wmde, Nandana, skpuneethumar, Zylc, Bstorm, 1978Gage2001, 
Lahi, Gq86, GoranSMilovanovic, DSquirrelGM, Chicocvenancio, QZanden, Tbscho, 
Freddy2001, LawExplorer, JJMC89, _jensen, rosalieper, Scott_WUaS, Luke081515, 
Wikidata-bugs, Jitrixis, aude, Gryllida, jayvdb, Nikerabbit, scfc, coren, 
Mbch331, Krenair
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T186945: Message welcome bots at local wikis trigger due to edits at Wikidata

[Pintoch]

Pintoch added a comment.
this bug seems to be fairly new, it has probably been introduced by a recent code change. I have just run into it and it is definitely a new behavior.TASK DETAILhttps://phabricator.wikimedia.org/T186945EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, A2093064, Aklapper, Billinghurst, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T191963: New constraint: properties with identical values

[Pintoch]

Pintoch created this task.Pintoch added projects: Wikibase-Quality-Constraints, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONSome Wikidata properties are expected to hold the same values when they are both present on the same item. This is the case for P4285 and P269 for instance (see https://www.wikidata.org/wiki/Q334065#P4285 and https://www.wikidata.org/wiki/Q334065#P269 for an example). These two properties are used to link to different databases which use a shared identifier.

The question of whether this is the desired way to link to two databases which share a common identifier is still being debated (see https://www.wikidata.org/wiki/Wikidata:Property_proposal/Directory_of_Open_Access_Journals_ID and https://www.wikidata.org/wiki/Wikidata:Property_proposal/Plants_of_the_World_online for instance).

The issue with this approach is that it creates some redundancy. One possible way to help with that redundancy would be to have a constraint that would enforce equality of these values on a given item. This constraint would be useful for existing properties which have this redundancy issue and potentially for others if we decide to use this solution in other cases.TASK DETAILhttps://phabricator.wikimedia.org/T191963EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Edited] T191963: New constraint: properties with identical values

[Pintoch]

Pintoch updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTIONSome Wikidata properties are expected to hold the same values when they are both present on the same item. This is the case for https://www.wikidata.org/wiki/Property:P4285 and https://www.wikidata.org/wiki/Property:P269 for instance (see https://www.wikidata.org/wiki/Q334065#P4285 and https://www.wikidata.org/wiki/Q334065#P269 for an example). These two properties are used to link to different databases which use a shared identifierTASK DETAILhttps://phabricator.wikimedia.org/T191963EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Created] T193875: Improving Wikidata reconciliation in OpenRefine

[Pintoch]

Pintoch created this task.Pintoch added projects: Wikimedia-Hackathon-2018, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONCome to complain about anything you do not like about the process of matching data to Wikidata with OpenRefine!

This aspect of OpenRefine is suitable for quick incremental improvements. I will help people get more familiar with the code base if needed.

Example of relevant issues:

https://github.com/OpenRefine/OpenRefine/issues?q=is:issue+is:open+label:reconciliation
https://github.com/wetneb/openrefine-wikidata/issuesTASK DETAILhttps://phabricator.wikimedia.org/T193875WORKBOARDhttps://phabricator.wikimedia.org/project/board/3260/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Culex, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193728: Solve legal uncertainty of Wikidata

[Pintoch]

Pintoch added a comment.
I think there are plenty of examples of non-CC0 data being imported in Wikidata.

PubMedCentral is being imported at a large scale and as far as I can tell it is not CC0 (at least https://europepmc.org/Copyright does not make that clear. It focuses on the full texts, which we don't import, but I guess the metadata could also be protected?). I don't want to point fingers at all - I think this import is completely fine, but I would be interested if this general impression that "it's fine" can be grounded legally.

Example of an item imported from there: https://www.wikidata.org/wiki/Q46524969

Another example (where I am involved): the French national registry of research structures (RNSR).
Example of item: https://www.wikidata.org/wiki/Q30261396
Source dataset: https://www.data.gouv.fr/fr/datasets/repertoire-national-des-structures-de-recherche-rnsr/ (released under a custom "open license", which looks similar to CC-BY).TASK DETAILhttps://phabricator.wikimedia.org/T193728EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Karima, Sylvain_WMFr, Denny, Ivanhercaz, Pintoch, Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper, Psychoslave, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, ZhouZ, Mpaulson, Wikidata-bugs, aude, jayvdb, Slaporte, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193728: Solve legal uncertainty of Wikidata

[Pintoch]

Pintoch added a comment.
The import was discussed at various places, including at the data import hub, the property talk page and my talk page.TASK DETAILhttps://phabricator.wikimedia.org/T193728EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Karima, Sylvain_WMFr, Denny, Ivanhercaz, Pintoch, Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper, Psychoslave, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, ZhouZ, Mpaulson, Wikidata-bugs, aude, jayvdb, Slaporte, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T193728: Solve legal uncertainty of Wikidata

[Pintoch]

Pintoch added a comment.
I am glad I got the discussion going then: you now have one concrete example to look at (or maybe two? you did not comment on PMC).  I think it is fair to say that this is not exactly an isolated case (but I am surprised that you seem to (pretend) not to know? Maybe for legal reasons?) How do you think these problematic uploads should be treated? If there a drift between the practices of the community and the rules of the project, that problem should be solved.

My impression is that the references I added on these statements fulfill the attribution requirement of the license (or at least the spirit of it). But I am not a lawyer. The curators of the database are aware of the import and seem quite happy with it. In general I think many open data producers do not expect that requiring attribution would be a significant hurdle for reuse. (In this particular case, they were aware of Wikidata before - they actually have a bunch of Qids in their dataset.)TASK DETAILhttps://phabricator.wikimedia.org/T193728EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Sylvain_WMFr, Denny, Ivanhercaz, Pintoch, Lydia_Pintscher, Lea_Lacroix_WMDE, Aklapper, Psychoslave, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, ZhouZ, Mpaulson, Wikidata-bugs, aude, jayvdb, Slaporte, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T191963: New constraint: properties with identical values

[Pintoch]

Pintoch added a comment.
Both properties mentioned above have been created in the mean time:


https://www.wikidata.org/wiki/Property:P5037
https://www.wikidata.org/wiki/Property:P5115


So this constraint could be useful, I think.TASK DETAILhttps://phabricator.wikimedia.org/T191963EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: abian, Hsarrazin, Pigsonthewing, Liuxinyu970226, Pintoch, Aklapper, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, LawExplorer, Agabi10, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T191885: Reflect atomic changes in wbeditentity summary

[Pintoch]

Pintoch added a comment.
It would be fantastic to have more meaningful edit summaries with wbeditentity. It's of course hard to do this in general, but it would be great to have this for some common cases where a short summary seems doable (adding multiple statements with the same property, for instance).TASK DETAILhttps://phabricator.wikimedia.org/T191885EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, Jakob_WMDE, Addshore, WMDE-leszek, Pablo-WMDE, Aklapper, Lydia_Pintscher, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Updated] T194194: Add possibility to check constraints on unsaved statements

[Pintoch]

Pintoch added a comment.
As soon as this is supported by the Wikibase API, then it makes sense to build support for this directly in Wikidata-Toolkit. This is something that would be massively useful for many people.

As for OpenRefine, we need to brainstorm a bit to find when exactly these calls should be made. Currently, constraint validation is run on the entire batch every time a change is made. There could be two sorts of constraints checks: the ones we run in real time because they are cheap, and the ones we perform just before the edits are made… but then they would need to be reported in a different way?

So it's not just a backend issue, we also need to understand how this will be presented to the user.

Other random thoughts:


for some constraints (such as inverse constraints) we need to look at the entire edit batch, not just an individual statement change, to detect if a violation will be triggered (so caching stuff is tricky)
we can probably make some assumptions about the batches (for instance, assume that an edit batch will not make any chances to the P279 type hierarchy of the types involved in its constraints)
I'm not familiar with the testing infrastructure for Wikidata. On OpenRefine, everything is pretty much hardcoded to use wikidata.org and not test.wikidata.org. Moving to another instance would require cleaning that up (and this must be done for the openrefine-wikidata reconciliation service first…) On the long term, OpenRefine should just have a Wikibase extension and be agnostic to the instance, but we are quite far from that.
TASK DETAILhttps://phabricator.wikimedia.org/T194194EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Agabi10, Pasleim, Lucas_Werkmeister_WMDE, Pintoch, Aklapper, Lahi, Gq86, GoranSMilovanovic, lisong, QZanden, LawExplorer, Culex, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs