[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-16 Thread VladimirAlexiev
VladimirAlexiev added a subscriber: Lucas.
VladimirAlexiev added a comment.


  @Lucas, congratulations on your command line wizardry! I know "jq" but not
  nearly to that extent, and I how did I not know about "units"?

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: VladimirAlexiev
Cc: Lucas, Lucas_Werkmeister_WMDE, So9q, VladimirAlexiev, CamelCaseNick, 
Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, 
QZanden, EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.


  Then I think I misunderstood your question? We certainly don’t have 155 
million violations “of a certain kind”. I’m guessing most reports that users 
would want would be much smaller; on Wikidata:Database reports/Constraint 
violations/Summary 
,
 the highest “real” number of violations (split by property and constraint 
type) is 1993092, a bit under two million. 
(`[...document.querySelectorAll('tbody td:nth-child(n+3):not(:empty)')].map(n 
=> parseInt(n.textContent.trim())).filter(Number.isFinite).sort((a, b) => a - 
b).slice(-10)`; the top two numbers are “one of” constraints that are 
deprecated, i.e. they’re really just meant for suggestions, so I’m not counting 
them here.)

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, So9q, VladimirAlexiev, CamelCaseNick, 
Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, 
QZanden, EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Addshore
Addshore added a comment.


  In T201150#7355393 , 
@Lucas_Werkmeister_WMDE wrote:
  
  > That would suggest some 155 million constraint violations in total (almost 
all of them on items):
  >
  >   $ units -t '((853 + 806 + 811) * 94504342 / 1500) + (2987 * 9166 / 500) + 
(187 * 578263 / 500)' 'million'
  >   155.88818
  
  In that case it sounds like `a SPARQL query should return all violations of a 
certain kind` is probably not a realistic goal and we want something other than 
a SPARQL query for such a report.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: Lucas_Werkmeister_WMDE, So9q, VladimirAlexiev, CamelCaseNick, 
Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, 
QZanden, EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.


  > Do you have a picture of how many violations, and violations split by type 
/ kind exist on Wikidata at any given time?
  
  Looks like we’re averaging about 1⅔ constraint violations per item (excluding 
redirects, if I’m not mistaken):
  
$ curl -s 
'https://www.wikidata.org/w/api.php?action=query&list=random&rnnamespace=0&rnlimit=500&format=json&formatversion=2'
 | jq -r '.query.random | .[] | .title' | while IFS= read -r id; do curl -s 
"https://www.wikidata.org/w/api.php?action=wbcheckconstraints&id=$id&format=json&formatversion=2";
 | jq -c '.. | .results? | select(length > 0) | .[] | 1'; done | wc -l  



  
853
$ curl -s 
'https://www.wikidata.org/w/api.php?action=query&list=random&rnnamespace=0&rnlimit=500&format=json&formatversion=2'
 | jq -r '.query.random | .[] | .title' | while IFS= read -r id; do curl -s 
"https://www.wikidata.org/w/api.php?action=wbcheckconstraints&id=$id&format=json&formatversion=2";
 | jq -c '.. | .results? | select(length > 0) | .[] | 1'; done | wc -l
806
$ curl -s 
'https://www.wikidata.org/w/api.php?action=query&list=random&rnnamespace=0&rnlimit=500&format=json&formatversion=2'
 | jq -r '.query.random | .[] | .title' | while IFS= read -r id; do curl -s 
"https://www.wikidata.org/w/api.php?action=wbcheckconstraints&id=$id&format=json&formatversion=2";
 | jq -c '.. | .results? | select(length > 0) | .[] | 1'; done | wc -l
811
$ units -t '(853 + 806 + 811) / 1500'
1.647
  
  Properties have substantially more:
  
$ curl -s 
'https://www.wikidata.org/w/api.php?action=query&list=random&rnnamespace=120&rnlimit=500&format=json&formatversion=2'
 | jq -r '.query.random | .[] | .title' | while IFS= read -r title; do curl -s 
"https://www.wikidata.org/w/api.php?action=wbcheckconstraints&id=${title#*:}&format=json&formatversion=2";
 | jq -c '
.. | .results? | select(length > 0) | .[] | 1'; done | wc -l
2987
$ units -t '2987 / 500'
5.974
  
  Lexemes less:
  
$ curl -s 
'https://www.wikidata.org/w/api.php?action=query&list=random&rnnamespace=146&rnlimit=500&format=json&formatversion=2'
 | jq -r '.query.random | .[] | .title' | while IFS= read -r title; do curl -s 
"https://www.wikidata.org/w/api.php?action=wbcheckconstraints&id=${title#*:}&format=json&formatversion=2";
 | jq -c '.. | .results? | select(length > 0) | .[] | 1'; done | wc -l
187
$ units -t '187 / 500'
0.374
  
  That would suggest some 155 million constraint violations in total (almost 
all of them on items):
  
$ units -t '((853 + 806 + 811) * 94504342 / 1500) + (2987 * 9166 / 500) + 
(187 * 578263 / 500)' 'million'
155.88818

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, So9q, VladimirAlexiev, CamelCaseNick, 
Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, MPhamWMF, maantietaja, 
CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, GoranSMilovanovic, 
QZanden, EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, 
Scott_WUaS, Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, 
Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-14 Thread Addshore
Addshore added a comment.


  Do you have a picture of how many violations, and violations split by type / 
kind exist on Wikidata at any given time?
  
  > periodic processing of every item because constraint definitions or 
implementations can change globally (TODO?)
  
  Approaching this one is still an open question currently.
  We could probably gather some data for this by looking at the distribution of 
latest edit times for all Item to see how much work this would actually be.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-14 Thread VladimirAlexiev
VladimirAlexiev added a comment.


  Here's the goal: a SPARQL query should return **all** violations of a certain 
kind, with a possible data lag of a few hours.
  So you need:
  
  - a baseline of having processed **all** items (TODO)
  - processing of changed items (DONE)
  - periodic processing of every item because constraint definitions or 
implementations can change globally (TODO?)
  
  DBpedia Live uses a similar flow:
  
  - each save of a Wikipedia page causes a work item to be posted to a queue
  - but all remaining pages are also scheduled to be processed (with lower 
priority) to capture slow-changes to:
- the Extraction Framework or
- the DBpedia Mappings

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: VladimirAlexiev
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-14 Thread Addshore
Addshore added a comment.


  It sounds like we need a definition of `regularly`!

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-14 Thread Addshore
Addshore removed Addshore as the assignee of this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-13 Thread Lydia_Pintscher
Lydia_Pintscher closed subtask T290635: Evaluate whether WMDE can take over our 
essential community run constraints bot as "Declined".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Lydia_Pintscher
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread Bugreporter
Bugreporter closed subtask T290641: tweak SPARQL queries that expose constraint 
violations as "Invalid".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, Bugreporter
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread VladimirAlexiev
VladimirAlexiev added a subtask: T290641: tweak SPARQL queries that expose 
constraint violations.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, VladimirAlexiev
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread VladimirAlexiev
VladimirAlexiev reopened this task as "Open".
VladimirAlexiev added a comment.


  > @Addshore Resolved T204031  on 
11 Aug: "Deploy **regular running** of wikidata constraint checks using the job 
queue: These now run after **every edit**"
  
  In addition to "after every edit", I think "regular" means that **periodic 
running** should also be scheduled.
  
  Eg I'm now cleaning up Crunchbase IDs that were inserted over many years (and 
a big batch a couple months ago).
  
  - go to https://www.wikidata.org/wiki/Property_talk:P2088 and run one of the 
"SPARQL (new)" queries (a better version of one of them is shown at 
https://www.wikidata.org/wiki/User_talk:Ivan_A._Krestinin#KrBot_stuck%3F_%28Wikidata%3ADatabase_reports%2FConstraint_violations%2FP2088%29):
 you only get a few violations
  - now check out 
https://www.wikidata.org/wiki/Wikidata:Database_reports/Constraint_violations/P2088:
 you see several thousand violations. This task will be done when all of them 
are available from SPARQL
  
  I'm reopening this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, VladimirAlexiev
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread So9q
So9q added a subtask: T290635: Evaluate whether WMF operations can take over 
our essential community run constraints bot.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, So9q
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread So9q
So9q added a comment.


  In T201150#7341220 , 
@VladimirAlexiev wrote:
  
  > 
  
  
  
  > 2. WMD should take over the operation of KrBot (that generates Constraint 
Violation pages) because it now takes huge resources ("Now the bot requires 106 
GB of memory to load and process all data") and Ivan Krestinin cannot cope. See 
discussion at User_talk:Ivan_A._Krestinin 

 and at Telegram 
  
  I created a task for this: https://phabricator.wikimedia.org/T290635

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, So9q
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread So9q
So9q added a comment.


  In T201150#7341220 , 
@VladimirAlexiev wrote:
  
  > Can I make two related requests? Not sure how to post them as separate 
tasks related to this task, can someone from WMD do that?
  
  You can create a new task. After saving click "edit related tasks" and add 
this one as parent :)

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, So9q
Cc: So9q, VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, 
Aklapper, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-09 Thread VladimirAlexiev
VladimirAlexiev added a comment.


  Can I make two related requests? Not sure how to post them as separate tasks 
related to this task, can someone from WMD do that?
  
  1. Change the query to return the offending value rather than the offending 
statement; which is more useful to eg generate a QS script to remove offending 
values. Eg for `P2088` Distinct Values, change SPARQL (new) 

 to this:
  
SELECT DISTINCT ?item ?itemLabel ?value WHERE {
?statement wikibase:hasViolationForConstraint 
wds:P2088-DD4CDCEA-B3F6-4F02-9CFB-4A9E312B73A8 .
?item p:P2088 ?statement .
?statement ps:P2088 ?value.
SERVICE wikibase:label { bd:serviceParam wikibase:language "en" } .
}
  
  
  
  2. WMD should take over the operation of KrBot (that generates Constraint 
Violation pages) because it now takes huge resources and Ivan Krestinin cannot 
cope. See discussion at User_talk:Ivan_A._Krestinin 

 and at Telegram 

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore, VladimirAlexiev
Cc: VladimirAlexiev, CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, 
Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, 
Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, 
Esc3300, merbst, LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, 
Xmlizer, abian, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, 
Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-08-11 Thread Addshore
Addshore changed the status of subtask T201147: Expose constraint violations to 
WDQS using event queue from "Stalled" to "Open".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Esc3300, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-08-11 Thread Addshore
Addshore closed this task as "Resolved".
Addshore claimed this task.
Addshore added a comment.
Restricted Application added a project: User-Addshore.


  These now run after every edit

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Esc3300, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-08-11 Thread Addshore
Addshore closed subtask T204031: Deploy regular running of wikidata constraint 
checks using the job queue as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Esc3300, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-08-09 Thread Ladsgroup
Ladsgroup changed the status of subtask T204031: Deploy regular running of 
wikidata constraint checks using the job queue from "Stalled" to 
"Open".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Ladsgroup
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Esc3300, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-07-27 Thread Michael
Michael changed the status of subtask T204031: Deploy regular running of 
wikidata constraint checks using the job queue from "Open" to 
"Stalled".

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Esc3300, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org


[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-04-22 Thread Addshore
Addshore removed a project: Wikidata-Campsite.

TASK DETAIL
  https://phabricator.wikimedia.org/T201150

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Addshore
Cc: CamelCaseNick, Harmonia_Amanda, Addshore, Jonas, Aklapper, Invadibot, 
MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86, 
Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, 
LawExplorer, _jensen, rosalieper, Agabi10, Scott_WUaS, Xmlizer, abian, jkroll, 
Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, Lydia_Pintscher
___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs