[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2018-07-30 Thread Smalyshev
Smalyshev added a comment.
See: https://www.mediawiki.org/wiki/Wikibase/Indexing/RDF_Dump_Format#Constraints (currently enabled only for internal cluster, soon on public one too).TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Agabi10, Jonas, Lucas_Werkmeister_WMDE, Smalyshev, Esc3300, Aklapper, PokestarFan, MisterSynergy, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Avner, Gehel, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-04 Thread Jonas
Jonas added a comment.
Yes, according to last weeks stats execution time of each individual(!) check can take up to 8 seconds.
I am afraid we can not run checks within a query.

The feature itself sounds very useful to me!
Maybe we can store the results of checks that were executed somewhere, so they could be queried afterwards.TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Jonas, Lucas_Werkmeister_WMDE, Smalyshev, Esc3300, Aklapper, PokestarFan, MisterSynergy, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-04 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.
@Smalyshev I don’t think the lack of grouping support in MWAPI is a big problem here – constraint checks are just expensive at the moment, so I expect such queries would take a long time regardless of whether the actual API requests are grouped or not.TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Smalyshev, Esc3300, Aklapper, PokestarFan, MisterSynergy, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-03 Thread Smalyshev
Smalyshev added a comment.
If there is a Mediawiki API that checks constraints, that would be the best way to integrate - we just add it to supported APIs and use it. Note however MWAPI gate right now can not group queries, i.e. if it is used with results of other patters, it would do query per item. Thus, we have three ways to work on it:


Have query "all french painters" and then check each for constraint violation (may be slow)
Have API "all single-value constraint violations" and then apply "french painter" filter to it. Again, may be slow if there's a lot of constraint violations.
Wait until I implement grouping for service and have API that allows several IDs to be specified for constraint violation checks.
TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Esc3300, Aklapper, PokestarFan, MisterSynergy, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-03 Thread MisterSynergy
MisterSynergy added a comment.
I thought of a new SERVICE as well, but I actually do not really have a preference how this should be implemented. Devs will find the best solution, I guess…TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MisterSynergyCc: Esc3300, Aklapper, PokestarFan, MisterSynergy, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-03 Thread Esc3300
Esc3300 added a comment.
oh .. forget what I just wrote.

Maybe a new service for WQS would be easiest solution.TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Esc3300Cc: Esc3300, Aklapper, PokestarFan, MisterSynergy, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T172380: Query constraint violations with WDQS

2017-08-03 Thread Esc3300
Esc3300 added a comment.
I inserted numbering in the task description.

I think (4.)  could be done easily with the SPARQL query links on property talk pages.

Maybe (2.) and (3.) could be done by some combination .. but it's likely to time out.

On the other hand, if you start from a list of items, you could try to do queries to check constraints from there. Many WikiProjects already have (Listeria) reports that do just that.TASK DETAILhttps://phabricator.wikimedia.org/T172380EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Esc3300Cc: Esc3300, Aklapper, PokestarFan, MisterSynergy, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs