[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Smalyshev added a comment. Not exactly Quarry, but see https://commons.wikimedia.org/wiki/User:TabulistBot - this should be similar to Listeria and generate persistent reusable tabular data. @Lucas_Werkmeister_WMDE I agree there are some downsides to this model, but I think it's the easiest and most natural to do for now despite the limitations, so I'd like to see if it can work with it.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: zhuyifei1999, Smalyshev, Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, AndyTan, Zylc, 1978Gage2001, Lahi, Gq86, Darkminds3113, GoranSMilovanovic, Soteriaspace, Jayprakash12345, Chicocvenancio, JakeTheDeveloper, QZanden, EBjune, Tbscho, merbst, LawExplorer, Framawiki, Avner, JJMC89, Gehel, Jonas, FloNight, Xmlizer, srodlund, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, scfc, TheDJ, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Lucas_Werkmeister_WMDE added a comment.
I don’t think that’s a good fit. Query results aren’t necessarily notable for Commons, nor are they necessarily pure data (e. g. labels and descriptions, image links, or constructed result columns – the most extreme example would be the “cocktail recipes” query). Commons’ Tabular Data also imposes some restrictions which not all query results fulfill (e. g. strings cannot be longer than 400 characters), and unless we store tiny JSON blobs like {"type": "literal", "value": "foo"} inside the string values in the tabular data (storing objects directly is not allowed), we also lose some information about the data (the distinction between literals and IRIs).TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: zhuyifei1999, Smalyshev, Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, Tbscho, Zoranzoki21, merbst, Avner, JJMC89, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, scfc, TheDJ, Mbch331, Krenair, chasemp___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Smalyshev added a comment. IIRC https://www.mediawiki.org/wiki/Extension:Graph can work with tabular data. WDQS GUI can't export into graphs though, except for Graph Builder, so there's some improvement possible there.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: zhuyifei1999, Smalyshev, Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, Tbscho, Zoranzoki21, merbst, Avner, JJMC89, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, scfc, TheDJ, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Daniel_Mietchen added a comment. In T104762#3806240, @Smalyshev wrote: Tabular data on Commons should be a good place for it, not? Do we need yet another place/way to store tabular data? That seems like a good option indeed. In that case, we'd need a way to pull the data back into the WDQS for visualization.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Daniel_MietchenCc: zhuyifei1999, Smalyshev, Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, Tbscho, Zoranzoki21, merbst, Avner, JJMC89, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, scfc, TheDJ, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Smalyshev added a comment. We want to be able to save query results and share them Tabular data on Commons should be a good place for it, not? Do we need yet another place/way to store tabular data?TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, Tbscho, Zoranzoki21, merbst, Avner, JJMC89, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, zhuyifei1999, scfc, TheDJ, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Lucas_Werkmeister_WMDE added a comment. In T104762#2635939, @Multichill wrote: With the current SPARQL setup it's easy to share queries either by full url or by short url. I think we can close this one. I disagree: one important part of this task, saving results, isn’t served at all by this. We want to be able to save query results and share them, and unlike on Quarry, it shouldn’t be possible to change those results later, even for the query author (who, on Quarry, can re-run the query, changing the results without assigning a new ID). Other than when privacy or legal concerns require the results to be deleted, the pages should be immutable. This should be an optional component, not the main interface for querying (as Quarry is for the SQL databases) – WDQS sees millions of queries every day (the exact number varies with each new Wikidata presentation), we can’t afford to save all those results.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Liuxinyu970226, WikidataFacts, Daniel_Mietchen, jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, Nikki, Aklapper, Multichill, Lahi, Gq86, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, QZanden, EBjune, Tbscho, Zoranzoki21, merbst, Avner, JJMC89, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, Gryllida, zhuyifei1999, scfc, TheDJ, Mbch331, Krenair, chasemp___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
jcrespo added a comment. @Base, your questions are very interesting, and you seem to have really nice suggestions, but I would suggest a mailing list, wiki talk page (or if it was a bug/feature request, doing them on a separate ticket), as the preferred way to communicate. This ticket is probably going to be closed soon, and when that happens your questions will get unanswered and with little visibility here.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: jcrespo, Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, mschwarzer, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Base added a comment. Do I get it right that now a query cannot be longer than URL length limit? How much exactly is that number? I wonder if there were cases of people needing to run longer queries. Is this investigable somehow?TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: BaseCc: Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, mschwarzer, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Multichill added a comment. With the current SPARQL setup it's easy to share queries either by full url or by short url. I think we can close this one.TASK DETAILhttps://phabricator.wikimedia.org/T104762EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, mschwarzer, Avner, debt, Gehel, D3r1ck01, Jonas, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Base added a comment. In https://phabricator.wikimedia.org/T104762#2270182, @Multichill wrote: > In https://phabricator.wikimedia.org/T104762#2269919, @Base wrote: > > > A stupid question by a person with bad SQL (progressed from almost zero mostly thanks to quarry) and almost no SPARQL knowledge: would it be possible to have part of a request being made in SQL and part in SPARQL and have it all output as one table? (Like select a list of articles on some wiki by some WD based criteria and then fetch its sizes, creators and stuff like this via SQL and just have it all in one table) > > > Quite off topic on this bug. Another forum like the wikidata mailinglist is probably more suitable. Have a look at https://petscan.wmflabs.org/ . With that tool you can combine queries from different sources. More simply I guess that means the answer is no. Thanks, that's what I wanted to hear :) TASK DETAIL https://phabricator.wikimedia.org/T104762 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Base Cc: Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Multichill added a comment. In https://phabricator.wikimedia.org/T104762#2269919, @Base wrote: > A stupid question by a person with bad SQL (progressed from almost zero mostly thanks to quarry) and almost no SPARQL knowledge: would it be possible to have part of a request being made in SQL and part in SPARQL and have it all output as one table? (Like select a list of articles on some wiki by some WD based criteria and then fetch its sizes, creators and stuff like this via SQL and just have it all in one table) Quite off topic on this bug. Another forum like the wikidata mailinglist is probably more suitable. Have a look at https://petscan.wmflabs.org/ . With that tool you can combine queries from different sources. TASK DETAIL https://phabricator.wikimedia.org/T104762 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Multichill Cc: Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Base added a comment. A stupid question by a person with bad SQL (progressed from almost zero mostly thanks to quarry) and almost no SPARQL knowledge: would it be possible to have part of a request being made in SQL and part in SPARQL and have it all output as one table? (Like select a list of articles on some wiki by some WD based criteria and then fetch its sizes, creators and stuff like this via SQL and just have it all in one table) TASK DETAIL https://phabricator.wikimedia.org/T104762 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Base Cc: Base, StudiesWorld, Ricordisamoa, Sitic, Addshore, yuvipanda, Nikki, Aklapper, Multichill, Avner, debt, Gehel, D3r1ck01, FloNight, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Capt_Swing, Deskana, Manybubbles, scfc, TheDJ, Mbch331 ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
Multichill added a comment. In https://phabricator.wikimedia.org/T104762#1426466, @yuvipanda wrote: > I think it'll be simpler to just have Quarry handle SPARQL as well. Fine with me too :-) TASK DETAIL https://phabricator.wikimedia.org/T104762 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Multichill Cc: yuvipanda, Nikki, Aklapper, Multichill, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Manybubbles, JanZerebecki, scfc, Malyacko, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T104762: Setup sparqly service at https://sparqly.wmflabs.org/ (like Quarry)
yuvipanda added a subscriber: yuvipanda. yuvipanda added a comment. I think it'll be simpler to just have Quarry handle SPARQL as well. TASK DETAIL https://phabricator.wikimedia.org/T104762 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: yuvipanda Cc: yuvipanda, Nikki, Aklapper, Multichill, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Manybubbles, JanZerebecki, scfc, Malyacko, P.Copp ___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
