Smalyshev added a comment.
> Why do these remote clients need "realtime" (no staleness) fetches of Q items? Because that's what Query Service is - realtime (well, near-realtime, given update times) queryable representation of Wikidata content in RDF form. > What I hear is it sounds like all clients expect everything to be perfectly synchronous, Not sure what you mean by "synchronous" here, could you explain? > In the case that lead to this ticket, it was a remote client at Orange issuing a very high rate of these uncacheable queries If you start with an old dump/starting point, yes, this is essentially a bulk data load. It is not meant for external clients, so there's no actual rate controls built in, except for the server itself rejecting the queries. Of course, rate limiting would mean the endpoint may take a very long time to catch up... BTW in this situation I don't really see how caching would help any, as Updater is not supposed to ever ask for the same content (or, in a situation with large backlog, for the same item) twice. If we need more detailed look into it, maybe set up a meeting so we could do an interactive dive-in there? TASK DETAIL https://phabricator.wikimedia.org/T217897 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Smalyshev Cc: Smalyshev, BBlack, Aklapper, Gehel, alaa_wmde, Legado_Shulgin, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, _jensen, rosalieper, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
