On 23.07.19 20:23, Stas Malyshev wrote:
> Also, with live updates, long queries create other technical challenges
> (if query is running for 2 hours, the database has basically to keep the
> snapshot it runs on for 2 hours, which may make it much less efficient).
Wait, does that mean that the
Hi Stas,
One thing that I've been wondering about is whether we could take a
little bit of load off via caching.
At the moment, if you run the same query again within a minute or two,
it uses the cached results. But after a few minutes, anyone who
follows the link triggers a new run.
If a query
On Tue, Jul 23, 2019 at 1:23 PM Stas Malyshev
wrote:
> Hi!
>
> > Will this be approachable: My 2 hour query will actually finally
> > return results into my 1gig csv.zip file?
>
> Not sure about 2 hours, as again it'd be a service that would be open to
> a wide community, and time is the most
Hi!
> Forgive my ignorance. I don't know much about infrastructure of WDQS and
> how it works. I just want to mention how application servers do it. In
> appservers, there are dedicated nodes both for apache and the replica
> database. So if a bot overdo things in Wikipedia (which happens quite a
>
> Adding authentication to the service, and allowing higher quotas to bots
> that authenticate.
Awesome and expected.
Creating an asynchronous queue, which could allow running more expensive
> queries, but with longer deadlines.
Even more awesome!
Will this be approachable: My 2 hour
Hey,
Forgive my ignorance. I don't know much about infrastructure of WDQS and
how it works. I just want to mention how application servers do it. In
appservers, there are dedicated nodes both for apache and the replica
database. So if a bot overdo things in Wikipedia (which happens quite a
lot),
Hello all!
Here is (at last!) an update on what we are doing to protect the
stability of Wikidata Query Service.
For 4 years we have been offering to Wikidata users the Query Service, a
powerful tool that allows anyone to query the content of Wikidata,
without any identification needed. This
