Re: [Wikidata] Overload of query.wikidata.org (Guillaume Lederrey)

2019-06-21 Thread Imre Samu
good news :) - the issue has been fixed in the 0.6.7 release - and it is working again! https://github.com/nichtich/wikidata-taxonomy/commit/97abd4158b3c4ba9cd2c53503ca6b8b2ca29bc2a Imre Stas Malyshev ezt írta (időpont: 2019. jún. 19., Sze, 0:22): > Hi! > > On 6/18/19 2:29 PM, Tim Finin

Re: [Wikidata] Overload of query.wikidata.org (Guillaume Lederrey)

2019-06-19 Thread Tim Finin
I've been using wdtaxonomy happily for many months on my macbook running 10.14.5. Starting yesterday, every call I make (e.g., "wdtaxonomy -c Q5") produces an immediate "SPARQL request failed" message. Might these requests be blocked now because of

Re: [Wikidata] Overload of query.wikidata.org (Guillaume Lederrey)

2019-06-18 Thread Stas Malyshev
Hi! On 6/18/19 2:29 PM, Tim Finin wrote: > I've been using wdtaxonomy >  happily for many months > on my macbook. Starting yesterday, every call I make (e.g., "wdtaxonomy > -c Q5") produces an immediate "SPARQL request failed" message. Could you

Re: [Wikidata] Overload of query.wikidata.org (Guillaume Lederrey)

2019-06-18 Thread Tim Finin
I've been using wdtaxonomy happily for many months on my macbook. Starting yesterday, every call I make (e.g., "wdtaxonomy -c Q5") produces an immediate "SPARQL request failed" message. Might these requests be blocked now because of the new WDQS

Re: [Wikidata] Overload of query.wikidata.org

2019-06-17 Thread Gerard Meijssen
Hoi, I make use of the SourceMD environment, it is well behaved allows for throttling and when I have multiple jobs it only runs one at a time. I do understand that my jobs are put on hold when the situation warrants it, I even put them myself on hold when I think about it. When someone else puts

Re: [Wikidata] Overload of query.wikidata.org

2019-06-17 Thread Stas Malyshev
Hi! > We are currently dealing with a bot overloading the Wikidata Query > Service. This bot does not look actively malicious, but does create > enough load to disrupt the service. As a stop gap measure, we had to > deny access to all bots using python-request user agent. > > As a reminder, any

Re: [Wikidata] Overload of query.wikidata.org

2019-06-17 Thread Guillaume Lederrey
No, there isn't any prioritization. Updates are guaranteed as they stay in the update queue if they could not be written, but both read and writes are impacted by resource saturation. On Mon, 17 Jun 2019, 15:35 Gerard Meijssen, wrote: > Hoi, > Does this mean that the retrieval of data has

Re: [Wikidata] Overload of query.wikidata.org

2019-06-17 Thread Gerard Meijssen
Hoi, Does this mean that the retrieval of data has priority over updates ? Thanks, GerardM On Mon, 17 Jun 2019 at 14:52, Guillaume Lederrey wrote: > Hello all! > > We now have an incident report [1] describing in more detail this > overload of Wikidata Query Service. The ban of

Re: [Wikidata] Overload of query.wikidata.org

2019-06-17 Thread Guillaume Lederrey
Hello all! We now have an incident report [1] describing in more detail this overload of Wikidata Query Service. The ban of python-request is still in effect and will remain so until we have a throttling solution in place for generic user agents. Thanks all for your patience! Guillaume [1]

[Wikidata] Overload of query.wikidata.org

2019-06-13 Thread Guillaume Lederrey
Hello all! We are currently dealing with a bot overloading the Wikidata Query Service. This bot does not look actively malicious, but does create enough load to disrupt the service. As a stop gap measure, we had to deny access to all bots using python-request user agent. As a reminder, any bot