Re: [Cloud] Database queries via PHP

2017-10-06 Thread Alex Monk
Maybe post your script so people can try to investigate? On 6 October 2017 at 19:42, Russell Blau wrote: > I'm trying to debug a PHP script that runs various queries against the > enwiki_p database on the new server (enwiki.analytics.db.svc.eqiad.wmflabs), > and I've run into a wall. To simplify

[Cloud] Database queries via PHP

2017-10-06 Thread Russell Blau
I'm trying to debug a PHP script that runs various queries against the enwiki_p database on the new server (enwiki.analytics.db.svc.eqiad.wmflabs), and I've run into a wall. To simplify the question, I'm running three SQL queries in succession using mysqli_query. The first two queries return res

Re: [Cloud] Browser extension for unsourced Wikipedia articles

2017-10-06 Thread Morten Wang
In my experience, the problem you're trying to solve boils down to finding articles similar to a given search query that are in the given category. Trying to outsmart Lucene on that kind of a problem is going to be challenging given that it's for example used as a benchmark in research[1], so switc

Re: [Cloud] How to self-limit database query time

2017-10-06 Thread Nuria Ruiz
> I also need database queries longer than 3 hours to get a full data set, t May I ask what is what you are querying for? On Fri, Oct 6, 2017 at 9:01 AM, Jaime Crespo wrote: > On Fri, Oct 6, 2017 at 5:51 PM, Martin Domdey wrote: > > Yes, thank you Xavier. I also need database queries longer tha

Re: [Cloud] How to self-limit database query time

2017-10-06 Thread Jaime Crespo
On Fri, Oct 6, 2017 at 5:51 PM, Martin Domdey wrote: > Yes, thank you Xavier. I also need database queries longer than 3 hours to > get a full data set, that is not possible to run in query parts. How is it > possible to switch off the timeout? I mentioned this just as a way to "self-limit" your

Re: [Cloud] How to self-limit database query time

2017-10-06 Thread Martin Domdey
Yes, thank you Xavier. I also need database queries longer than 3 hours to get a full data set, that is not possible to run in query parts. How is it possible to switch off the timeout? Martin -- Diese Nachricht wurde von meinem Android Mobiltelefon mit GMX Mail gesendet.Am 06.10.2017, 16:53, Xa

[Cloud] jstart / jsub -continuous commands were broken; fixed now

2017-10-06 Thread Bryan Davis
I deployed a new version of the jsub command at 2017-10-05T22:42Z. The major change was porting the script from Python2 to Python3. Unfortunately I did not test all code paths with the new script. When invoked as `jstart` or `jsub -continuous ...` it would fail with an error [0]: Traceback (most

Re: [Cloud] How to self-limit database query time

2017-10-06 Thread Xavier Combelle
About the long waiting time for web tools, it depends strongly on the tool. For example for query.wikidata.org it would be nice that some query could be run even if it would spend one hour or even one full day instead of timeout at something like 5 minutes. Sometimes a long waiting result is better

Re: [Cloud] How to self-limit database query time

2017-10-06 Thread Chase Pettet
Great tip Jaime! (This page needs some massaging and improving but...) I put this tip here https://wikitech.wikimedia.org/wiki/Help:Toolforge/Database#Query_Limits Cheers. Hope your weekend goes well. On Fri, Oct 6, 2017 at 9:35 AM, Jaime Crespo wrote: > Hi, > > Sometimes I get questions on h

[Cloud] How to self-limit database query time

2017-10-06 Thread Jaime Crespo
Hi, Sometimes I get questions on how to control queries running for longer than intended on the wikireplicas. Since MariaDB 10.1 (the version used on tools and the new wikireplicas), one can run: SET max_statement_time = 300; [0] And all subsequent queries on the same connection will be killed i