Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-10 Thread Andre Klapper
On Wed, 2013-10-09 at 12:53 +0100, Magnus Manske wrote: It's on-and-off again. Two tools of mine have been identified as the culprits, apparently hogging all resources. Which is strange, because they worked fine for months. Personally, I suspect an underlying problem (nfs, PHP setup, like

Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-10 Thread Magnus Manske
Well, it's broken again, so... On Thu, Oct 10, 2013 at 10:26 AM, Andre Klapper aklap...@wikimedia.orgwrote: On Wed, 2013-10-09 at 12:53 +0100, Magnus Manske wrote: It's on-and-off again. Two tools of mine have been identified as the culprits, apparently hogging all resources. Which is

Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-10 Thread addshorewiki
I have reopened https://bugzilla.wikimedia.org/show_bug.cgi?id=55498 Again this is just affecting tools-webserver-01, 167 tools get the error, 182 will not. ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org

Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-10 Thread Magnus Manske
Thanks. Question: Are the webservers set up using puppet? If so, would it be easy to create a brand-new webserver instance, move some/all tools from 01 there, and see what happens? Disclaimer: I have never used puppet, nor am I intricately familiar with Labs internal setup. On Thu, Oct 10,

Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-10 Thread addshorewiki
They are setup using puppet 'role::labs::tools::webserver' webserver-03 was created not too long ago and some tools were shifted onto it. It shouldn't be to hard to resolve the problem again, we just need to wait for someone with the technical permissions to do so.

[Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-09 Thread Daniel Mietchen
Hi, it seems that http://tools.wmflabs.org is off and has been so all morning for me. Daniel ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Re: [Wikitech-l] HTTP 500 error at tools.wmflabs.org

2013-10-09 Thread Magnus Manske
It's on-and-off again. Two tools of mine have been identified as the culprits, apparently hogging all resources. Which is strange, because they worked fine for months. Personally, I suspect an underlying problem (nfs, PHP setup, like that). The two tools are deactivated now, so if they alone were