Re: [Labs-l] [Labs-announce] Reminder: Ubuntu Precise instances will be shut down at the end of this month

FYI that analytics is working on (finally!) saying by to that limn instance by end of this month. Thanks, Nuria On Tue, Mar 14, 2017 at 1:49 PM, Andrew Bogott wrote: > There are now 16 days remaining until the Ubuntu Precise deadline. After > that all remaining Labs VMs

Re: [Labs-l] Tell us about the SQL that you can't get to work

>An idea I just had for showing interest is to get Tool Labs >maintainers and other Labs users to describe questions that they have >tried and failed to answer using SQL queries. I think there are two concerns here, correctness and performance. On the analytics team we tried (early on) to use the

Re: [Labs-l] Service restored

We are also having problems running puppet (we had no issues yesterday morning and changes had not been made): These are the errors that we are getting on our self hosted puppet master: Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Could not find data item

Re: [Labs-l] Service restored

A. Pelletier m...@uberbox.org wrote: On 15-03-31 10:04 AM, Nuria Ruiz wrote: Error: Could not retrieve catalog from remote server: Error 400 on SERVER: Could not find data item ganglia_class in any Hiera data file and no default supplied at /etc/puppet/manifests/ganglia.pp:22 on node wikimetrics1

Re: [Labs-l] Service restored

if you want to contact _joe_or whether I should follow up. Thank you. Nuria On Tue, Mar 31, 2015 at 3:04 PM, Marc A. Pelletier m...@uberbox.org wrote: On 15-03-31 03:28 PM, Nuria Ruiz wrote: Thank You! We will keep an eye on the list. I see an addition by him of the following test

Re: [Labs-l] Labs restart mysql connections dropping?

but it is true that we have not seen them today or yesterday. Maybe the problem has subsided? Will keep an eye for it. On Sun, Feb 15, 2015 at 9:00 PM, Sean Pringle sprin...@wikimedia.org wrote: On Mon, Feb 16, 2015 at 2:38 AM, Nuria Ruiz nu...@wikimedia.org wrote: Which recent restart

Re: [Labs-l] Labs restart mysql connections dropping?

16, 2015 at 9:15 AM, Nuria Ruiz nu...@wikimedia.org wrote: Nuria, the labsdb restarts were on Feb 12th. Russell mentioned connection problems starting Feb 8th -- just to be sure, can you please double-check and specify a date also? Our recent problems regarding (2006, 'MySQL server has gone

Re: [Labs-l] Labs restart mysql connections dropping?

Which recent restart? The GHOST restarts in late January, or the labsdb restarts last week? Something else? The labs restart last week. Is there any pattern? Eg, time of day, specific queries, etc We do not have enough usage sin labs such we would see daily patterns or such but several queries

Re: [Labs-l] Labs restart mysql connections dropping?

ping ... On Thu, Feb 12, 2015 at 1:38 PM, Nuria Ruiz nu...@wikimedia.org wrote: Team: After the restart on labs recently we are seeing a lot of dropped connections. We are connecting (just like before) to labsdb1001.eqiad.wmnet Is there something we should change in our setup after the re

[Labs-l] Labs restart mysql connections dropping?

Team: After the restart on labs recently we are seeing a lot of dropped connections. We are connecting (just like before) to labsdb1001.eqiad.wmnet Is there something we should change in our setup after the re-start? Thanks, Nuria ___ Labs-l

Re: [Labs-l] ToolLabs back up

Well, I think this is the problem right here. If something must have 24/7 uptime, it should be in production, not labs. Not really, that would be the case if it could not tolerate outages of any sort, 'ideally' we would like our tools to be 24/7. Now, can the tools tolerate a full-day outage? They

Re: [Labs-l] ToolLabs back up

Daniel, Tomcat has problems with re-start when it says it shuts down but really does not. Look to see if port 4001 is occupied. (netstat -putona), kill any processes (kill -9) and try re-starting again. Nuria On Wed, Jan 28, 2015 at 12:30 AM, Daniel Naber na...@danielnaber.de wrote: On

Re: [Labs-l] Cannot connect to DB

Seems like something is missing cause despite having changed the config our wikimetrics1 instance is still throwing a bunch of errors like: File /usr/local/lib/python2.7/dist-packages/sqlalchemy/engine/base.py, line 238, in _revalidate_connection Can't reconnect until invalid

Re: [Labs-l] Cannot connect to DB

Also we get too many connections. Yuvi: (or anyone) what are appropriate settings for pool size for db connections for these hosts? Thanks again, Nuria On Tue, Jan 27, 2015 at 11:21 AM, Nuria Ruiz nu...@wikimedia.org wrote: Seems like something is missing cause despite having changed

[Labs-l] Cannot connect to DB

Team: All of a sudden, wikimetrics (a popular tool deployed to labs: https://metrics.wmflabs.org/) cannot connect to the labs database, this happens when there are firewall or IP tables issues as it looks like ip tables rules are not on puppet. However we have tried to apply the older rules we

[Labs-l] Question: how do we upgrade our labs nodes to trusty?

Hello, How do we upgrade our labs nodes to trusty? Can we upgrade the node we currently have or do we need to spawn a new node? Thanks, Nuria ___ Labs-l mailing list Labs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/labs-l

Re: [Labs-l] Graphite + Charts for Labs

Yuvi: Could you please ad some docs as to how to populate counters on this graphite install? Thank you. On Wed, Oct 29, 2014 at 7:32 AM, Yuvi Panda yuvipa...@gmail.com wrote: Hello! Graphite for labs is now available at https://graphite.wmflabs.org. Collects a good number of metrics for

Re: [Labs-l] Enwiki database corruption

Is thee an update on this regard? Is enwiki back up in labs? On Mon, Oct 20, 2014 at 12:36 PM, Russell Blau russb...@imapmail.org wrote: The enwiki_p database replica on labsdb seems to be out of synch with the master. This is manifesting itself on many articles; here is just one example.

Re: [Labs-l] Google bot

Why would we want to restrict google indexing of the whole cluster? There are tools of many different nature deployed there, seems that indexing or not should be configured on a instance per instance basis. On Sun, Oct 19, 2014 at 4:41 PM, Maximilian Doerr maximilian.do...@gmail.com wrote:

Re: [Labs-l] A tale of three databases

Second that, getting more visibility in how labs is set up is very educational. On Tue, Sep 23, 2014 at 9:14 AM, Denny Vrandečić vrande...@gmail.com wrote: Thank you for the postmortem! Such often contain very valuable lessons, and I am glad you chose to write it down and share it so openly.

Re: [Labs-l] [COMPLETED] Database maintenance 2014-09-19 13:30 UTC

Big thanks! Just writing to confirm everything is working. On Mon, Sep 22, 2014 at 10:41 AM, Marc A. Pelletier m...@uberbox.org wrote: On 09/22/2014 09:59 AM, Marc A. Pelletier wrote: Fixing this is my priority this morning. Moar news coming in soon. This should now been fixed (thank you

Re: [Labs-l] [COMPLETED] Database maintenance 2014-09-19 13:30 UTC

: On Sep 21, 2014 8:38 PM, Nuria Ruiz nu...@wikimedia.org wrote: Since the IP tables settings are not on puppet we keep track of those by hand, please let us know if these are no longer correct: Have you tried using the commands from https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools/Help

Re: [Labs-l] A proposal for better tool discoverability

It's great if this catches on, but we need a way to express multiple authors. Could we have an authors field instead of author, and use an array instead of a string? Bower uses an array for both authors and keywords: https://github.com/bower/bower.json-spec On Wed, Aug 13, 2014 at 9:14 PM,