[Analytics] Issues on Cluster

2016-01-28 Thread Joseph Allemandou
Hi Analytics fellows, We are experiencing issues with loading data into the hadoop cluster, therefore blocking the full job pipeline. When fixed, the cluster will be heavily loaded trying to catch up, so please, be nice with it and don't run heavy jobs in the next hours. We'll keep you posted

Re: [Analytics] WikimediaBot convention

2016-01-28 Thread Toby Negrin
On Thu, Jan 28, 2016 at 4:27 AM, Marcel Ruiz Forns wrote: > I wonder if Marcel means "crawlers". > > Toby, do you mean when referring to spiders? Yes, I think they are > equivalent terms. Do you think we should change the naming there? > Hi Marcel -- Here's some

Re: [Analytics] [Engineering] Eventlogging Mysql consumers downtime

2016-01-28 Thread Andrew Otto
Backfilling is done on the master, but I’m not sure about slave resyncing. I think it is mostly done, except for large tables. Tracking this here: https://phabricator.wikimedia.org/T120187 On Thu, Jan 28, 2016 at 7:34 AM, Marcel Ruiz Forns wrote: > Yes, it has been