[Analytics] graphite/statsd stopped collecting deprecation data

2014-12-19 Thread Timo Tijhof
It seems as of November 29th, something in our logging infrastructure has stopped. Does anyone know what happened? Debugging: Looking at the graphs[1] reveals all data points have them plummeted straight down that day and haven't shown any activity since. Except on December 4th we observed that

[Analytics] FYI: "Analytics-Refinery" project renamed in Phabricator

2014-12-19 Thread Kevin Leduc
The new name is *Analytics-Cluster* , the URL is still the same [1] We changed the name because some of the tasks logged in this project went beyond the scope of the Refinery code repository and involved actual work on the cluster. More on the project is on Wikitech [2] [1] https://phabricator.w

Re: [Analytics] Oozie 101 doc

2014-12-19 Thread Grace Gellerman
This is great! Thanks for taking the initiative, Nuria :) On Fri, Dec 19, 2014 at 10:22 AM, Nuria Ruiz wrote: > > > (sending to public list) > > I have started a doc in wikitech that describes an oozie 101 example and > goes a little into how to troubleshoot oozie jobs. Still WIP. > > > Will upd

[Analytics] Oozie 101 doc

2014-12-19 Thread Nuria Ruiz
(sending to public list) I have started a doc in wikitech that describes an oozie 101 example and goes a little into how to troubleshoot oozie jobs. Still WIP. Will update as work progresses: https://wikitech.wikimedia.org/wiki/Analytics/Cluster/Oozie Please edit/correct as needed. ___

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Aaron Halfaker
Thanks folks! :) On Fri, Dec 19, 2014 at 8:36 AM, Andrew Otto wrote: > > > Ticket is resolved already :-D Thanks, akosiaris! > > > > So stat1003 can again to connect to x1-analytics-slave. > :) :) Thank you! > > > > On Dec 19, 2014, at 07:06, Christian Aistleitner < > christ...@quelltextlich.at>

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Andrew Otto
> Ticket is resolved already :-D Thanks, akosiaris! > > So stat1003 can again to connect to x1-analytics-slave. :) :) Thank you! > On Dec 19, 2014, at 07:06, Christian Aistleitner > wrote: > > Hi, > > On Fri, Dec 19, 2014 at 12:31:50PM +0100, Christian Aistleitner wrote: >> We previously cou

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Andrew Otto
> Ticket is resolved already :-D Thanks, akosiaris! > > So stat1003 can again to connect to x1-analytics-slave. :) :) Thank you! > On Dec 19, 2014, at 07:06, Christian Aistleitner > wrote: > > Hi, > > On Fri, Dec 19, 2014 at 12:31:50PM +0100, Christian Aistleitner wrote: >> We previously cou

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Oliver Keyes
Yup; x1 is used for Flow/Echo/anything else that needs that kind of distributed data structure. On 19 December 2014 at 07:06, Christian Aistleitner < christ...@quelltextlich.at> wrote: > > Hi, > > On Fri, Dec 19, 2014 at 12:31:50PM +0100, Christian Aistleitner wrote: > > We previously could connec

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Christian Aistleitner
Hi, On Fri, Dec 19, 2014 at 12:31:50PM +0100, Christian Aistleitner wrote: > We previously could connect to that slave from stat1003, but that did > no longer work when I tried just now :-/ > That might be related to yesterday's vlan move of stat1003, so I filed > T84990 [3] to open up the firewal

Re: [Analytics] Where is Flow's data

2014-12-19 Thread Christian Aistleitner
Hi Aaron, On Thu, Dec 18, 2014 at 07:33:25PM -0600, Aaron Halfaker wrote: > After some digging around, I can't seem to figure out where Flow's data > lives. Can someone help me out? At some point I heard that Flow data is in the x1 shard. But I actually never had to work with that data, so that