Re: [Analytics] s[23467]-analytics-slave getting pointed to analytics-store

2014-06-03 Thread Sean Pringle
Another question: What should we do with s5-analytics-slave? Last year at Aaron's request this was made writable like s1 with staging and personal databases. Could it revert to using analytics-store with only staging? ___ Analytics mailing list Analytics

Re: [Analytics] s[23467]-analytics-slave getting pointed to analytics-store

2014-06-03 Thread Sean Pringle
On Tue, Jun 3, 2014 at 11:43 PM, Aaron Halfaker wrote: > This should not happen until some important indexes have been carried over > to analytics store. > > In other words, block on > https://rt.wikimedia.org/Ticket/Display.html?id=7594 please. > Noted. s3-analytics-slave switched over a fortn

Re: [Analytics] Table of Wikis (for supporting cross-wiki work)

2014-06-03 Thread Oliver Keyes
That would be awesome. I mean, this is already awesome but, more awesome :). Also, uggh at our API's JSON output being a thinly-veiled hack straight on top of XML. On 3 June 2014 17:29, Dario Taraborelli wrote: > +1, shall we add private and close as separate fields? > > On Jun 3, 2014, at

Re: [Analytics] Table of Wikis (for supporting cross-wiki work)

2014-06-03 Thread Dario Taraborelli
+1, shall we add private and close as separate fields? On Jun 3, 2014, at 5:15 PM, Oliver Keyes wrote: > Point of clarification; is this all wikis, or all active wikis, or...? For > example, it would be useful to be able to exclude special or closed wikis if > necessary. > > > On 3 June 2014

Re: [Analytics] Table of Wikis (for supporting cross-wiki work)

2014-06-03 Thread Oliver Keyes
Point of clarification; is this all wikis, or all active wikis, or...? For example, it would be useful to be able to exclude special or closed wikis if necessary. On 3 June 2014 07:51, Dario Taraborelli wrote: > that’s nifty, thanks Aaron. > > On Jun 3, 2014, at 5:14 AM, Dan Andreescu > wrote:

Re: [Analytics] Replacing txstatsd

2014-06-03 Thread Matthew Walker
Amusingly; I just forked Steve Ivy's NodeJS client so that I could use with txstatsd. I'd be happy to help test the install in labs if you want -- otherwise I'm content to watch this unfold from the sidelines. Do you have an approximate eta on when we'll see this in production? ~Matt Walker Wikim

Re: [Analytics] Replacing txstatsd

2014-06-03 Thread Chase Pettet
So counters and sets exist (and work) in the linked (proposed) deb. Out of the box timers I think are lower/count (of all the timers matching that key)/mean/upper/upper_99. Chase On 6/3/14, 1:34 PM, Matthew Walker wrote: Plugging for additional functionality -- it would also be ridiculously

Re: [Analytics] Replacing txstatsd

2014-06-03 Thread Matthew Walker
Plugging for additional functionality -- it would also be ridiculously cool is if we had the ability to count uniques (sets in the etsy statsd implementation). ~Matt Walker Wikimedia Foundation Fundraising Technology Team On Tue, Jun 3, 2014 at 11:22 AM, Matthew Walker wrote: > Can you help me

Re: [Analytics] Replacing txstatsd

2014-06-03 Thread Matthew Walker
> > Can you help me understand what the weird behavior you are seeing with > counters is? I'm pretty familiar with statsd types overall so I can tell > you if this would solve the issue. Simply, metrics like "ocg.pdftest_counter:1|c" do not count, instead it keeps the last sent value and persist

Re: [Analytics] Replacing txstatsd

2014-06-03 Thread Chase Pettet
Matt, No one seems to love txstatsd -- for many reasons :) I have been looking to try out a version I used at my last job. It should be fully statsd compliant with extras basically. The effort is seen here: https://gerrit.wikimedia.org/r/#/c/131449/ Can you help me understand what the wei

[Analytics] Replacing txstatsd

2014-06-03 Thread Matthew Walker
Chase, Ori mentioned that you might have plans to replace txstatsd as our StatsD collector for graphite/carbon. Do you have such plans and can you elaborate? The reason I'm asking is because we currently operate txstatsd with a non statsd complaint message processor which has some unexpected, to

Re: [Analytics] Table of Wikis (for supporting cross-wiki work)

2014-06-03 Thread Dario Taraborelli
that’s nifty, thanks Aaron. On Jun 3, 2014, at 5:14 AM, Dan Andreescu wrote: > awesome! > > > On Mon, Jun 2, 2014 at 7:49 PM, Aaron Halfaker > wrote: > I polled https://www.mediawiki.org/w/api.php?action=sitematrix&format=jsonfm > to get a list of wikis and some metadata then I pulled it in

Re: [Analytics] s[23467]-analytics-slave getting pointed to analytics-store

2014-06-03 Thread Aaron Halfaker
This should not happen until some important indexes have been carried over to analytics store. In other words, block on https://rt.wikimedia.org/Ticket/Display.html?id=7594 please. -Aaron On Tue, Jun 3, 2014 at 7:19 AM, Toby Negrin wrote: > Thanks Christian. > > > On Tue, Jun 3, 2014 at 4:50

Re: [Analytics] s[23467]-analytics-slave getting pointed to analytics-store

2014-06-03 Thread Toby Negrin
Thanks Christian. On Tue, Jun 3, 2014 at 4:50 AM, Christian Aistleitner < christ...@quelltextlich.at> wrote: > Hi, > > No action required. Just a heads up. > > Since there were some problems around machine capacities, slow queries > and subsequent slave lag and alarms in the past months, springl

Re: [Analytics] Table of Wikis (for supporting cross-wiki work)

2014-06-03 Thread Dan Andreescu
awesome! On Mon, Jun 2, 2014 at 7:49 PM, Aaron Halfaker wrote: > I polled > https://www.mediawiki.org/w/api.php?action=sitematrix&format=jsonfm to > get a list of wikis and some metadata then I pulled it into a table in the > new analytics-store DB. > > The data should be complete at the time I

[Analytics] s[23467]-analytics-slave getting pointed to analytics-store

2014-06-03 Thread Christian Aistleitner
Hi, No action required. Just a heads up. Since there were some problems around machine capacities, slow queries and subsequent slave lag and alarms in the past months, springle suggested to point the s[23467]-analytics-slave aliases to the new analytics-store machine. That should kill some of the