Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Sean Pringle
On Wed, Apr 30, 2014 at 3:39 PM, Oliver Keyes wrote: > Also, where are you replicating from? Only there are kind of a lot of > tables here I don't recognise. > >From each shard using the same replication streams as the sX-analytics-slaves use. Which tables? -- DBA @ WMF _

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Sean Pringle
On Wed, Apr 30, 2014 at 12:44 PM, Oliver Keyes wrote: > Okay, so, have tested (to a limited degree. The work I'm doing that > involves the dbs involves eventlogging, so this is mostly me making up > excuses to run queries). Thoughts: > > *We should probably put in some kind of restrictions around

Re: [Analytics] Survey tool for features

2014-04-29 Thread Oliver Keyes
Says the guy with a HCI doctorate. Paging doctors Dunning and Krueger :P. The crux of my argument, though, is that I'm uncomfortable with us saying "yes, let's build/standardise on a tool for qualitative analysis" when we're actively recruiting for several qualitative analysts: it's unfair for us

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Oliver Keyes
Also, where are you replicating from? Only there are kind of a lot of tables here I don't recognise. On 29 April 2014 19:44, Oliver Keyes wrote: > Okay, so, have tested (to a limited degree. The work I'm doing that > involves the dbs involves eventlogging, so this is mostly me making up > excus

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Oliver Keyes
Okay, so, have tested (to a limited degree. The work I'm doing that involves the dbs involves eventlogging, so this is mostly me making up excuses to run queries). Thoughts: *We should probably put in some kind of restrictions around what we care about. For example, I see the tables relating to th

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Oliver Keyes
One word: YAY! Thank you so much for this, Sean :D On 29 April 2014 17:13, Sean Pringle wrote: > On Wed, Apr 30, 2014 at 6:01 AM, Dario Taraborelli < > dtarabore...@wikimedia.org> wrote: > >> Sean, consolation prizes are understated, this is terrific. >> >> I just noticed that centralauth is n

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Sean Pringle
On Wed, Apr 30, 2014 at 6:01 AM, Dario Taraborelli < dtarabore...@wikimedia.org> wrote: > Sean, consolation prizes are understated, this is terrific. > > I just noticed that centralauth is not included, after EventLogging data > this is the most useful database to have replicated on the big one bo

Re: [Analytics] Survey tool for features

2014-04-29 Thread Jonathan Morgan
On Tue, Apr 29, 2014 at 12:30 PM, Oliver Keyes wrote: > > Geneally speaking my advice to the multimedia team would be "don't go near > surveys". I've done a lot of them in the last 3 years, and the one thing > I've learned is that surveys are very, very difficult to get right. Another > thing I've

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Dario Taraborelli
Sean, consolation prizes are understated, this is terrific. I just noticed that centralauth is not included, after EventLogging data this is the most useful database to have replicated on the big one box. Dario On Apr 29, 2014, at 6:31 PM, Sean Pringle wrote: > On Wed, Apr 30, 2014 at 1:20 AM

Re: [Analytics] Survey tool for features

2014-04-29 Thread Tilman Bayer
On Tue, Apr 29, 2014 at 12:06 PM, Mark Holmquist wrote: > On Tue, Apr 29, 2014 at 11:56:58AM -0700, Leila Zia wrote: >> Mark, If you haven't looked at Qualtrics in the past, check it out. >> It has many more options than SurveyMonkey that can make it >> worthwhile specially if we are already payin

Re: [Analytics] Survey tool for features

2014-04-29 Thread Oliver Keyes
>From a cursory glance at their website, sure. From having actually used both of them, Qualtrics is far superior in its featureset and how that featureset is presented, although surveymonkey has got a lot better recently. Geneally speaking my advice to the multimedia team would be "don't go near s

Re: [Analytics] Survey tool for features

2014-04-29 Thread Mark Holmquist
On Tue, Apr 29, 2014 at 11:56:58AM -0700, Leila Zia wrote: > Mark, If you haven't looked at Qualtrics in the past, check it out. > It has many more options than SurveyMonkey that can make it > worthwhile specially if we are already paying for it. On Tue, Apr 29, 2014 at 10:34:21AM -0700, Mark Holm

Re: [Analytics] Survey tool for features

2014-04-29 Thread Leila Zia
On 04/29/2014 11:30 AM, Steven Walling wrote: On Tue, Apr 29, 2014 at 10:34 AM, Mark Holmquist mailto:mtrac...@member.fsf.org>> wrote: But a dark threat loomed over the land. With one product using SurveyMonkey, other products seemed poised to use it, too [1]. The compromise buil

Re: [Analytics] Survey tool for features

2014-04-29 Thread Toby Negrin
We reviewed building a survey tool a couple of quarterly reviews ago and like Stephen said it wasn't prioritized highly compared to many other requests. This, combined with the availability of sub-optimal but workable solutions like SurveyMonkey makes it unlikely we'll look into building one in the

Re: [Analytics] Survey tool for features

2014-04-29 Thread Dan Andreescu
> > In my view, we have much bigger pain points in gathering data, such as > lack of a framework for A/B testing. Using SurveyMonkey is the least of our > problems in gathering qualitative or quantitative data to make decisions > with. > Agreed, bigger fish to fry unfortunately, though I agree the

Re: [Analytics] Survey tool for features

2014-04-29 Thread Steven Walling
On Tue, Apr 29, 2014 at 10:34 AM, Mark Holmquist wrote: > But a dark threat loomed over the land. With one product using > SurveyMonkey, > other products seemed poised to use it, too [1]. The compromise built > upon the premise that Media Viewer needed a survey in less time than it > would take to

Re: [Analytics] Survey tool for features

2014-04-29 Thread Jessie Wild
On Tue, Apr 29, 2014 at 10:34 AM, Mark Holmquist wrote: > Our heroes now reach out to their friends in other realms [3]. Is there > hope for freedom in the land of getting user feedback? Will MediaWiki > or the grander Wikimedia ecosystem soon have a survey tool that all > projects > can use with

[Analytics] Editor activation data

2014-04-29 Thread Dario Taraborelli
(cross-posting, slightly edited to add more context) I uploaded several plots with absolute editor activation counts and editor activation rates. These are based on data we generated for the sensitivity analysis of “new user” metrics. [1] https://meta.wikimedia.org/wiki/Research:Editor_activati

Re: [Analytics] Survey tool for features

2014-04-29 Thread Mark Holmquist
On Tue, Apr 29, 2014 at 02:08:24PM -0400, Matthew Flaschen wrote: > The only survey I've done was one for gender, on signup. It was > designed to see the impact of VisualEditor. That used GuidedTour as > a modal library (not really its original purpose), and just had the > buttons fire EventLoggi

Re: [Analytics] Survey tool for features

2014-04-29 Thread Matthew Flaschen
On 04/29/2014 01:34 PM, Mark Holmquist wrote: Our heroes now reach out to their friends in other realms [3]. Is there hope for freedom in the land of getting user feedback? Will MediaWiki or the grander Wikimedia ecosystem soon have a survey tool that all projects can use with minimal hassle? T

[Analytics] Survey tool for features

2014-04-29 Thread Mark Holmquist
Hi, Once upon a time, the Multimedia team set out on a great quest [0] to add a survey to the Media Viewer they were building. This quest ended with the team deciding that the great Lord SurveyMonkey would provide the users the survey they needed with the least amount of effort, and there was much

Re: [Analytics] db1047 & one box to rule them all

2014-04-29 Thread Sean Pringle
On Wed, Apr 30, 2014 at 1:20 AM, Sean Pringle wrote: > > As something of a consolation prize, "analytics-store.eqiad.wmnet" is now > open for SELECT queries from the 'research' user. This box: > > - Is a CNAME for dbstore1002.eqaid.wmnet. > Just to be contrary I've already messed with the CNAME t

[Analytics] db1047 & one box to rule them all

2014-04-29 Thread Sean Pringle
Hi! The speed bumps from the eventlogging migration are almost ironed out: 1. db1048 has had the eventlogging uuid fields made formally UNIQUE KEY. I gather Ori will now run some validation against logs to check for remaining gaps. 2. db1046 which died mid-migration has been restored and is catc