Re: [Analytics] Adding indexes to EventLogging tables

2014-05-13 Thread Sean Pringle
On Mon, May 12, 2014 at 11:48 PM, Gilles Dubuc gil...@wikimedia.org wrote: It would be awesome if you could add a similar (wiki, timestamp) index for exactly the same reasons to all the MultimediaViewerNetworkPerformance* tables on the same database. Those tables haven't been problematic yet

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-13 Thread Sean Pringle
On Tue, May 13, 2014 at 7:02 AM, Aaron Halfaker ahalfa...@wikimedia.orgwrote: (Aaron? still keen?) Totally. :). I'm down for some query performance review too. I'm already doing that informally. Great! I therefore added you to a pending gerrit review ;-) For queries that need indexes on

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-13 Thread Dario Taraborelli
Sean, tendril is really awesome. I too would love to review the performance of some queries used for the EE dashboards. One in particular [1] used to be fairly fast and is now taking an ugly lot of time to complete, possibly due to some schema change I was unaware of. I’ll drop you a line

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-12 Thread Aaron Halfaker
Hi Gilles, We don't have a documented process yet. I'd be happy to be the contact for adding indexes since I need indexes so often myself. I've asked springle if this would be acceptable. In the meantime, you could file a ticket in rt requesting the index. -Aaron On May 12, 2014 11:13 AM,

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-12 Thread Gilles Dubuc
Thanks Aaron, I don't have access to rt itself, I've been sending requests by email before. Should this go to ops-reque...@rt.wikimedia.org or to another rt address? I was unable to find a list of those rt email addresses that I presume send the request to the right team/project in rt. On Mon,

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-12 Thread Sean Pringle
On Mon, May 12, 2014 at 8:48 PM, Gilles Dubuc gil...@wikimedia.org wrote: Which ones are your tsvs stuff? The ones I'm trying to improve are querying MediaViewer_8245578 (just grep for that on the page you've linked to, there will be some things I ran manually today, but the big queries are

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-12 Thread Gilles Dubuc
Thanks for adding that index, that's exactly what I needed. I'll update the queries to what you suggested now. I actually looked into doing exactly that change earlier today, but couldn't get it to hit the timestamp index. I wasn't specifying a value for wiki (it's one of the queries we run, the

Re: [Analytics] Adding indexes to EventLogging tables

2014-05-12 Thread Gilles Dubuc
It would be awesome if you could add a similar (wiki, timestamp) index for exactly the same reasons to all the MultimediaViewerNetworkPerformance* tables on the same database. Those tables haven't been problematic yet because they're a lot smaller, but we might as well make all Multimedia