[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-03-29 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Status|NEW |RESOLVED

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Status|PATCH_TO_REVIEW |NEW --- Comment

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Assignee|wikibugs-l@lists.wikimedia.

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Priority|High|Normal -- You

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #13 from Sean Pringle sprin...@wikimedia.org --- Much better than it was. I'm now trialing partitioned logging tables on one slave per production shard and directing these queries to those boxes. Since most of the queries use

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #14 from Aaron Schulz aschulz4...@gmail.com --- How many partitions per table? So the Special:Log (no filter) case will have to UNION/resort/limit queries from each partition? -- You are receiving this mail because: You are on the

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #15 from Sean Pringle sprin...@wikimedia.org --- 16 partitions, a number chosen after some rough back-of-napkin style calculations for the larger wikis. The effect of accessing multiple partitions is closest to UNION. I don't

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2014-01-09 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #16 from Aaron Schulz aschulz4...@gmail.com --- 16 looks reasonable, I just wouldn't want something crazy like 256 ;) -- You are receiving this mail because: You are on the CC list for the bug.

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #7 from Aaron Schulz aschulz4...@gmail.com --- Though actually doesn't change_tag also have similar poor cardinality problems for the log_id index? -- You are receiving this mail because: You are the assignee for the bug. You are

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #8 from Sean Pringle sprin...@wikimedia.org --- True, ct_log_id cardinality still isn't brilliant, but it's better than ts_log_id. The index is one that fluctuates cardinality estimates quite a bit between slaves, requiring

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #9 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 95584 merged by Springle: Changed use of tag_summary to use change_tag with GROUP_CONCAT() https://gerrit.wikimedia.org/r/95584 -- You are receiving this mail

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #10 from Aaron Schulz aschulz4...@gmail.com --- Which slow queries are *not* filtering on user ID? I thought that is where the slow queries still mostly happen. -- You are receiving this mail because: You are the assignee for the

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #11 from Sean Pringle sprin...@wikimedia.org --- You're right, most of the slow queries we've seen in spikes do filter by log_user. But there are others that don't that also run slow. Ishmael, S3, db1003: /*

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Status|RESOLVED|REOPENED

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Version|1.21.1 |1.23-git --

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #5 from Sean Pringle sprin...@wikimedia.org --- Possibilities after talking with Aaron on IRC, assuming group_concat can be sorted in MW code for pg... Using change_tag instead of tag_summary avoids the poor cardinality of

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|REOPENED

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-11-14 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #6 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 95584 had a related patch set uploaded by Aaron Schulz: Changed use of tag_summary to use change_tag with GROUP_CONCAT() https://gerrit.wikimedia.org/r/95584 --

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-10-16 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Sean Pringle sprin...@wikimedia.org changed: What|Removed |Added Status|NEW |RESOLVED

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-10-11 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Nemo federicol...@tiscali.it changed: What|Removed |Added CC||aschulz4...@gmail.com

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-09-19 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 --- Comment #1 from Sean Pringle sprin...@wikimedia.org --- Similar: SELECT /* IndexPager::buildQueryInfo (contributions page unfiltered) AstroChemist */

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-09-17 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Rainer Rillke @commons.wikimedia rainerril...@hotmail.com changed: What|Removed |Added See Also|

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-09-17 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Nemo federicol...@tiscali.it changed: What|Removed |Added Priority|Normal |High

[Bug 53577] IndexPager::buildQueryInfo (LogPager) query needs tuning

2013-09-02 Thread bugzilla-daemon
https://bugzilla.wikimedia.org/show_bug.cgi?id=53577 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added Keywords||performance