[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added Status|UNCONFIRMED |RESOLVED Resolution|--- |INVALID --- Comment #12 from Tim Landscheidt t...@tim-landscheidt.de --- I assume then that this (killed queries taking a long time to wind down) is not really a bug, but ... the way it is :-). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 --- Comment #8 from kolossos alder_...@hotmail.com --- After 11 days still running: tools.templatetiger@tools-login: MariaDB [(none)] show processlist; +--++---+-+-+-+---+--+--+ | Id | User | Host | db | Command | Time| State | Info | Progress | +--++---+-+-+-+---+--+--+ | 12142236 | s51071 | 10.68.17.64:38639 | s51071__templatetiger_p | Killed | 1930465 | query end | LOAD DATA LOCAL INFILE '/data/project/templatetiger/public_html/dumps/sort/enwiki-2014-04-02-lPqO.t | 50.000 | | 18335208 | s51071 | 10.68.16.7:46051 | NULL| Query | 0 | NULL | show processlist |0.000 | +--++---+-+-+-+---+--+--+ 2 rows in set (0.00 sec) -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 Tim Landscheidt t...@tim-landscheidt.de changed: What|Removed |Added Assignee|m...@uberbox.org|sprin...@wikimedia.org --- Comment #9 from Tim Landscheidt t...@tim-landscheidt.de --- Tim, just to be clear: On what DB host is this query running/hanging? Looking at /data/project/templatetiger/public_html/einspielen.sql, this seems to be tools-db? Replication for enwiki stopped on 2014-04-18 (twelve days ago) and was restarted on 2014-04-21 (nine days ago; cf. bug #64154), so this query in limbo might be related to that, thus assigning to Sean (even though I assume tools-db resides on a different DB server). -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 --- Comment #10 from kolossos alder_...@hotmail.com --- It's running on tools-db. I started it with jsub. I never restarted the query and it has no contact to the official enwiki-db because I import an extract of templates as a text-file into my project-db. Template data are not included the official enwiki-db. I got the data from checkwiki-project. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 --- Comment #11 from Sean Pringle sprin...@wikimedia.org --- tools-db is labsdb1005. It isn't a production replicant, so this is unrelated to the replication outage. LOAD DATA INFILE importing a lot of data to a transactional storage engine like InnoDB is asking for trouble because the statement is a also a transaction -- an 18GB transaction :-) That means a whole lot of undo log entries are generated in case of rollback, much purge thread lag occurs, other traffic is slowed, and if the undo log exceeds buffer pool capacity it will start thrashing the tablespace on disk. If the transaction gets killed and has to rollback the whole process will be even slower than the original load. All that can be done now is: a) Wait it out. b) Restart mysqld and hope crash recovery is faster (may not be). c) Not nice stuff that will need downtime for everyone. In the future, better to do bulk data loads into ARIA tables then ALTER them to be InnoDB if you need it specifically. Your plan to batch the inserts in 2GB chunks is also good. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 --- Comment #7 from kolossos alder_...@hotmail.com --- Process of enwiki is still there: MariaDB [(none)] show processlist; +--++---+-+-+-+---+--+--+ | Id | User | Host | db | Command | Time| State | Info | Progress | +--++---+-+-+-+---+--+--+ | 12142236 | s51071 | 10.68.17.64:38639 | s51071__templatetiger_p | Killed | 132 | query end | LOAD DATA LOCAL INFILE '/data/project/templatetiger/public_html/dumps/sort/enwiki-2014-04-02-lPqO.t | 50.000 | -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 Andre Klapper aklap...@wikimedia.org changed: What|Removed |Added CC||abog...@wikimedia.org, ||benap...@gmail.com, ||rlan...@gmail.com Component|[Other] |General Product|Tools |Wikimedia Labs Summary|Killed Mysql queries still |Killed Mysql queries still |runing |running --- Comment #6 from Andre Klapper aklap...@wikimedia.org --- https://bugzilla.wikimedia.org/describecomponents.cgi :) -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 64140] Killed Mysql queries still running
https://bugzilla.wikimedia.org/show_bug.cgi?id=64140 Liangent liang...@gmail.com changed: What|Removed |Added CC||liang...@gmail.com, ||t...@tim-landscheidt.de Component|General |tools Assignee|wikibugs-l@lists.wikimedia. |m...@uberbox.org |org | -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
