Re: Specific benchmarking tool
Johan, Yes, there are built in parsers for different formats, for example I was using the general log. mk-log-player --split Thread_id --type genlog (genlog was added the other day and is only in trunk so far) http://www.maatkit.org/doc/mk-log-player.html --type type: string; group: Split The type of log to --split (default slowlog). The permitted types are binlog Split a binary log file. slowlog Split a log file in any varation of MySQL slow-log format. Cheers, Ewen On Tue, Nov 24, 2009 at 2:41 PM, Johan De Meersman vegiv...@tuxera.be wrote: Ewen, Do you need a specific log format or setting ? I'm debugging the tool, and it uses ;\n# as record separator, which is entirely not consistent with the log format I get out of the mysql log. Does it perchance try to parse zero-execution-time slowlogs instead of the regular log ? On Sat, Nov 14, 2009 at 1:23 AM, Johan De Meersman vegiv...@tuxera.be wrote: hmm, I got segfaults. i,ll check after the weekend. On 11/13/09, ewen fortune ewen.fort...@gmail.com wrote: Johan, What does? mk-log-player? - I just used it to split and play back 8G, no problem. Ewen On Fri, Nov 13, 2009 at 6:20 PM, Johan De Meersman vegiv...@tuxera.be wrote: It seems to have a problem with multi-gigabyte files :-D On Fri, Nov 13, 2009 at 5:35 PM, Johan De Meersman vegiv...@tuxera.be wrote: Ooo, shiny ! Thanks, mate :-) On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune ewen.fort...@gmail.com wrote: Johan, The very latest version of mk-log-player can do that. If you get the version from trunk: wget http://www.maatkit.org/trunk/mk-log-player mk-log-player --split Thread_id --type genlog Cheers, Ewen On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: Specific benchmarking tool
Yeah, I figured that out in the mean time :-) I was putting the log type right after --split, and the damn thing doesn't think of throwing an 'unknown field' error :-) It's working now, thanks a lot ! On Tue, Nov 24, 2009 at 8:27 PM, ewen fortune ewen.fort...@gmail.comwrote: Johan, Yes, there are built in parsers for different formats, for example I was using the general log. mk-log-player --split Thread_id --type genlog (genlog was added the other day and is only in trunk so far) http://www.maatkit.org/doc/mk-log-player.html --type type: string; group: Split The type of log to --split (default slowlog). The permitted types are binlog Split a binary log file. slowlog Split a log file in any varation of MySQL slow-log format. Cheers, Ewen On Tue, Nov 24, 2009 at 2:41 PM, Johan De Meersman vegiv...@tuxera.be wrote: Ewen, Do you need a specific log format or setting ? I'm debugging the tool, and it uses ;\n# as record separator, which is entirely not consistent with the log format I get out of the mysql log. Does it perchance try to parse zero-execution-time slowlogs instead of the regular log ? On Sat, Nov 14, 2009 at 1:23 AM, Johan De Meersman vegiv...@tuxera.be wrote: hmm, I got segfaults. i,ll check after the weekend. On 11/13/09, ewen fortune ewen.fort...@gmail.com wrote: Johan, What does? mk-log-player? - I just used it to split and play back 8G, no problem. Ewen On Fri, Nov 13, 2009 at 6:20 PM, Johan De Meersman vegiv...@tuxera.be wrote: It seems to have a problem with multi-gigabyte files :-D On Fri, Nov 13, 2009 at 5:35 PM, Johan De Meersman vegiv...@tuxera.be wrote: Ooo, shiny ! Thanks, mate :-) On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune ewen.fort...@gmail.com wrote: Johan, The very latest version of mk-log-player can do that. If you get the version from trunk: wget http://www.maatkit.org/trunk/mk-log-player mk-log-player --split Thread_id --type genlog Cheers, Ewen On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=vegiv...@tuxera.be
Specific benchmarking tool
Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan
Re: Specific benchmarking tool
take a look at mysqlslap: http://dev.mysql.com/doc/refman/5.1/en/mysqlslap.html Walter On Fri, Nov 13, 2009 at 22:33, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: Specific benchmarking tool
Johan, The very latest version of mk-log-player can do that. If you get the version from trunk: wget http://www.maatkit.org/trunk/mk-log-player mk-log-player --split Thread_id --type genlog Cheers, Ewen On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=arch...@jab.org
Re: Specific benchmarking tool
I did :-) Maybe I missed it, but I didn't see any option that suggests mysqlslap can easily replay a query log ? On Fri, Nov 13, 2009 at 4:50 PM, Walter Heck - OlinData.com li...@olindata.com wrote: take a look at mysqlslap: http://dev.mysql.com/doc/refman/5.1/en/mysqlslap.html Walter On Fri, Nov 13, 2009 at 22:33, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/mysql?unsub=vegiv...@tuxera.be
Re: Specific benchmarking tool
Ooo, shiny ! Thanks, mate :-) On Fri, Nov 13, 2009 at 4:56 PM, ewen fortune ewen.fort...@gmail.comwrote: Johan, The very latest version of mk-log-player can do that. If you get the version from trunk: wget http://www.maatkit.org/trunk/mk-log-player mk-log-player --split Thread_id --type genlog Cheers, Ewen On Fri, Nov 13, 2009 at 4:33 PM, Johan De Meersman vegiv...@tuxera.be wrote: Hey all, I'm looking for a Mysql benchmarking/stresstesting tool that can generate a workload based on standard Mysql full query log files. The idea is to verify performance of real production loads on various database setups. Does anyone know of such a tool, free or paying ? Thx, Johan
