Re: Very slow inserts into InnoDB tables

2008-06-15 Thread Nick Adams
hdparm -Tt /dev/sdX ? Ian Simpson wrote: That's pretty much what I've been doing to get that the drive is running at 100% bandwidth. What I'd like is something that just gives the bandwidth of the device in terms of Mb/s: you can probably work it out using that iostat command, seeing how

Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi list, Have a bit of a mystery here that I hope somebody can help with. I've just got a new server that I'm using as a dedicated MySQL server. In terms of hardware it's pretty much identical, if not slightly superior to an existing server already in production use. It's having a real struggle

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
Please check if the my.cnf configurations to be the same. What are your configuration parameters in terms of innodh flush log trx commit , bin logging, sync binlog and innodb unsafe for binlog ? If the systems have raid, check if the BBWC is enabled on the new host and WB is enabled. On Fri,

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Alex, Configurations are identical, other than the differences I initially mentioned. I've diffed both the configuration files and the output of SHOW VARIABLES on both servers. I've contacted my hosting provider to ask about the RAID settings. Variable_name: innodb_flush_log_at_trx_commit

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ananda Kumar
check for iostat to see if the disk is heavly used. On 6/13/08, Ian Simpson [EMAIL PROTECTED] wrote: Hi Alex, Configurations are identical, other than the differences I initially mentioned. I've diffed both the configuration files and the output of SHOW VARIABLES on both servers. I've

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
also how often do you issue a commit. batching the inserts inside a transaction might help. On Fri, Jun 13, 2008 at 6:53 PM, Ananda Kumar [EMAIL PROTECTED] wrote: check for iostat to see if the disk is heavly used. On 6/13/08, Ian Simpson [EMAIL PROTECTED] wrote: Hi Alex, Configurations

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi guys, thanks for pitching in. The inserts are from replication; we're not using transactions on the master (yet), and I don't think there's a way of telling MySQL to batch incoming replication statements if they're not already in a transaction. Disk usage: the older server (the one that's

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
replication based inserts are serial whereas most of the time the inserts on masters are concurrent. this leads to the slaves falling behind. to tackle this we have used the following strategies : 1. Use raid 0 on the slaves (master users raid 10) so as to speed up writes. 2. pre fetch and cache

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Jerry Schwartz
Disk usage: the older server (the one that's running fine) is running more transactions per second, but has lower blocks written and read per second than the new server: [JS] That, to me, suggests that the difference might be in the way the systems themselves are configured. Unfortunately, I

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Guys, Having delved a little more into the capabilities of iostat, I've discovered that the drive bandwidth seems to be maxed out while MySQL is running, which I'd peg as the primary candidate for the problem. Looks like I'll be having more words with my hosting company about this... Thanks

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Jerry Schwartz
Having delved a little more into the capabilities of iostat, I've discovered that the drive bandwidth seems to be maxed out while MySQL is running, which I'd peg as the primary candidate for the problem. [JS] That suggests even more strongly that there is a difference in the kernel configuration.

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Jerry, It could be a kernel issue; however, currently I'm suspecting that the drive in the new server simply doesn't have the same bandwidth capability. The iostat results I'm getting (although I'm not an expert in reading them, having only learned of it about 3 hours ago) suggest that the

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Wm Mussatto
On Fri, June 13, 2008 08:26, Ian Simpson wrote: Hi Jerry, It could be a kernel issue; however, currently I'm suspecting that the drive in the new server simply doesn't have the same bandwidth capability. The iostat results I'm getting (although I'm not an expert in reading them, having only

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
That's pretty much what I've been doing to get that the drive is running at 100% bandwidth. What I'd like is something that just gives the bandwidth of the device in terms of Mb/s: you can probably work it out using that iostat command, seeing how much it wrote and what percentage of the

Re: very slow inserts on InnoDB [InnoDB Performance Tuning]

2005-07-26 Thread Josh Chamas
Hi Catalin, Here are some InnoDB performance tuning tips that may boost your insert speed: Catalin Trifu wrote: ... innodb_buffer_pool_size = 256M Higher is better, in fact pushing this up to 60%-80% on a dedicated database would be good. If there are other things running like a web server,

very slow inserts on InnoDB

2005-07-25 Thread Catalin Trifu
Hi, I have the following table : CREATE TABLE `raw_outgoing_sms` ( `id` bigint(20) NOT NULL auto_increment, `id_gsm_operator` bigint(20) NOT NULL default '0', `id_shortcode` bigint(20) NOT NULL default '0', `msisdn` varchar(20) NOT NULL default '', `sender`

Re: very slow inserts on InnoDB

2005-07-25 Thread SGreen
news [EMAIL PROTECTED] wrote on 07/25/2005 10:41:46 AM: Hi, I have the following table : CREATE TABLE `raw_outgoing_sms` ( `id` bigint(20) NOT NULL auto_increment, `id_gsm_operator` bigint(20) NOT NULL default '0', `id_shortcode` bigint(20) NOT NULL default '0',

Re: very slow inserts on InnoDB

2005-07-25 Thread Devananda
Catalin, I was able to create the table with the CREATE statement you pasted, and insert a row with some simple data. mysql insert into raw_outgoing_sms (id_gsm_operator,id_shortcode,msisdn,sender,text,dlr_url) values (10,20,'19284720','deva','hello world','yahoo.com'); Query OK, 1 row

Re: very slow inserts on InnoDB

2005-07-25 Thread Catalin Trifu
Hi, Thanks for the reply. The setup is the following: Dual Processor SuSE 9.0 (kernel 2.4.21 SMP), apache 2.0.54, php 5.0.4, mysql-4.1.12 (RPM), 2GB RAM, 80GB scsi RAID 5 The database config file is this one: [mysqld] port= 3306 socket =