Slow inserts after moving to new system

2013-11-25 Thread Michael Stroh
I recently moved to a new web server (running 5.5.32) on one of my production systems. The new server has more RAM, faster CPU, etc so we see queried results a lot quicker. However, with basically the default my.cnf config file on each system, we see simple inserts taking about 10x longer than o

Re: Very slow inserts into InnoDB tables

2008-06-15 Thread Nick Adams
hdparm -Tt /dev/sdX ? Ian Simpson wrote: That's pretty much what I've been doing to get that the drive is running at 100% bandwidth. What I'd like is something that just gives the bandwidth of the device in terms of Mb/s: you can probably work it out using that iostat command, seeing how mu

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
That's pretty much what I've been doing to get that the drive is running at 100% bandwidth. What I'd like is something that just gives the bandwidth of the device in terms of Mb/s: you can probably work it out using that iostat command, seeing how much it wrote and what percentage of the bandwidth

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Wm Mussatto
On Fri, June 13, 2008 08:26, Ian Simpson wrote: > Hi Jerry, > > It could be a kernel issue; however, currently I'm suspecting that the > drive in the new server simply doesn't have the same bandwidth > capability. The iostat results I'm getting (although I'm not an expert > in reading them, having

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Jerry, It could be a kernel issue; however, currently I'm suspecting that the drive in the new server simply doesn't have the same bandwidth capability. The iostat results I'm getting (although I'm not an expert in reading them, having only learned of it about 3 hours ago) suggest that the olde

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Jerry Schwartz
>Having delved a little more into the capabilities of iostat, I've >discovered that the drive bandwidth seems to be maxed out while MySQL is >running, which I'd peg as the primary candidate for the problem. [JS] That suggests even more strongly that there is a difference in the kernel configuratio

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Guys, Having delved a little more into the capabilities of iostat, I've discovered that the drive bandwidth seems to be maxed out while MySQL is running, which I'd peg as the primary candidate for the problem. Looks like I'll be having more words with my hosting company about this... Thanks f

RE: Very slow inserts into InnoDB tables

2008-06-13 Thread Jerry Schwartz
>Disk usage: the older server (the one that's running fine) is running >more transactions per second, but has lower blocks written and read per >second than the new server: [JS] That, to me, suggests that the difference might be in the way the systems themselves are configured. Unfortunately, I do

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
replication based inserts are serial whereas most of the time the inserts on masters are concurrent. this leads to the slaves falling behind. to tackle this we have used the following strategies : 1. Use raid 0 on the slaves (master users raid 10) so as to speed up writes. 2. pre fetch and cache

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi guys, thanks for pitching in. The inserts are from replication; we're not using transactions on the master (yet), and I don't think there's a way of telling MySQL to batch incoming replication statements if they're not already in a transaction. Disk usage: the older server (the one that's runn

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
also how often do you issue a commit. batching the inserts inside a transaction might help. On Fri, Jun 13, 2008 at 6:53 PM, Ananda Kumar <[EMAIL PROTECTED]> wrote: > check for iostat to see if the disk is heavly used. > > On 6/13/08, Ian Simpson <[EMAIL PROTECTED]> wrote: >> >> Hi Alex, >> >> Co

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ananda Kumar
check for iostat to see if the disk is heavly used. On 6/13/08, Ian Simpson <[EMAIL PROTECTED]> wrote: > > Hi Alex, > > Configurations are identical, other than the differences I initially > mentioned. I've diffed both the configuration files and the output of > SHOW VARIABLES on both servers. > >

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi Alex, Configurations are identical, other than the differences I initially mentioned. I've diffed both the configuration files and the output of SHOW VARIABLES on both servers. I've contacted my hosting provider to ask about the RAID settings. Variable_name: innodb_flush_log_at_trx_commit

Re: Very slow inserts into InnoDB tables

2008-06-13 Thread Alex Arul Lurthu
Please check if the my.cnf configurations to be the same. What are your configuration parameters in terms of innodh flush log trx commit , bin logging, sync binlog and innodb unsafe for binlog ? If the systems have raid, check if the BBWC is enabled on the new host and WB is enabled. On Fri, J

Very slow inserts into InnoDB tables

2008-06-13 Thread Ian Simpson
Hi list, Have a bit of a mystery here that I hope somebody can help with. I've just got a new server that I'm using as a dedicated MySQL server. In terms of hardware it's pretty much identical, if not slightly superior to an existing server already in production use. It's having a real struggle

Re: very slow inserts on InnoDB [InnoDB Performance Tuning]

2005-07-26 Thread Josh Chamas
Hi Catalin, Here are some InnoDB performance tuning tips that may boost your insert speed: Catalin Trifu wrote: ... innodb_buffer_pool_size = 256M Higher is better, in fact pushing this up to 60%-80% on a dedicated database would be good. If there are other things running like a web server,

Re: very slow inserts on InnoDB

2005-07-25 Thread Catalin Trifu
Hi, Thanks for the reply. The setup is the following: Dual Processor SuSE 9.0 (kernel 2.4.21 SMP), apache 2.0.54, php 5.0.4, mysql-4.1.12 (RPM), 2GB RAM, 80GB scsi RAID 5 The database config file is this one: [mysqld] port= 3306 socket = /var/li

Re: very slow inserts on InnoDB

2005-07-25 Thread Devananda
Catalin, I was able to create the table with the CREATE statement you pasted, and insert a row with some simple data. mysql> insert into raw_outgoing_sms (id_gsm_operator,id_shortcode,msisdn,sender,text,dlr_url) values (10,20,'19284720','deva','hello world','yahoo.com'); Query OK, 1 row aff

Re: very slow inserts on InnoDB

2005-07-25 Thread SGreen
news <[EMAIL PROTECTED]> wrote on 07/25/2005 10:41:46 AM: > Hi, > > > I have the following table : > > CREATE TABLE `raw_outgoing_sms` ( >`id` bigint(20) NOT NULL auto_increment, >`id_gsm_operator` bigint(20) NOT NULL default '0', >`id_shortcode` bigint(20) NOT NULL defa

very slow inserts on InnoDB

2005-07-25 Thread Catalin Trifu
Hi, I have the following table : CREATE TABLE `raw_outgoing_sms` ( `id` bigint(20) NOT NULL auto_increment, `id_gsm_operator` bigint(20) NOT NULL default '0', `id_shortcode` bigint(20) NOT NULL default '0', `msisdn` varchar(20) NOT NULL default '', `sender` varcha

RE: Slow Inserts

2003-03-27 Thread Dan Wright
in to all. This is very educational. Dan > -Original Message- > From: Brian McCain [mailto:[EMAIL PROTECTED] > Sent: Thursday, March 27, 2003 7:22 PM > To: Dan Wright; [EMAIL PROTECTED] > Subject: Re: Slow Inserts > > > I had a very similar problem a couple weeks ago, a

Re: Slow Inserts

2003-03-27 Thread Brian McCain
CTED]> To: "Victor Pendleton" <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]> Sent: Thursday, March 27, 2003 1:50 PM Subject: RE: Slow Inserts > I've tried it both as fixed (char) and variable (varchar). Interestingly > when I set is as char when building the table, M

RE: Slow Inserts

2003-03-27 Thread Jennifer Goodie
>I've tried it both as fixed (char) and variable (varchar). Interestingly >when I set is as char when building the table, MySQL changes it to varchar >sometimes (but not always). It will change a char to varchar if there is another column of variable size in the table. -- MySQL General Mailing

RE: Slow Inserts

2003-03-27 Thread Victor Pendleton
What does the table DDL look like. Is the table a fixed or dynamic format? -Original Message- From: Dan Wright [mailto:[EMAIL PROTECTED] Sent: Thursday, March 27, 2003 11:08 AM To: [EMAIL PROTECTED] Subject: Slow Inserts I've been having trouble with some large tables getting what

RE: Slow Inserts

2003-03-27 Thread William R. Mussatto
eas I'm getting. > Thanks to all that are consider the issues I'm having. > > Dan > > -Original Message- > From: Victor Pendleton [mailto:[EMAIL PROTECTED] > Sent: Thursday, March 27, 2003 4:40 PM > To: 'Dan Wright'; [EMAIL PROTECTED] > Subject: RE: S

RE: Slow Inserts

2003-03-27 Thread Dan Wright
EMAIL PROTECTED] Sent: Thursday, March 27, 2003 4:40 PM To: 'Dan Wright'; [EMAIL PROTECTED] Subject: RE: Slow Inserts What does the table DDL look like. Is the table a fixed or dynamic format? -Original Message- From: Dan Wright [mailto:[EMAIL PROTECTED] Sent: Thursday, March 27,

Slow Inserts

2003-03-27 Thread Dan Wright
I've been having trouble with some large tables getting what seems to be corrupted. Here's the situation: I have several tables that have 3 million to as much as 7 million records. I have a process that I run against those tables that pulls out a record based on specific criteria (select id,name f

Re: Performance issue: slow inserts

2002-08-22 Thread Brian Moon
ROTECTED]> To: <[EMAIL PROTECTED]> Sent: Thursday, August 22, 2002 4:22 AM Subject: Performance issue: slow inserts | | I have a lot of tables, and not all of them are filled | equally. | Inserts to tables that have a lot of entries(see the | count below), take a long time (about .06 se

Performance issue: slow inserts

2002-08-22 Thread moka
I have a lot of tables, and not all of them are filled equally. Inserts to tables that have a lot of entries(see the count below), take a long time (about .06 secs on the average in mysql, over 0.09-0.1 in DBI), for example mysql> INSERT INTO T1 VALUES ('3CCF571C1A88118801040302','072','

slow inserts and selects for fulltext indexes (mysql4)

2002-03-20 Thread Mark Maunder
Hi, Is there a way to speed up inserts on a table with three fulltext indexes? I'm using the multiple value insert format like: insert into blah (field1, field2) values ('val1', 'val2'), ('val2', 'val3'), etc.. Perhaps this is a bug in the current mysql4 bk snapshot, but inserts and selects on a