You can also set the bulk_insert_buffer_size=, based
on available RAM.
This would improve bulk insert on myisam tables.
regards
anandkl
On 7/26/08, mos <[EMAIL PROTECTED]> wrote:
>
> At 06:46 PM 7/25/2008, you wrote:
>
>> List,
>>
>> I am bulk inserting a huge amount of data into a MyISAM table
At 06:46 PM 7/25/2008, you wrote:
List,
I am bulk inserting a huge amount of data into a MyISAM table (a
wikipedia page dump).
Before I issued SOURCE filename.sql; I did an ALTER TABLE page DISABLE
KEYS; LOCK TABLES page WRITE;
The dump consists of about 1,200 bulk INSERT statements with roughly
List,
I am bulk inserting a huge amount of data into a MyISAM table (a
wikipedia page dump).
Before I issued SOURCE filename.sql; I did an ALTER TABLE page DISABLE
KEYS; LOCK TABLES page WRITE;
The dump consists of about 1,200 bulk INSERT statements with roughly
12,000 tuples each.
For the
Hi,
My software use to run with mySQL 4.1, but now i have to use some of the new
features of mySQL 5.0 i did dump all databases, uninistalled mysql4.1,
installed the mysql5.0 and start loading the .sql file. This operation use
to take about 4 hours but know it is taking 1day!!! Did anything hap
I need some help with improving INSERT performance. I am using JDBC. I
have minimized my indices as much as I can, changed to use batching, and
setup a thread pool for each transacted batch. Note that I am only using
InnoDB.
Now I am wondering what can be tweaked in the server properties. Right
-
From: <[EMAIL PROTECTED]>
Newsgroups: mailing.database.myodbc
Sent: Tuesday, January 31, 2006 8:01 PM
Subject: Re: Insert performance
--=_alternative 0062A2DC85257107_=
Content-Type: text/plain; charset="US-ASCII"
Imran Chaudhry <[EMAIL PROTECTED]> wrote on 01/31/2
Hi you could try:
1. disable autocommit while inserting those records, then commit after
finished.
2. You could try insert multiple column like this
insert into tableX values (a,b,c), (c,d,e), (e,f,g) ...
CMIIW
Vinay wrote:
I am using mysql5.0 on Hp-UX. IT took about 14 hours to in
Imran Chaudhry <[EMAIL PROTECTED]> wrote on 01/31/2006 12:44:17 PM:
> > I am using mysql5.0 on Hp-UX. IT took about 14 hours to insert 1.7
> millin records. How do I make >my insert run faster.The table has
> three foreign key references and the referencing columns are
> >indexed . Is that impac
> I am using mysql5.0 on Hp-UX. IT took about 14 hours to insert 1.7 millin
> records. How do I make >my insert run faster.The table has three foreign key
> references and the referencing columns are >indexed . Is that impacting the
> insert statement performance.
Just thought I'd add a little
Indexes slow down inserts, updates (if the indexed column is being updated),
and deletes.
If this is a data-refresh, consider dropping the indexes, importing the data,
and then indexing the table.
You haven't mentioned how you are getting the data into the database? Is this a bulk-load? Insert
"Vinay" <[EMAIL PROTECTED]> wrote on 01/31/2006 11:42:51 AM:
> I am using mysql5.0 on Hp-UX. IT took about 14 hours to insert 1.7
> millin records. How do I make my insert run faster.The table has
> three foreign key references and the referencing columns are indexed
> . Is that impacting the in
the indexes would significantly slow down the inserts, also are you doing
the insert from a sql script, if so you couldtry this
Wrapping your very long insert script in as follows
set autocommit = 0 ;
begin ;
[[thousands of inserts here]]
commit ;
If you use the *mysqldump* option --opt, you g
I am using mysql5.0 on Hp-UX. IT took about 14 hours to insert 1.7 millin
records. How do I make my insert run faster.The table has three foreign key
references and the referencing columns are indexed . Is that impacting the
insert statement performance.
Thanks for the help
Vinay
Please, sorry for a delayed reply. In my previous mail I've asked
you include the output of 'show variables' statement, so please
do it in your next message. I'd like (and probably others on
the list) to see your settings. Also, perform the 'show status' just
after t
what does the JDBC code look like that your using to do the inserts?
On Fri, 2005-11-11 at 13:56 -0800, Dhiren Bhatia wrote:
> Any ideas on how I can optimize this? Thanks.
>
> On 11/9/05, Dhiren Bhatia <[EMAIL PROTECTED]> wrote:
> >
> > This is on a development box, 1.5 GB RAM, 1CPU (1.6GHz) wi
Any ideas on how I can optimize this? Thanks.
On 11/9/05, Dhiren Bhatia <[EMAIL PROTECTED]> wrote:
>
> This is on a development box, 1.5 GB RAM, 1CPU (1.6GHz) with the app
> server & database server running on the same box. I'm using the Tomcat
> Database Connection Pool to get a JDBC connection
This is on a development box, 1.5 GB RAM, 1CPU (1.6GHz) with the app server
& database server running on the same box. I'm using the Tomcat Database
Connection Pool to get a JDBC connection and insert the data. I dont have
too much free disk space on this machine (approx 2GB). At the time of the
in
Hello.
As others suggest send the 'CREATE' statement for your table, and,
please, include the output of :
'show status';
'show variables';
> How long should it take to insert approx 30,000 rows into MySQL. It
> takes me
> about 30 mins. I'm using version 4.1.10-nt. Any ideas?
That seems like a long time. Although I don't know how much data you
are importing, how many indexes you have on the database, memory,
etc. How you are going about importing can affect your speed
dramatically. If you are importing a tab delimited (or other
delimination) file, you should get
> How long should it take to insert approx 30,000 rows into MySQL.
Depends on the data and field structure. Do you have lots of indexes
on the table?
>It takes me about 30 mins.
There are some tips at http://dev.mysql.com/doc/refman/4.1/en/insert-speed.html
--
Scott Noyes
[EMAIL PROTECTED]
--
How long should it take to insert approx 30,000 rows into MySQL. It takes me
about 30 mins. I'm using version 4.1.10-nt. Any ideas?
Thanks,
Dhiren
Hi,
I am trying to find out that if I have a table without any Foreign keys and
I am doing a lot of Inserts to it, should the performance be different if I
have indexes or not? If I don't have any indexes, shouldn't I expect the
performance for the Inserts to be better than it would be if I had
Mikko Noromaa" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Monday, June 03, 2002 9:11 AM
Subject: INSERT performance when indexes are used
> Hi,
>
> I have a table with about 5 million records, and an index on that
> table's VARCHAR(255) field, as well as a c
Hi,
I have a table with about 5 million records, and an index on that
table's VARCHAR(255) field, as well as a couple of integer indexes. The
VARCHAR-index is essential to my application as I frequently need to
search through the whole table by using the VARCHAR field.
When I do INSERTs into thi
Hi,
I have a table with about 5 million records, and an index on that
table's VARCHAR(255) field, as well as a couple of integer indexes. The
VARCHAR-index is essential to my application as I frequently need to
search through the whole table by using the VARCHAR field.
When I do INSERTs into thi
25 matches
Mail list logo
