Re: [GENERAL] Insert statements really slow

[Waller, David]

I have found some errors in my perl script that was slowing everything
down.  I too am now seeing similar speed between postgresql and mysql.

Sorry for the confusion.

Dave 

-Original Message-
From: Merlin Moncure [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, November 13, 2007 8:44 PM
To: Waller, David
Cc: pgsql-general@postgresql.org
Subject: Re: [GENERAL] Insert statements really slow

On Nov 9, 2007 12:53 PM, Waller, David [EMAIL PROTECTED] wrote:
 I have an application that I am porting from MySQL to PostgreSQL and I

 am working on the import Perl script that process the data.

 The data is web log data and each line has a variable amount of the 
 fields (mostly because of cookies) so I am using a lot of insert
statements.

 In MySQL I go through a file in about 2 minutes and it is taking about

 30 in PG.  I have removed all but the primary key index and have done 
 a BEGIN and COMMIT after turning off AUTOCOMMIT.

can you give us a better idea of the # records/sec we are talking about
here?  mysql and pg are usually pretty close in insert performance.
maybe there is something fishy going on.

merlin

---(end of broadcast)---
TIP 3: Have you checked our extensive FAQ?

   http://www.postgresql.org/docs/faq

[GENERAL] Insert statements really slow

[Waller, David]

I have an application that I am porting from MySQL to PostgreSQL and I
am working on the import Perl script that process the data.
 
The data is web log data and each line has a variable amount of the
fields (mostly because of cookies) so I am using a lot of insert
statements.
 
In MySQL I go through a file in about 2 minutes and it is taking about
30 in PG.  I have removed all but the primary key index and have done a
BEGIN and COMMIT after turning off AUTOCOMMIT.
 
What other things should I be looking at to spped this up?
 
Dave Waller