[GENERAL] Insert statements really slow

2007-11-09 Thread Waller, David
I have an application that I am porting from MySQL to PostgreSQL and I am working on the import Perl script that process the data. The data is web log data and each line has a variable amount of the fields (mostly because of cookies) so I am using a lot of insert statements. In MySQL I go throu

Re: [GENERAL] Insert statements really slow

2007-11-09 Thread Andrew Sullivan
On Fri, Nov 09, 2007 at 11:53:08AM -0600, Waller, David wrote: > The data is web log data and each line has a variable amount of the > fields (mostly because of cookies) so I am using a lot of insert > statements. > > In MySQL I go through a file in about 2 minutes and it is taking about > 30 in

Re: [GENERAL] Insert statements really slow

2007-11-09 Thread Scott Marlowe
On Nov 9, 2007 11:53 AM, Waller, David <[EMAIL PROTECTED]> wrote: > > In MySQL I go through a file in about 2 minutes and it is taking about 30 in > PG. I have removed all but the primary key index and have done a BEGIN and > COMMIT after turning off AUTOCOMMIT. How many rows are you wrapping in

Re: [GENERAL] Insert statements really slow

2007-11-13 Thread Merlin Moncure
On Nov 9, 2007 12:53 PM, Waller, David <[EMAIL PROTECTED]> wrote: > I have an application that I am porting from MySQL to PostgreSQL and I am > working on the import Perl script that process the data. > > The data is web log data and each line has a variable amount of the fields > (mostly because o

Re: [GENERAL] Insert statements really slow

2007-11-14 Thread Waller, David
: Waller, David Cc: pgsql-general@postgresql.org Subject: Re: [GENERAL] Insert statements really slow On Nov 9, 2007 12:53 PM, Waller, David <[EMAIL PROTECTED]> wrote: > I have an application that I am porting from MySQL to PostgreSQL and I > am working on the import Perl script that proc