I am currently using a Perl data loader that was set up to load data to
three particular tables. The majority of this data is entered into one table.
The scripts obtain the data by parsing it out of an Excel spreadsheet.
My loads seem to take a very long time. Each file only has about 12,000 rows,
yet it takes close to 25 minutes to load one file. I have placed some
debugging syntax in the code and it seems that the extra time if related to
postgres as I had originally thought it may have to do with the parsing of the
Excel file.
I have tried turning off FSYNC but there is no difference in load time. I
also tried removing the indexes from the table in which most of the data is
loaded but no luck. By the way, is there anyway to confirm that the FSYNC option
was turned off correctly? a way to view status or something?
Any thoughts on what might be going on? another performance tuning trick
that I have not thought of?
Thanks for your help,
Jodi Kanter
_______________________________ |
- Re: [ADMIN] slow inserts Jodi Kanter
- Re: [ADMIN] slow inserts Peter Darley
- Re: [ADMIN] slow inserts Nick Fankhauser
- Re: [ADMIN] slow inserts Jodi Kanter
- Re: [ADMIN] slow inserts Rolf Luettecke
- Re: [ADMIN] slow inserts Morten Sickel
- Re: [ADMIN] slow inserts Ferdinand Smit