Re: Streaming data into Postgresql

2002-11-11 Thread Randal L. Schwartz
If this is the same posting made to perlmonks, my comment there also applies here. If you are inserting 50,000 records rapidly with Pg, *you must* use transactions. Begin a transaction block, insert 1000 records, and commit it. repeat until done. Otherwise, Pg wraps EACH AND EVERY insert in a

Streaming data into Postgresql

2002-11-07 Thread Kevin Old
Hello, I need help with the code below. It all works and the data is streamed into the database, but it takes a long time. I'm dealing with 60,000+ records that are being pulled from a continuous growing text file (that stops after the hour of data is collected). I just want to see if anyone has