Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

On 2/3/20 12:42 PM, Ravi Krishna wrote: "already suffering from a complex of coding in an unreadable language" hearsay and conjecture I was somewhat facetious. But what finished perl was the reputation it earned that it is a write only language. I don't think that reputation it earned is wit

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

> > "already suffering from a complex of coding in an unreadable language" > > hearsay and conjecture > I was somewhat facetious. But what finished perl was the reputation it earned that it is a write only language. I don't think that reputation it earned is without merit. IMO the early adop

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

"already suffering from a complex of coding in an unreadable language" hearsay and conjecture On 2/3/2020 8:57 AM, Ravi Krishna wrote: already suffering from a complex of coding in an unreadable language

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

El día lunes, febrero 03, 2020 a las 10:01:04a. m. -0600, Steven Lembark escribió: > On Fri, 31 Jan 2020 19:24:41 +0100 > Matthias Apitz wrote: > > > Hello, > > > > Since ages, we transfer data between different DBS (Informix, Sybase, > > Oracle, and now PostgreSQL) with our own written tool,

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

> > Depending on who wrote the code, they may have extracted the rows > as hashrefs rather than arrays; that can be a 10x slowdown right > there. [I have no idea why so many people are so addicted to storing > rows in hashes, but it is always a significant slowdown; and > array slices are no more

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

> 2. postgres has not implicit plan cache, so every INSERT planned > again and again Good point: If you are doing something in a loop you probably want to use prepare_cached() to get the $sth, for both extract and insert. -- Steven Lembark3646 Flora Pla

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

On Fri, 31 Jan 2020 19:24:41 +0100 Matthias Apitz wrote: > Hello, > > Since ages, we transfer data between different DBS (Informix, Sybase, > Oracle, and now PostgreSQL) with our own written tool, based on > Perl::DBI which produces a CSV like export in a common way, i.e. an > export of Oracle c

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

You can use COPY over DBI. https://metacpan.org/pod/DBD::Pg#COPY-support On Fri, Jan 31, 2020 at 2:03 PM Pavel Stehule wrote: > > > pá 31. 1. 2020 v 19:25 odesílatel Matthias Apitz > napsal: > >> >> Hello, >> >> Since ages, we transfer data between different DBS (Informix, Sybase, >> Oracle, a

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

pá 31. 1. 2020 v 19:25 odesílatel Matthias Apitz napsal: > > Hello, > > Since ages, we transfer data between different DBS (Informix, Sybase, > Oracle, and now PostgreSQL) with our own written tool, based on > Perl::DBI which produces a CSV like export in a common way, i.e. an > export of Oracle

Re: performance of loading CSV data with COPY is 50 times faster than Perl::DBI

On 1/31/20 10:24 AM, Matthias Apitz wrote: Hello, Since ages, we transfer data between different DBS (Informix, Sybase, Oracle, and now PostgreSQL) with our own written tool, based on Perl::DBI which produces a CSV like export in a common way, i.e. an export of Oracle can be loaded into Sybase

performance of loading CSV data with COPY is 50 times faster than Perl::DBI

Hello, Since ages, we transfer data between different DBS (Informix, Sybase, Oracle, and now PostgreSQL) with our own written tool, based on Perl::DBI which produces a CSV like export in a common way, i.e. an export of Oracle can be loaded into Sybase and vice versa. Export and Import is done ro