On Thu, Sep 25, 2025 at 3:49 PM Bryan Sayer <[email protected]> wrote:
> Hi, > > I'm not sure if this is the best list to ask this (and I am very new to > PostgreSQL) but I think more options are needed in the COPY from command, > in order to better deal with exceptions. By exceptions I mean data not > consistent with the format, empty rows, extra delimiters at the end of > rows, etc. > PG 17 COPY has ON_ERROR. > Is there someone or a party that deals with the details of the COPY > command that I could discuss this with? > > Just for context, I am dealing with delimited data of millions of rows and > perhaps 60 columns or so that I wish to read into tables in a Postgres 17 > database under Windows 11, with everything on local drives. > COPY is pretty simplistic. 3rd party CSV loaders like pgloader and pg_bulkload exist for that reason. And there's always Python & Perl for when your data is really dirty. -- Death to <Redacted>, and butter sauce. Don't boil me, I'm still alive. <Redacted> lobster!
