As part of an archiving routine that uses SqlAlchemy, I need to execute some pretty specific commands using `\copy` to archive a selection of columns, in a special order, into a csv.
Doing some digging, psycopg2 provides an interface to `COPY` -- but that doesn't work for my needs. I'd rather not use a subprocess to handle run `\copy` in psql, because then it's not in the transaction. I'll be running this to partition 10GB of data into a lot of 10-50MB chunks... so I'd like to avoid piping this through sqlalchemy. i'm not opposed to pulling this in row-by-row, but I'd really rather avoid it. I have almost 250MM rows right now, and the future "nightly" build will be doing about 1MM at a time. Does anyone have a suggestion for a workaround? -- You received this message because you are subscribed to the Google Groups "sqlalchemy" group. To unsubscribe from this group and stop receiving emails from it, send an email to sqlalchemy+unsubscr...@googlegroups.com. To post to this group, send email to sqlalchemy@googlegroups.com. Visit this group at http://groups.google.com/group/sqlalchemy. For more options, visit https://groups.google.com/d/optout.
