Hi, PgLoader is the python ETL tool for PostgreSQL, supporting a lot of (possibly convoluted) input formats, and able to load files in parallel. Either loading several files at once (each in its own PG connection) or the same file in several connections (two collaborative models implemented). http://pgloader.projects.postgresql.org/
This new version of pgloader has seen some testing of max_parallel_sections setting, a user was able to load 1000 files using 10 parallel sections. Version 2.3.1 also supports fixed file format, where no field separator exists but each field length is known (and fixed). This premature support does not offer any facility for stripping (left, right or both), I'll work on this if there's any demand. The changelog also misses to specify escape characters are now supported for configuring field_sep, such as \t for example. Regards, -- dim
signature.asc
Description: This is a digitally signed message part.
