Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-30 Thread Bernhard Ströbl via QGIS-User
Hi Björn, yes that works. Only challenge is that you have to tell the algorithm which geometry type the data is, whereas QGIS' native PostGIS writer does check that for itself and use an appropriate one. Being not able to tell beforehand I established a geometry filter and use the multi type

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-30 Thread pathmapper via QGIS-User
Hi Bernhard, not sure about the native "Export to PostgreSQL" algorithm, but there's also a GDAL alg "Export to PostgreSQL (new connection)" which allows to configure the DB access. Using this one in your model should do the trick.. Cheers, Björn On 30.05.2024 08:47, Bernhard Ströbl via

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-30 Thread Bernhard Ströbl via QGIS-User
Hello everybody, I did some experiments in the last couple days and your help was very valuable. I succeeded in creating two models that - when run within QGIS or from the console - download data of different types and write it into a PostgreSQL database. For automation purposes I want to run

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-22 Thread Bernhard Ströbl via QGIS-User
Hi Germán, thank you for your answer. That will definitely solve part of my needs. all the best Bernhard > Germán Carrillo hat am 22.05.2024 23:30 CEST > geschrieben: > > > Hi All, > > have a look at: > > https://github.com/gacarrillor/AppendFeaturesToLayer > > It has ready-to-use

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-22 Thread Bernhard Ströbl via QGIS-User
Hi Etienne, I did read the docs, but that particular chapter slipped my attention, so thank you for nudging me. Seems like exactly what I might need. Bernhard > Etienne Trimaille hat am 22.05.2024 19:19 CEST > geschrieben: > > > Hi, > >

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-22 Thread Germán Carrillo via QGIS-User
Hi All, have a look at: https://github.com/gacarrillor/AppendFeaturesToLayer It has ready-to-use models to perform transform and upsert (update or insert) operations. You can run it via standalone processing (Python) scripts or via QGIS Process. Regards, Germán El mié, 22 may 2024 a las

Re: [Qgis-user] Using Processing for nightly ETL jobs

2024-05-22 Thread Etienne Trimaille via QGIS-User
Hi, https://docs.qgis.org/3.34/en/docs/user_manual/processing/standalone.html Le mer. 22 mai 2024 à 18:52, NOSPAM via QGIS-User a écrit : > Dear List, > > has anybody already used QGIS' processing framework for performing > nightly ETL jobs? > > I need to have nightly jobs run that > 1)

[Qgis-user] Using Processing for nightly ETL jobs

2024-05-22 Thread NOSPAM via QGIS-User
Dear List, has anybody already used QGIS' processing framework for performing nightly ETL jobs? I need to have nightly jobs run that 1) download data (e.g. from a WFS server), 2) perform some tasks like renaming fields or the like 3) and finally load them into a PostGIS database. My idea