I've found some more information that seems to confirm my suspicion.
The connection is not persistent between the pg_preoperator step and the
copy_expert one.
There's a suggestion to make persistence a property of the connection:
https://stackoverflow.com/questions/50858770/airflow-retain-the-sam
No problem.
Thanks for the link, I was able to create a plugin and an operator that do
almost what I want.
My only issue is regarding the temp table, because it's not available when
I call copy_expert. So it seems to me that's not the same session as the
one that created the temp table previously
Using Airflow plugins, maybe you should take a look at
https://airflow.apache.org/plugins.html.
BTW, sorry for send duplicate e-mail last night, due to my network failure
Best wish.
- jiajie
Hi,
Thank you for this explanation. If I summarize, I'll have to writ
Hi,
Thank you for this explanation. If I summarize, I'll have to write a
file_to_postgres Operator, with pg_preoperator and pg_postoperator
parameters.
Just a simple question: Where should I add and store this Operator in the
airflow ecosystem ?
Regards,
Flo
On Wed, Mar 20, 2019 at 5:05 PM jiaj
Gatsby is awesome. I use it in my company (Polidea) to create our
website. I can help with moving the site if we want to use it. This is
useful for us because it will allow you to build a website based on various
data sources.
I only warn you about using "CSS in JS" library. This results in the
c
