GitHub user walidmujahid added a comment to the discussion: Add native Terraform integration
This was certainly an discussion to read through. I have spent a few hours researching how to best setup and destroy ephemeral infrastructure that tasks in a scheduled dag would need to rely on...ignoring the debate as to whether Terraform should be used for that or not (having become a fan of [this opinion](https://www.reddit.com/r/Terraform/comments/1dqfbsm/comment/lapgzs2/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button)), my mind settled on just continuing to use Terraform code I previously had, just using airflow to schedule (and scale when needed) the infrastructure using. So, I'm going to be extending the Airflow image with Terraform similar to how rearc did with Bronco: https://github.com/rearc/bronco/tree/main Then I'll be using the BashOperator similar to here: https://stackoverflow.com/a/66801089/6784817 In any case, if you get a TerraformOperator up and running in the future, I would be very interested to play with it. My current problem I am trying to solve may no longer exist by then, but if it does, I wouldn't mind considering a refactor to use a TerraformOperator. GitHub link: https://github.com/apache/airflow/discussions/28089#discussioncomment-11094796 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
