Hello All,
I just completed an upgrade from 2.0.1 to 2.2.4 and was pretty uneventful. Some
missing dependencies I corrected, and Airflow web server,
scheduler (Celery), workers and flower are working great. Many of the hello
world, and example DAGs run fine - and of course they are not using a
connection.
~~~~
However, previous DAGs that utilize SimpleHttpOperator, e.g. —>
ping_ambari = SimpleHttpOperator(
task_id='ping_ambari',
extra_options={"verify": dag.params.get("verify_ssl")},
http_conn_id=dag.params.get("nifi_http_conn_id"),
endpoint=<long http address>,
method='GET',
headers={"X-Requested-By": "ambari"},
email_on_failure=True,
dag=dag,
)
Have started (and continue after reboots and restarts) to throw the error —>
AirflowNotFoundException(f"The conn_id `{conn_id}` isn't defined”)
(Which I tracked down to ../airflow/models/connection.py )
~~~~
This is new, and moments before the upgrade this type of task ran fine
Any ideas what is new and changed that I need to adjust to attend to this?
DB upgrade was uneventful and reported success. Config changes were easy, only
like 4 to attend to.
All of my connections are in the GUI using the Admin Connections page (I don’t
use any other type of connections)
Best Regards
John