Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
kaxil commented on issue #48183: URL: https://github.com/apache/airflow/issues/48183#issuecomment-2748689018 > [@kaxil](https://github.com/kaxil) for XCom, Variable are we tracking on SDK board? No but the same code should fix both, the one that is in Ash's example for DAG processor -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
ashb commented on issue #48183: URL: https://github.com/apache/airflow/issues/48183#issuecomment-2747914755 @jroachgolf84 Adding something like https://github.com/apache/airflow/blob/6a703dd1f795784e446742dddf412b0fe3b4e4a0/airflow-core/src/airflow/dag_processing/processor.py#L261-L296 here https://github.com/apache/airflow/blob/6a703dd1f795784e446742dddf412b0fe3b4e4a0/airflow-core/src/airflow/jobs/triggerer_job_runner.py#L299-L315 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
jroachgolf84 commented on issue #48183: URL: https://github.com/apache/airflow/issues/48183#issuecomment-2747845462 Just curious, what would a fix for this look like? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
vatsrahul1001 commented on issue #48183: URL: https://github.com/apache/airflow/issues/48183#issuecomment-2747783672 @kaxil for XCom, Variable are we tracking on SDK board? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
kaxil commented on issue #48183: URL: https://github.com/apache/airflow/issues/48183#issuecomment-2747733975 It is same for XCom, Variable or anything that requires DB connection in the actual trigger code. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] Triggerer code does not seem to be able to use an Airflow connection [airflow]
pankajkoti commented on issue #48183:
URL: https://github.com/apache/airflow/issues/48183#issuecomment-2747444903
This is the traceback I see
```
Trigger failed:
Traceback (most recent call last):
File "/opt/airflow/airflow-core/src/airflow/jobs/triggerer_job_runner.py",
line 764, in cleanup_finished_triggers
result = details["task"].result()
File "/opt/airflow/airflow-core/src/airflow/jobs/triggerer_job_runner.py",
line 864, in run_trigger
async for event in trigger.run():
File
"/opt/airflow/providers/databricks/src/airflow/providers/databricks/triggers/databricks.py",
line 178, in run
statement_state = await
self.hook.a_get_sql_statement_state(self.statement_id)
File
"/opt/airflow/providers/databricks/src/airflow/providers/databricks/hooks/databricks.py",
line 790, in a_get_sql_statement_state
response = await self._a_do_api_call(get_sql_statement_endpoint)
File
"/opt/airflow/providers/databricks/src/airflow/providers/databricks/hooks/databricks_base.py",
line 707, in _a_do_api_call
url = self._endpoint_url(endpoint)
File
"/opt/airflow/providers/databricks/src/airflow/providers/databricks/hooks/databricks_base.py",
line 619, in _endpoint_url
port = f":{self.databricks_conn.port}" if self.databricks_conn.port else
""
File "/usr/local/lib/python3.10/functools.py", line 981, in __get__
val = self.func(instance)
File
"/opt/airflow/providers/databricks/src/airflow/providers/databricks/hooks/databricks_base.py",
line 138, in databricks_conn
return self.get_connection(self.databricks_conn_id)
File "/opt/airflow/airflow-core/src/airflow/hooks/base.py", line 64, in
get_connection
conn = Connection.get_connection_from_secrets(conn_id)
File "/opt/airflow/airflow-core/src/airflow/models/connection.py", line
496, in get_connection_from_secrets
raise AirflowNotFoundException(f"The conn_id `{conn_id}` isn't defined")
airflow.exceptions.AirflowNotFoundException: The conn_id
`databricks_default` isn't defined
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
