The GitHub Actions job "Tests (AMD)" on airflow.git/rahul-madaan-databricks-ol-injection has failed. Run started by GitHub user rahul-madaan (triggered by rahul-madaan).
Head commit for run: b11ed0ae82c0ec7e8dfd584383efa1f24cab04a6 / rahul-madaan <[email protected]> Add OpenLineage parent/transport info injection to DatabricksSubmitRunOperator DatabricksSubmitRunOperator did not emit any OpenLineage information. This adds optional injection of OpenLineage parent job and transport configuration into the job's ``new_cluster.spark_conf`` (single-task and multi-task forms), so the Spark job running on Databricks can correlate its lineage events with the Airflow task and send them to the same backend. The behaviour is controlled by two new operator parameters, ``openlineage_inject_parent_job_info`` and ``openlineage_inject_transport_info``, each defaulting to the corresponding ``openlineage.spark_inject_*_info`` config option, mirroring the existing Dataproc, EMR and Glue operators. Injection is skipped when the provider is unavailable, when the relevant properties are already present, or when the job has no ``new_cluster`` to modify (e.g. an existing cluster). Signed-off-by: rahul-madaan <[email protected]> Report URL: https://github.com/apache/airflow/actions/runs/26813877165 With regards, GitHub Actions via GitBox --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
