SkastVnT commented on PR #66895:
URL: https://github.com/apache/airflow/pull/66895#issuecomment-4447425721

   **I added the following validation screenshots for the Databricks query tags 
test DAG:**
   
   **Screenshot 1 — `no_airflow_tags` task**
   
   This validates the negative-control case: `DatabricksSqlOperator` still runs 
successfully when Airflow query tag injection is disabled with 
`include_airflow_query_tags=False`.
   <img width="1794" height="889" alt="1" 
src="https://github.com/user-attachments/assets/505e326e-9961-4c7a-b595-e0f197c957a9";
 />
   
   -----------------
   **Screenshot 2 — `insert_more_rows` task**
   
   This validates a tagged write operation: the task completed successfully and 
inserted additional rows into the Databricks demo table through 
`DatabricksSqlOperator`.
   <img width="1794" height="889" alt="2" 
src="https://github.com/user-attachments/assets/a1aea529-2970-44a0-a076-9bf72ffbd440";
 />
   
   -----------------
   **Screenshot 3 — `tagged_select` task**
   
   This validates a tagged read operation: the task completed successfully with 
custom query tags such as `pipeline` and `step`, together with Airflow context 
query tags.
   <img width="1794" height="889" alt="4" 
src="https://github.com/user-attachments/assets/1179bf3d-2caf-49a6-872b-da4d9bed5fa7";
 />
   
   -----------------
   **Screenshot 4 — `setup_table` task**
   
   This validates the setup step: the task successfully created the Delta table 
and inserted the initial demo rows.
   <img width="1794" height="889" alt="5" 
src="https://github.com/user-attachments/assets/250821ad-39e2-44d8-b1dc-c0d64715760b";
 />
   
   -----------------
   **Screenshot 5 — Databricks demo table rows**
   
   This confirms that the Databricks table was created and populated correctly. 
The final result contains 10 rows inserted by the Airflow tasks.
   <img width="1794" height="889" alt="7" 
src="https://github.com/user-attachments/assets/c84981f7-44f3-4ad1-9b4d-a288bdc9730d";
 />
   
   -----------------
   **Screenshot 6 — Databricks table existence check**
   
   This confirms that `airflow_query_tags_demo` exists in the Databricks 
`default` schema.
   <img width="1794" height="857" alt="8" 
src="https://github.com/user-attachments/assets/9b36cd8f-1dff-4233-9f4b-ccdd85c58d69";
 />
   
   -----------------
   **Screenshot 7 — `system.query.history` availability check**
   
   This confirms that `system.query.history` is accessible in the Databricks 
workspace, so query history can be used to validate query tags.
   <img width="1794" height="889" alt="3" 
src="https://github.com/user-attachments/assets/f1526625-594b-4664-8944-04b50a51dd41";
 />
   
   These screenshots cover the successful Airflow task execution, Databricks 
table creation, inserted demo rows, and access to `system.query.history`. I 
will add the query-history tag validation screenshot separately once the 
updated run returns rows containing the expected Airflow query tags.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to