Hi All, I am excited to announce that the Task SDK Integration FrameWork has been merged into the main branch via: https://github.com/apache/airflow/pull/53332.
This adds a framework that introduces a new category of tests that validate the integration between the task SDK and a running Airflow Instance (API server) and tests what we call as the Task Execution Interface. Benefits: - API compatibility Assurance: Catches breaking changes between the task SDK and Airflow core. - Version Compat: My vision is to start running version combinations of the task SDK and Airflow versions to catch compatibility issues. - End to End confidence: Validates various functionalities between the task SDK and Airflow core to ensure that communications work properly. I also wrote a detailed document in the repo that explains the working of these tests: https://github.com/apache/airflow/blob/main/contributing-docs/testing/task_sdk_integration_tests.rst and how to use them with breeze as well as in a local virtual environment easily. In short, you could do: cd task-sdk-tests/ uv run pytest -s Or on breeze: breeze testing task-sdk-integration-tests Future plans: - Expand test coverage by adding tests for different functionalities. I will start working on this soon and would probably reach out to some of you for help / suggestions. - Expand the test matrix to run with not just current sources but with version combinations to guarantee compatibility. Thank you to everyone who provided valuable feedback and reviews. Thanks & Regards, Amogh Desai
