kosiew opened a new pull request, #68017:
URL: https://github.com/apache/airflow/pull/68017
* Part of #64609
### What does this PR do?
Follow up for #64960
Adds documentation clarifying which `databricks_retry_args` configurations
are supported when using Databricks operators in deferrable mode.
The new documentation:
* Explains that `databricks_retry_args` must be serialization-safe because
it is serialized across the trigger boundary when `deferrable=True`.
* Documents supported value types (plain Python primitives and collections
of primitives).
* Provides examples of supported configurations, such as `{"reraise": True}`.
* Explains that retry count and delay should be configured through the
dedicated `retry_limit` and `retry_delay` operator parameters.
* Documents unsupported configurations, including Tenacity strategy objects
(`stop_after_attempt`, `wait_incrementing`, etc.) and arbitrary callables.
* Recommends using the non-deferrable Databricks operators when custom
callable retry strategies are required.
* Adds a Databricks provider changelog entry describing the documentation
update.
### Does this PR introduce any user-facing change?
Yes. Documentation now explicitly describes the serialization requirements
and supported shapes for `databricks_retry_args` in deferrable Databricks
operators, helping users avoid unsupported retry configurations.
### How was this patch tested?
No tests were added or modified. This PR contains documentation and
changelog updates only.
---
##### Was generative AI tooling used to co-author this PR?
* [x] Yes (please specify the tool below)
ChatGPT
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
