amoghrajesh commented on code in PR #66859:
URL: https://github.com/apache/airflow/pull/66859#discussion_r3271665397
##########
task-sdk/src/airflow/sdk/execution_time/task_runner.py:
##########
@@ -1455,6 +1465,10 @@ def _handle_current_task_success(
if conf.getboolean("state_store", "clear_on_success"):
log.info("Task state will be cleared by the server because
clear_on_success is enabled.")
+ if _get_worker_state_backend() is not None:
+ # clear the task state keys for custom state backends configured
on worker side
+ context["task_state"].clear()
Review Comment:
Fixed. Added `TaskStateAccessor._clear_backend_only()` which calls
`backend.clear(self._scope)` without sending comms message. `clear_on_success`
path now calls that instead of `.clear()`. The server clears DB rows via
SucceedTask already, so the ClearTaskState comms was redundant.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
