tirkarthi commented on issue #47781:
URL: https://github.com/apache/airflow/issues/47781#issuecomment-2726574592
In 984c61d2871167056cc727c82b7ee5d3acf9d54a I can see the below change where
`args` used to be a single item list of command changed to `args` that celery
tries to check that could be causing this? This was merged to 3.10.2 but it got
yanked.
```diff
@@ -213,15 +257,19 @@ def send_task_to_executor(
task_tuple: TaskInstanceInCelery,
) -> tuple[TaskInstanceKey, CommandType, AsyncResult |
ExceptionWithTraceback]:
"""Send task to executor."""
- key, command, queue, task_to_run = task_tuple
+ from airflow.executors import workloads
+
+ key, args, queue, task_to_run = task_tuple
+ if isinstance(args, workloads.BaseWorkload):
+ args = (args.model_dump_json(),)
try:
with timeout(seconds=OPERATION_TIMEOUT):
- result = task_to_run.apply_async(args=[command], queue=queue)
+ result = task_to_run.apply_async(args=args, queue=queue)
except (Exception, AirflowTaskTimeout) as e:
exception_traceback = f"Celery Task ID:
{key}\n{traceback.format_exc()}"
result = ExceptionWithTraceback(e, exception_traceback)
- return key, command, result
+ return key, args, result
```
cc: @ashb @eladkal
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
