Nataneljpwd commented on PR #53435: URL: https://github.com/apache/airflow/pull/53435#issuecomment-3128061249
@karenbraganz, I think that the issue might be that if there is more than 1 stuck task, it commits before it changed or requed all tasks, and so the other tasks are lost, and we can see the commit [here](https://github.com/apache/airflow/blob/f1a76a104a4fb42d87bb6e5fb6d3f071f991d9eb/airflow-core/src/airflow/jobs/scheduler_job_runner.py#L1978C1-L1979C1), I would try moving the commit out of the loop and see if it changes anything, nevertheless, I would do it either way as we batch requests to the db that way which is better, but I think it might resolve the issue, thoug, I do not see that expire on commit is configured anywhere -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
