FrankYang0529 commented on issue #73658: URL: https://github.com/apache/airflow/issues/73658#issuecomment-5868221523
edge3 5.0.0rc1 has a regression from my PR #72048, so I'd hold edge3 for an rc2: - #72048: `[core] parallelism` now takes effect. With `parallelism = 3` and six parallel tasks, the RC queues three task instances and leaves three scheduled, while 4.3.2 queues all six. But when the scheduler restarts while Edge task instances from the previous scheduler are still queued or running, the new scheduler crashes on startup with `DetachedInstanceError`, and every later restart crashes the same way. The upgrade path hits it too: after a scheduler running 4.3.2 queues some Edge tasks and stops, the first scheduler start after upgrading to 5.0.0rc1 crashes the same way. I reproduced both cases with the RC from PyPI on Airflow 3.3.2 The fix is in #73832. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
