xBis7 commented on PR #54284: URL: https://github.com/apache/airflow/pull/54284#issuecomment-3175234610
If any tasks have been retrieved by that query, then it means that their dependencies have been met and they are queuable. The only limitation is the `max_active_tasks_per_dag` config that the user has already set and the number of available pool slots. If we add the sorting in the `order_by`, it will mess with the FIFO philosophy that the scheduler has been following and it will skip entire batches of tasks. > I think it would probably make sense to make it so that it only gets deprioritized for fixed time I agree with this. I think that we should let the query return the tasks just like before and then do the sorting. That way, we won't mess with the selection order and we will also queue tasks that might otherwise starve. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
