dstandish commented on PR #54284: URL: https://github.com/apache/airflow/pull/54284#issuecomment-3175138378
> The goal is to prioritize tasks that have already been examined but haven't been queued yet, is that correct? > > > wont this basically break priorities? As now lower priority tasks will be queued before higher priority tasks? This could be a great addition if it is the last field of the order by function but not the first. > > I also think that we should check priorities and the map_index first, before looking for starved tasks. > > > ``` > > nulls_first(TI.last_queueing_decision.desc(), session=session), > > ``` Sorry guys -- i meant to do `asc()` not `desc()` The logic should be, that tasks which come out in the query but which can't actually be queued, go to the _bottom_ of the list -- not the top. We could potentially "expire" the consideration so that e.g. the only get deprioritized for fixed time like 1 minute or something. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
