dstandish commented on PR #54284:
URL: https://github.com/apache/airflow/pull/54284#issuecomment-3175175206
I think it would probably make sense to make it so that it only gets
deprioritized for fixed time so the expression would be like
```sql
case
when last_queueing_decision is null then null
when abs(datediff(seconds, now(), last_queueing_decision)) > 90 then
null
else last_queueing_decision
end NULLS FIRST
```
Something like that.
Then basically the non-schedulable tasks come out of purgatory after a brief
cool off period or something. Just to make sure they don't get completely
clobbered by a busy cluster. You're just backing off of them a bit so the
scheduler can keep working on actually queueable tasks.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
