seanmuth commented on issue #58554: URL: https://github.com/apache/airflow/issues/58554#issuecomment-5589413378
Actually @zh-jn just had a discussion with @dstandish and we do consider the sorting of _running_ state backfill runs to the very bottom to be a bug, and not-quite intended behavior. The idea was definitely deprioritization, but not permanent starvation. Our proposed fix is to simply remove that nulls_last sort on the backfill. If we're already to the stage where the backfill DR is in `Running` we should run the TIs, using last_scheduling_decision as the batching/sort key. PR to follow shortly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
