andrewgodwin commented on issue #18113: URL: https://github.com/apache/airflow/issues/18113#issuecomment-919439356
Unfortunately the triggerer mechanism doesn't solve this - triggers can run separately, but even to raise a task failure, deferred tasks have to be sent back to a worker to execute, so they're still bound by the same sort of rules. One thing I do want to look at soon, however, is extending the Executor interface to allow executors to run more than just Tasks - in essence, opening up the ability to submit other workloads (like callback functions) to run on executors, and hopefully pave the way for moving these and a lot of other things out of the scheduler/webserver. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
