Hi Airflow Community, Airflow is a scheduling platform for data pipelines, however there is no good metric to measure the scheduling delay in the production and also the stress test environment. This makes it hard to catch regressions in the scheduler during the stress test stage.
I would like to propose an airflow scheduling delay metric definition. Here is the detailed design of the metric and its implementation: https://docs.google.com/document/d/1NhO26kgWkIZJEe50M60yh_jgROaU84dRJ5qGFqbkNbU/edit?usp=sharing Please take a look and any feedback is welcome. Thanks, Ping
