GitHub user potiuk added a comment to the discussion: How to use sharding for schedulers?
In Airflow 3, there are dag bundles implemented and they are supposed in the future have configurable scan interval per bundle (AIP-66) - https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=294816356. Also there is a discussion in progress on work-in-progress AIP-65 https://cwiki.apache.org/confluence/display/AIRFLOW/%5BWIP%5D+AIP-85+Extendable+DAG+parsing+controls - that further builds on top of AIP-66. If you would like to contribute to completing the proposal and implementing it - feel free to chime in, continue the discussion there (you will find links in the docs) GitHub link: https://github.com/apache/airflow/discussions/56294#discussioncomment-14600046 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
