Hi All, We have requirement to run 10k(s) of concurrent tasks. We are exploring Airflow's Celery Executor for same. Horizontally Scaling of worker nodes seem possible but it can only have one active scheduler. So will Airflow scheduler be able to handle these many concurrent tasks. Is there any benchmarking number around airflow scheduler's scalability. Thanks, Raman
- Benchmarking of Airflow Scheduler with Celery Executor ramandumcs
