potiuk commented on issue #5788: [POC] multi-threading using asyncio URL: https://github.com/apache/airflow/pull/5788#issuecomment-570369090 Just a comment. I think we might want to discuss and rethink the approach we have for different executors including the Local Executor as well. The #6750 concept of the Native Executor from @nuclearpinguin might be theoretically be used with any deployment option. It could pretty much replace (and simplify) all other executors - CeleryExecutor, KubernetesExecutor, LocalExecutor - by choosing the right deployment options (Celery, Kubernetes, simple Process Pool) + the right Kombu Transport for communication (Redis/Rabbitmq, In-memory, ....). Something we should discuss at the next sig-scalability meeting.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
