Re: Airflow 1.10.0

2018-06-13 Thread Bolke de Bruin
Same here and will be for a while still :-(. So unfortunately 1.10 is a bit stalled. B, > On 13 Jun 2018, at 17:16, Chris Riccomini wrote: > > Hey Fokko, > > Sorry that I've been MIA for a while. Just wanted to check in on 1.10, and > its current status. > > Cheers, > Chris > > On Tue, May

Re: Airflow 1.10.0

2018-06-13 Thread Chris Riccomini
Hey Fokko, Sorry that I've been MIA for a while. Just wanted to check in on 1.10, and its current status. Cheers, Chris On Tue, May 1, 2018 at 11:18 PM Driesprong, Fokko wrote: > Hi Bryon, > > We'll be releasing the RC's soon. If there aren't much issues with the > RC's, it will be released qu

Re: Single Airflow Instance Vs Multiple Airflow Instance

2018-06-13 Thread Martin Gauthier
Thank you everyone, All your comments and ideas will be usefull to us in a near future to make up our plan of action.

Re: Single Airflow Instance Vs Multiple Airflow Instance

2018-06-13 Thread Martin Gauthier
Thank you Kevin, This is great output and which gives us a more of any idea on how to set it up from our end.

Concurrency Settings for Celery Executor

2018-06-13 Thread ramandumcs
Hi All, There seems to be couple of settings in airflow.cfg which controls the number of tasks that can run in parallel on Airflow( "parallelism" and "celeryd_concurrency") In case of celeryExecutor which one is honoured. Do we need to set both or setting only celeryd_concurrency would work.