Re: Airflow 1.8.0 BETA 5

2017-01-29 Thread Bolke de Bruin
Hey Boris The scheduler is a bit more aggressive and can use multiple processors, so higher CPU usage is actually a good thing. I case it is really out of hand look at the new scheduler options and heartbeat options (see PR for updating.md not in the beta yet). Bolke Sent from my iPhone >

Re: Airflow 1.8.0 BETA 5

2017-01-29 Thread Boris Tyukin
I am not sure if it is my config or something, but looks like after the upgrade and start of scheduler, airflow would totally hose CPU. The reason is two new examples that start running right away - latest only and latest with trigger. Once I pause them, CPU goes back to idle. Is this because now d

Re: SQL Syntax Errors in 1.8

2017-01-29 Thread Chad Henderson
Sounds good to me. On Jan 29, 2017 2:41 AM, "Bolke de Bruin" wrote: > Hey Chad, > > I saw that PR and I am a bit hesitant to include in 1.8.0, as it is indeed > rather big and it touches core functionality. What about targeting it for > 1.8.1, which should be ~1 month after? > > Cheers > Bolke >

Re: SQL Syntax Errors in 1.8

2017-01-29 Thread Bolke de Bruin
Hey Chad, I saw that PR and I am a bit hesitant to include in 1.8.0, as it is indeed rather big and it touches core functionality. What about targeting it for 1.8.1, which should be ~1 month after? Cheers Bolke > On 29 Jan 2017, at 04:26, Chad Henderson wrote: > > Hi everyone, > > Is it too