Re: [ANNOUNCE] Please welcome new Airflow committer Chao-han Tsai

Congrats Chao-Han! I really appreciate your work on improving subdags. :) Sent from ProtonMail mobile Original Message On Aug 20, 2019, 05:40, Maxime Beauchemin wrote: > We'll deserved! Welcome aboard! > > On Mon, Aug 19, [2019](tel:2019), 9:54 AM Aizhamal Nurmamat kyzy >

Re: Airflow Dynamic tasks

Celery executor. 12 BareMetals: CPU(s):40, MHz 2494.015, RAM 378G - each box Worker .cfg: [core] sql_alchemy_pool_size = 5 sql_alchemy_pool_recycle = 900 sql_alchemy_reconnect_timeout = 300 parallelism = 1200 dag_concurrency = 800 non_pooled_task_slot_count = 1200 max_active_runs_per_dag = 10

Re: [DISCUSS] Tweaks to the Airflow logo

Latest one looks great. On Tue, Aug 20, 2019 at 11:22 AM Aizhamal Nurmamat kyzy wrote: > Great job Chris! Love it :) Thank you for your patience and such a big > contribution! > > On Tue, Aug 20, 2019 at 10:45 AM Jarek Potiuk > wrote: > > > All for it :) > > > > On Tue, Aug 20, 2019 at 1:08 PM

Re: [DISCUSS] Tweaks to the Airflow logo

Great job Chris! Love it :) Thank you for your patience and such a big contribution! On Tue, Aug 20, 2019 at 10:45 AM Jarek Potiuk wrote: > All for it :) > > On Tue, Aug 20, 2019 at 1:08 PM Kaxil Naik wrote: > > > Time for an official VOTE? > > > > On Tue, Aug 20, 2019 at 6:06 PM Jarek Potiuk

Re: [DISCUSS] Tweaks to the Airflow logo

All for it :) On Tue, Aug 20, 2019 at 1:08 PM Kaxil Naik wrote: > Time for an official VOTE? > > On Tue, Aug 20, 2019 at 6:06 PM Jarek Potiuk > wrote: > > > <3 for smaller, dark gray dot. It's close to perfection now :) > > > > J. > > > > On Tue, Aug 20, 2019 at 1:02 PM Karolina Rosół < >

Re: [DISCUSS] Tweaks to the Airflow logo

<3 for smaller, dark gray dot. It's close to perfection now :) J. On Tue, Aug 20, 2019 at 1:02 PM Karolina Rosół wrote: > You bought me with the latest proposal. Looks perfect now! Great job Chris! > <3 Also dark grey instead of black for the dot was a good idea. First thing > I see is the

Re: [DISCUSS] Tweaks to the Airflow logo

You bought me with the latest proposal. Looks perfect now! Great job Chris! <3 Also dark grey instead of black for the dot was a good idea. First thing I see is the pinwheel not the dot as someone previously mentioned. Karolina Rosół Polidea | Project Manager Check out

Re: [DISCUSS] Tweaks to the Airflow logo

I think this iteration looks great. Thanks for continuing to work on this, Chris! On Tue, Aug 20, 2019 at 11:31 AM Chris Hendrixson wrote: > Hey all, it seems like a lot of folks are drawn to the pinwheel design and > it does seem like a good compromise. Based on the feedback, I adjusted the >

Re: Airflow Dynamic tasks

Delay between tasks could be due to not having enough worker slots. What type of executor are you using, how is it configured? Max On Tue, Aug 20, 2019 at 7:50 AM Bacal, Eugene wrote: > Absolutely possible, Daniel, > > We are looking in all directions. Has anyone noticed performance >

Re: [DISCUSS] Tweaks to the Airflow logo

Hey all, it seems like a lot of folks are drawn to the pinwheel design and it does seem like a good compromise. Based on the feedback, I adjusted the center dot; it's smaller now and dark gray instead of black, both of which make it feel more cohesive with the rest of the design instead of

Re: Airflow Dynamic tasks

Absolutely possible, Daniel, We are looking in all directions. Has anyone noticed performance improvements with PostgreSQL vs MySQL ? -Eugene On 8/15/19, 2:03 PM, "Daniel Standish" wrote: It's not just webserver and scheduler that will parse your dag file. During the execution of

Re: Enable LGTM on the repository

+1 ! Fantastic! It will be great to see our code improves as we are progressing with Pylint fixes + maybe it can motivate us to finally implement better strategy for keeping pip dependencies up-to-date. I also think Javascript is also important. I wonder how our score might improve if we decide

Re: [DISCUSS] Tweaks to the Airflow logo

Hello everyone! I'm Karolina and I'm a Project Manager on a daily basis with focus on cloud / big data projects. I'm new to dev-list but I work closely with Kamil Breguła and Jarek Potiuk who are very much present in the Apache Airflow community. Thanks to their knowledge and passion I am

Re: Enable LGTM on the repository

The tool looks good. It also shows when this error was introduced and more debug information. [image: image.png] +1 from my side to integrate it On Tue, Aug 20, 2019 at 11:49 AM Ash Berlin-Taylor wrote: > Interesting! > > One or two of the rules we'd probably want to ignore (`Module 'airflow'

Re: Enable LGTM on the repository

Interesting! One or two of the rules we'd probably want to ignore (`Module 'airflow' is imported with both 'import' and 'import from'`) and possibly the cycle one, but some of them certainly look like bugs/errors that should be fixed. > On 20 Aug 2019, at 10:00, Driesprong, Fokko wrote: > >

Enable LGTM on the repository

Hi all, I recently bumped into LGTM , an automated vulnerability checker. Besides that, it also analyzes general code quality. I think it would be nice to enable this on Airflow as well. LGTM automatically runs 1600+ standard analyses contributed by