Re: Google Summer of Code Announced. Interested?

2020-01-20 Thread Jarek Potiuk
Send an email from apache@org address to mentors-subscr...@community.apache.org J. - On Mon, Jan 20, 2020 at 10:09 PM Kaxil Naik wrote: > Where should I subscribe for the mentors list? > > On Tue, Jan 21, 2020 at 2:02 AM Aizhamal Nurmamat kyzy < > aizha...@apache.org> > wrote: > > > This is ex

Re: Google Summer of Code Announced. Interested?

2020-01-20 Thread Kaxil Naik
Where should I subscribe for the mentors list? On Tue, Jan 21, 2020 at 2:02 AM Aizhamal Nurmamat kyzy wrote: > This is exciting! > > On Sun, Jan 19, 2020 at 3:51 PM Jarek Potiuk > wrote: > > > Hello everyone, > > > > I have added some 40+ issues to gsoc issues (by labelling them in JIRA as > >

Re: [DISCUSS] Donating Airflow k8s Operator

2020-01-20 Thread Aizhamal Nurmamat kyzy
Indeed. I have previously requested +Barni Seetharaman (the author of the operator) to write up a post about how and when to use this operator with examples. If Barni's bandwidth doesn't allow him to work on it at the moment, maybe we can have other volunteers who know the code to contribute the d

Re: Google Summer of Code Announced. Interested?

2020-01-20 Thread Aizhamal Nurmamat kyzy
This is exciting! On Sun, Jan 19, 2020 at 3:51 PM Jarek Potiuk wrote: > Hello everyone, > > I have added some 40+ issues to gsoc issues (by labelling them in JIRA as > hinted by Pablo). I've also subscribed to "mentors" list and looking > forward to further actions > > Maybe other commiters/PMC

Re: Remove Dask Executor in Airflow 2.0 ?

2020-01-20 Thread Kaxil Naik
Yes definitely, we are actually going to add some content from the Workshop during the Airflow Summit to Airflow Website and a link to that page would be added to CONTRIBUTING.md. On Mon, Jan 20, 2020 at 10:18 PM Darren Weber wrote: > Via the GSOC thread, I found > > https://cwiki.apache.org/co

Re: Remove Dask Executor in Airflow 2.0 ?

2020-01-20 Thread Darren Weber
Via the GSOC thread, I found https://cwiki.apache.org/confluence/display/AIRFLOW/First+time+contributor%27s+workshop - agree with a comment on that thread that a wiki page link from CONTRIBUTING.md could be useful too On Mon, Jan 20, 2020 at 8:30 AM Jarek Potiuk wrote: > We are actually planning

Re: Remove Dask Executor in Airflow 2.0 ?

2020-01-20 Thread Jarek Potiuk
We are actually planning (pending confirmation) "First time Apache Airflow Contributor's" training at PyCon US in April. I think if there is a good usage of Dask and we got Scientific -oriented users using Airflow with Dask - I am all for having a closer cooperation on that topic :). J. On Mon,

Re: Remove Dask Executor in Airflow 2.0 ?

2020-01-20 Thread Darren Weber
Thanks for the ping on https://github.com/dask/dask/issues/5803 I'm curious about how dask async features might be low-hanging fruit for Airflow scaling - https://distributed.dask.org/en/latest/asynchronous.html - https://github.com/apache/airflow/pull/6984 Our company has scientific workflows an