Re: Language matters - don't use the term "whitelist" in Apache Airflow

2020-06-08 Thread Soma S Dhavala
+1 👍 On Mon, Jun 8, 2020 at 2:05 PM Kaxil Naik wrote: > 👏 > > On Mon, Jun 8, 2020, 08:28 Robin Edwards wrote: > > > Nice one Ash, > > > > +1 > > > > R > > > > On Mon, 8 Jun 2020 at 05:04, Jarek Potiuk > > wrote: > > > > > > Indeed. Thanks Ash! Much appreciated! > > > > > > J. > > > > > > On Mo

Re: Airflow and Machine Learning

2020-02-19 Thread Soma S Dhavala
ument/d/1-l0EZveZJAxcRNdTOvNzVArq6V37Aj24H0CGd76Nh80/edit?usp=sharing> a deck <https://docs.google.com/presentation/d/1M6rD8AYWauC6MvHZqTyjmK24NX-9cVevlIMeDgRASmw/edit?usp=sharing> on use cases. On Thu, Feb 20, 2020 at 9:43 AM Soma S Dhavala wrote: > At project sunbird, we built daggit

Re: Airflow and Machine Learning

2020-02-19 Thread Soma S Dhavala
At project sunbird, we built daggit , an open source ML-As-A-Service platform on the top of airflow. While airflow and other ML platforms have taken *code-as- * *configuration* approach, we like to have users declaratively specify their ML A

Re: [DISCUSS] Using shared memory for inter-task communication

2019-11-26 Thread Soma S Dhavala
TL;DR I am sharing my thoughts here about supporting in-memory data passing. Not necessarily directly linked to airflow specific implementation, but airflow still does play its role, i.e, chaining computational nodes. In the data-flow graph parlance, airflow operators are fundamentally computatio

Re: [Discuss] Airflow Summits 2020

2019-11-20 Thread Soma S Dhavala
+1 airflow current On Wed, Nov 20, 2019 at 10:05 PM Jonathan Miles wrote: > +1 I like the double meaning of Airflow Current > > There are also things you can do with air flows, like: Airflow Glide. > > I think draught, unfortunately has negative connotations in English; > draughty: (of an enclos

Re: [Discuss] Airflow Summits 2020

2019-11-20 Thread Soma S Dhavala
airflow zone'd On Wed, Nov 20, 2019 at 4:22 PM Tomasz Urbaszek wrote: > Airflow Wind? Airflow Breath? > > On Wed, Nov 20, 2019 at 12:02 AM Jarek Potiuk > wrote: > > > How about "*Airflow Draught*" (sorry Breeze is already taken): > > > > From https://www.lexico.com/en/definition/draught: A curr

Re: Donating code to add Common Workflow Language import to Airflow

2019-11-16 Thread Soma S Dhavala
On Sat, Nov 16, 2019 at 2:25 PM Jarek Potiuk wrote: > > > > 1) The more dags I have in a dags folder, the longer time it takes to > > parse them all. Taking into account that in my case I have also to parse > > CWL files, it takes even more time for such a simple operation. So I was > > wondering

Re: [Final review] Airflow website + need your input to the web copy

2019-11-08 Thread Soma S Dhavala
On Sat, Nov 9, 2019 at 6:00 AM Aizhamal Nurmamat kyzy wrote: > Thank you both for your feedback. > > I really dislike the moving background elements on the lading page. I > > already found the previous example when they weren't moving hard to focus > > on other elements such as finding the header