Re: Airflow maintenance blog post

This is great. I think we can create a repo (or a just under airflow) for these common DAGs that will be used by every airflow user. It will be a central place for the communities to open source and contribute their DAGs and it makes it much easier to discover these DAGs. Chao-Han On Wed, Aug 21,

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 Sent from ProtonMail mobile Original Message On Aug 22, 2019, 08:42, Chao-Han Tsai wrote: > Option 1. > > On Wed, Aug 21, [2019](tel:2019) at 11:22 AM Bolke de Bruin > wrote: > >> Option X >> >> (Want to be outside of the box 🙃) >> >> Sent from my iPhone >> >> > On 2

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1. On Wed, Aug 21, 2019 at 11:22 AM Bolke de Bruin wrote: > Option X > > (Want to be outside of the box 🙃) > > Sent from my iPhone > > > On 21 Aug 2019, at 19:22, Chen Tong wrote: > > > > Option 1! > > > > On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < > > felipe.elias...@gm

Re: Airflow maintenance blog post

Great!. More uses of Airflow! J. On Wed, Aug 21, 2019 at 9:27 PM Maxime Beauchemin wrote: > It's common to have these maintenance DAGs, but it's great to have people > share theirs and blog about it. > > > Thanks to Robert Sanders at Clairvoyant for this post and code repo > > https://blog.clai

Airflow maintenance blog post

It's common to have these maintenance DAGs, but it's great to have people share theirs and blog about it. Thanks to Robert Sanders at Clairvoyant for this post and code repo https://blog.clairvoyantsoft.com/automated-maintenance-for-apache-airflow-8d844f32737d

Re: Airflow Dynamic tasks

Hi Max, We have ran few testing today from DB side and noticed that: - DB connections are not being re-used - Connections stay open while active only 5: mysql> show global status like 'Thread%'; +-+-+

Re: [IE] Re: [VOTE] Change the Airflow logo

Option X (Want to be outside of the box 🙃) Sent from my iPhone > On 21 Aug 2019, at 19:22, Chen Tong wrote: > > Option 1! > > On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < > felipe.elias...@gmail.com> wrote: > >> Option 1 👏 >> >> El 21-08-2019, a la(s) 12:56, Maxime Beauchemin

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 👍🏼 Sent from my iPhone > On Aug 21, 2019, at 10:22 AM, Chen Tong wrote: > > Option 1! > > On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < > felipe.elias...@gmail.com> wrote: > >> Option 1 👏 >> >> El 21-08-2019, a la(s) 12:56, Maxime Beauchemin < >> maximebeauche...@gmail

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 2 On Wed, Aug 21, 2019 at 1:24 PM Chen Tong wrote: > Option 1! > > On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < > felipe.elias...@gmail.com> wrote: > > > Option 1 👏 > > > > El 21-08-2019, a la(s) 12:56, Maxime Beauchemin < > > maximebeauche...@gmail.com> escribió: > > > > >

Using IAM auth token for sql_alchemy

Hi, I'm trying to use IAM created auth tokens for connecting to the airflow database. One question I had was: How often does sql_alchemy_conn_cmd get called? so want to figure out the lifetime of a connection. Best, Sourabh

Airflow Sensor - Queue Consume

Hey Guys - As anyone tried creating a Airflow Plugin with a Sensor that consumes messages from a RabbitMQ Queue? If you have a working example, can you please let me know - if you used RabbitMQ's Pika Library or anything else? Krishna

Re: [VOTE] Change the Airflow logo

Option 2 On Wed, Aug 21, 2019 at 6:58 AM Ash Berlin-Taylor wrote: > The discuss thread had a positive response so I'm now calling for a VOTE > on updating the Airflow logo to one of the designs below. > > (Since no one said "I like the existing logo" I have not put that as an > option. Shout ver

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 10:54 PM Chen Tong wrote: > Option 1! > > On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < > felipe.elias...@gmail.com> wrote: > > > Option 1 👏 > > > > El 21-08-2019, a la(s) 12:56, Maxime Beauchemin < > > maximebeauche...@gmail.com> escribió: > > > >

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1! On Wed, Aug 21, 2019 at 1:18 PM Felipe Elias Lolas Isuani < felipe.elias...@gmail.com> wrote: > Option 1 👏 > > El 21-08-2019, a la(s) 12:56, Maxime Beauchemin < > maximebeauche...@gmail.com> escribió: > > > Option 1 ++ > > > >> On Wed, Aug 21, 2019 at 9:52 AM Tao Feng wrote: > >> > >>

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 👏 El 21-08-2019, a la(s) 12:56, Maxime Beauchemin escribió: > Option 1 ++ > >> On Wed, Aug 21, 2019 at 9:52 AM Tao Feng wrote: >> >> Option 1 >> >> On Wed, Aug 21, 2019 at 8:26 AM Leah Cole >> wrote: >> >>> Option 1 >>> >>> On Wed, Aug 21, 2019 at 7:01 AM Sunil Varma Chiluvuri <

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 ++ On Wed, Aug 21, 2019 at 9:52 AM Tao Feng wrote: > Option 1 > > On Wed, Aug 21, 2019 at 8:26 AM Leah Cole > wrote: > > > Option 1 > > > > On Wed, Aug 21, 2019 at 7:01 AM Sunil Varma Chiluvuri < > > sunilvarma.chiluv...@equifax.com> wrote: > > > > > Option 1 > > > > > > On Wed, Aug 21

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 8:26 AM Leah Cole wrote: > Option 1 > > On Wed, Aug 21, 2019 at 7:01 AM Sunil Varma Chiluvuri < > sunilvarma.chiluv...@equifax.com> wrote: > > > Option 1 > > > > On Wed, Aug 21, 2019 at 8:55 AM Kaxil Naik wrote: > > > > > A real tough one. > > > > > > *Option 1*

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 7:01 AM Sunil Varma Chiluvuri < sunilvarma.chiluv...@equifax.com> wrote: > Option 1 > > On Wed, Aug 21, 2019 at 8:55 AM Kaxil Naik wrote: > > > A real tough one. > > > > *Option 1* > > > > On Wed, Aug 21, 2019 at 2:25 PM Deng Xiaodong > wrote: > > > > > I vote f

Re: [IE] Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 8:55 AM Kaxil Naik wrote: > A real tough one. > > *Option 1* > > On Wed, Aug 21, 2019 at 2:25 PM Deng Xiaodong wrote: > > > I vote for Option 2, out of these 3 nice designs. > > > > XD > > > > On Wed, Aug 21, 2019 at 21:02 Bas Harenslak < > basharens...@godatadr

Re: [VOTE] Change the Airflow logo

A real tough one. *Option 1* On Wed, Aug 21, 2019 at 2:25 PM Deng Xiaodong wrote: > I vote for Option 2, out of these 3 nice designs. > > XD > > On Wed, Aug 21, 2019 at 21:02 Bas Harenslak > > wrote: > > > Option 1 > > > > > > On 21 Aug 2019, at 15:08, raman gupta > ramandu...@gmail.com>> wro

Re: [VOTE] Change the Airflow logo

I vote for Option 2, out of these 3 nice designs. XD On Wed, Aug 21, 2019 at 21:02 Bas Harenslak wrote: > Option 1 > > > On 21 Aug 2019, at 15:08, raman gupta ramandu...@gmail.com>> wrote: > > Option 2. > > Thanks, > Raman Gupta > > On Wed, Aug 21, 2019 at 6:26 PM Vardan Gupta

Re: [VOTE] Change the Airflow logo

Though choice... Wish I could vote for all of them! Anyway : Option 1 On Wed, 21 Aug 2019, 14:02 Bas Harenslak, wrote: > Option 1 > > > On 21 Aug 2019, at 15:08, raman gupta ramandu...@gmail.com>> wrote: > > Option 2. > > Thanks, > Raman Gupta > > On Wed, Aug 21, 2019 at 6:26 PM Vardan Gup

Re: [VOTE] Change the Airflow logo

Option 1 On 21 Aug 2019, at 15:08, raman gupta mailto:ramandu...@gmail.com>> wrote: Option 2. Thanks, Raman Gupta On Wed, Aug 21, 2019 at 6:26 PM Vardan Gupta mailto:vardangupta...@gmail.com>> wrote: Option 1 On Wed, Aug 21, 2019 at 6:18 PM Mohannad Albanayosy mailto:m.banay...@gmail.com>

Re: [VOTE] Change the Airflow logo

Option 2. Thanks, Raman Gupta On Wed, Aug 21, 2019 at 6:26 PM Vardan Gupta wrote: > Option 1 > > On Wed, Aug 21, 2019 at 6:18 PM Mohannad Albanayosy > wrote: > > > Option 1 > > > > Great job! > > > > On Wed, Aug 21, 2019 at 2:37 PM Driesprong, Fokko > > wrote: > > > > > Some sharp lookin' log

Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 6:18 PM Mohannad Albanayosy wrote: > Option 1 > > Great job! > > On Wed, Aug 21, 2019 at 2:37 PM Driesprong, Fokko > wrote: > > > Some sharp lookin' logo's! > > > > My vote would be option 1 as well > > > > Cheers, Fokko > > > > Op wo 21 aug. 2019 om 14:15 schre

Re: [VOTE] Change the Airflow logo

Option 1 Great job! On Wed, Aug 21, 2019 at 2:37 PM Driesprong, Fokko wrote: > Some sharp lookin' logo's! > > My vote would be option 1 as well > > Cheers, Fokko > > Op wo 21 aug. 2019 om 14:15 schreef Ishan Rastogi : > > > Option 1 > > > > Cheers, > > Ishan Rastogi > > > > On Wed, Aug 21, 2019

Re: [VOTE] Change the Airflow logo

Some sharp lookin' logo's! My vote would be option 1 as well Cheers, Fokko Op wo 21 aug. 2019 om 14:15 schreef Ishan Rastogi : > Option 1 > > Cheers, > Ishan Rastogi > > On Wed, Aug 21, 2019 at 5:44 PM Philippe Gagnon > wrote: > > > Option 1 > > > > Thanks for the hard work Chris and Daniel! >

Re: [VOTE] Change the Airflow logo

Option 1 Cheers, Ishan Rastogi On Wed, Aug 21, 2019 at 5:44 PM Philippe Gagnon wrote: > Option 1 > > Thanks for the hard work Chris and Daniel! > > On Wed, Aug 21, 2019, 06:58 Ash Berlin-Taylor wrote: > >> The discuss thread had a positive response so I'm now calling for a VOTE >> on updating

Re: [VOTE] Change the Airflow logo

Option 1 Thanks for the hard work Chris and Daniel! On Wed, Aug 21, 2019, 06:58 Ash Berlin-Taylor wrote: > The discuss thread had a positive response so I'm now calling for a VOTE > on updating the Airflow logo to one of the designs below. > > (Since no one said "I like the existing logo" I hav

Re: [VOTE] Change the Airflow logo

Option 1 On Wed, Aug 21, 2019 at 8:08 AM Tomasz Urbaszek wrote: > I vote for option 2. > Chris, Daniel - great job! > > Bests, > Tomek > > On Wed, Aug 21, 2019 at 12:58 PM Ash Berlin-Taylor wrote: > >> The discuss thread had a positive response so I'm now calling for a VOTE >> on updating the A

Re: [VOTE] Change the Airflow logo

Option 1 Best, *Verdan Mahmood* On Wed, Aug 21, 2019 at 2:08 PM Tomasz Urbaszek wrote: > I vote for option 2. > Chris, Daniel - great job! > > Bests, > Tomek > > On Wed, Aug 21, 2019 at 12:58 PM Ash Berlin-Taylor wrote: > >> The discuss thread had a positive response so I'm now calling for a

Re: [VOTE] Change the Airflow logo

I vote for option 2. Chris, Daniel - great job! Bests, Tomek On Wed, Aug 21, 2019 at 12:58 PM Ash Berlin-Taylor wrote: > The discuss thread had a positive response so I'm now calling for a VOTE > on updating the Airflow logo to one of the designs below. > > (Since no one said "I like the existi

Re: [VOTE] Change the Airflow logo

Hello, I vote for option 1 as well. Cheers, Karolina Rosół Polidea | Project Manager M: +48 606 630 236 <+48606630236> E: karolina.ro...@polidea.com [image: Polidea] Check out our projects! [image: Github]

Re: [VOTE] Change the Airflow logo

Hi, I vote for option 1. Cheers, Chris Ash Berlin-Taylor schrieb am Mi., 21. Aug. 2019, 12:58: > The discuss thread had a positive response so I'm now calling for a VOTE > on updating the Airflow logo to one of the designs below. > > (Since no one said "I like the existing logo" I have not put

Re: Airflow meetup in India

We should probably having discussions like this on the new users@ list (rather than the dev@ one) -ash > On 20 Aug 2019, at 05:23, Sumit Maheshwari wrote: > > Thanks, Kaxil. > > On Tue, Aug 20, 2019 at 4:53 AM Jarek Potiuk > wrote: > >> Happy Airflowing in Bangalore ! >> >> On Mon, Aug 19,

Re: airflow command not working

Hi Ullas, unfortunately, the airflow commands don't run on Windows like they do on Linux. I solved this problem by running Airflow in a Docker container on Windows or you could try using the WSL2. But I'm not sure if it's already general available on Windows 10. Cheers, Chris Driesprong, Fokko

Re: airflow command not working

Hi Ullas, Without any logs or errors, it is really hard to see what's going on. Astronomer did publish a nice guide on how to run Airflow on Windows, that might help: https://www.astronomer.io/guides/airflow-wsl/ Cheers, Fokko Op wo 21 aug. 2019 om 09:03 schreef Ullas Raj.N : > hi , > i have in

airflow command not working

hi , i have installed airflow in my windows , installation was successful but the command - "airflow initdb" is not working can u help me with this ?