Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-08 Thread Rahul Vats
+1 (non-binding). Verified running our example DAGs. LGTM Regards, Rahul Vats 9953794332 On Sun, 9 Jun 2024 at 01:21, Scheffler Jens (XC-AS/EAE-ADA-T) wrote: > +1 non binding > > Sent from Outlook for iOS > > From: Phani Kumar > Sent:

Re: [DISCUSS] AIP-71 Generalizing DAG Loader and Processor for Ephemeral Storage

2024-06-08 Thread Tzu-ping Chung
On Git (and other VCS for the matter) specifically, I believe respec only supports GitHub because it uses the GitHub API instead of Git. I’m only guessing, but using Git for random access would have terrible performance and is likely not an option for them. Airflow does not have the same

Re: [DISCUSS] common.compat provider (WAS: Common.util provider?)

2024-06-08 Thread Jarek Potiuk
I have an idea about that one, and probably that one will fulfill the "polyfill" approach discussed earlier. I think we should not name the provider "common.util" but "common.compat" - because all the code that we need to put there is really about keeping compatibility. For example look here

Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-08 Thread Scheffler Jens (XC-AS/EAE-ADA-T)
+1 non binding Sent from Outlook for iOS From: Phani Kumar Sent: Saturday, June 8, 2024 3:45:18 PM To: dev@airflow.apache.org Subject: Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1 +1 non binding On Sat, 8 Jun 2024, 15:02 Hussein Awala,

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Buğra Öztürk
Hello Jarek, Thanks for sharing! It sounds very interesting. I would like to join. Could you please forward to me as well? Thanks! On Sat, 8 Jun 2024, 17:28 Jed Cunningham, wrote: > Interesting. Can you forward to me as well Jarek? Thanks! >

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Jed Cunningham
Interesting. Can you forward to me as well Jarek? Thanks!

Re: [DISCUSS] AIP-71 Generalizing DAG Loader and Processor for Ephemeral Storage

2024-06-08 Thread Jed Cunningham
Sorry for the delayed reply here. I've been chewing on this one a bit though. One concern I have is that I highly value having a provider agnostic remote git integration. fsspec, however, has local git or github - no arbitrary remote git support. That means Airflow, in my view, can't just rely on

Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-08 Thread Phani Kumar
+1 non binding On Sat, 8 Jun 2024, 15:02 Hussein Awala, wrote: > +1 (binding) checked signatures, checksums, licences and sources. > > On Saturday, June 8, 2024, rom sharon wrote: > > > +1 (non-binding) > > >

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Pankaj Koti
Hello Jarek, Thanks for sharing this. I would like to join as well, please! On Sat, 8 Jun 2024, 14:33 Sumit Maheshwari, wrote: > Same, add me as well. Thanks!! > > On Sat, Jun 8, 2024 at 2:27 PM Kaxil Naik wrote: > > > Same, would love to join > > > > On Sat, 8 Jun 2024 at 09:19, Aritra Basu

Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-08 Thread Hussein Awala
+1 (binding) checked signatures, checksums, licences and sources. On Saturday, June 8, 2024, rom sharon wrote: > +1 (non-binding) >

Re: [VOTE] Airflow Providers prepared on June 07, 2024

2024-06-08 Thread Rahul Vats
+1 (non-binding) Verified running our example DAG. Regards, Rahul Vats 9953794332 On Sat, 8 Jun 2024 at 14:13, Ephraim Anierobi wrote: > +1 (binding) checked reproducibility, licenses, signatures & checksum > > On Sat, 8 Jun 2024 at 09:24, rom sharon wrote: > > > +1 (non-binding) > > >

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Sumit Maheshwari
Same, add me as well. Thanks!! On Sat, Jun 8, 2024 at 2:27 PM Kaxil Naik wrote: > Same, would love to join > > On Sat, 8 Jun 2024 at 09:19, Aritra Basu wrote: > > > Hi Jarek, > > > > I'd be interested to join. > > > > -- > > Regards, > > Aritra Basu > > > > On Sat, Jun 8, 2024, 12:24 PM Jarek

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Kaxil Naik
Same, would love to join On Sat, 8 Jun 2024 at 09:19, Aritra Basu wrote: > Hi Jarek, > > I'd be interested to join. > > -- > Regards, > Aritra Basu > > On Sat, Jun 8, 2024, 12:24 PM Jarek Potiuk wrote: > > > Hello here, > > > > At PyCon US I met a few people from Nielsen who had developed

Re: [VOTE] Airflow Providers prepared on June 07, 2024

2024-06-08 Thread Ephraim Anierobi
+1 (binding) checked reproducibility, licenses, signatures & checksum On Sat, 8 Jun 2024 at 09:24, rom sharon wrote: > +1 (non-binding) >

Re: [VOTE] Release Airflow 2.9.2 from 2.9.2rc1

2024-06-08 Thread rom sharon
+1 (non-binding)

Re: [VOTE] Airflow Providers prepared on June 07, 2024

2024-06-08 Thread rom sharon
+1 (non-binding)

Re: Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Aritra Basu
Hi Jarek, I'd be interested to join. -- Regards, Aritra Basu On Sat, Jun 8, 2024, 12:24 PM Jarek Potiuk wrote: > Hello here, > > At PyCon US I met a few people from Nielsen who had developed internally > tooling for IDE/Python debugger integrated debugging of Airflow DAGs. > > They are

Call with Nielsen team demoing their DAG debugging feature

2024-06-08 Thread Jarek Potiuk
Hello here, At PyCon US I met a few people from Nielsen who had developed internally tooling for IDE/Python debugger integrated debugging of Airflow DAGs. They are thrilled with the opportunity of sharing what they've done and possibly maybe even bringing it to Airflow. As one of the Airflow 3

Re: [Meeting Notes] Airflow 3.0 Dev call - 4 June 2024

2024-06-08 Thread Jarek Potiuk
Very good summary Kaxil. Reviewed it and it looks like all things we discussed are captured well. Also I am really happy that we are starting to formalize and converge on the set of basic principles - they will help us to focus on particular "streams" while keeping those in mind when we are going