Re: Add retry option for TaskGroup

2022-04-13 Thread Jarek Potiuk
I think I share Elad's and RafaƂ's (and I feel Tomek's since he raised it) sentiment, Up till now it was a "visual feature" and yeah "subdag" left a bad taste, so if this is going to be implemented, I'd say AIP with deep discussion and considering all edge cases is needed first. I agree with Elad

Re: "Release Notes" - rethinking our CHANGELOG and UPDATING docs

2022-04-13 Thread Jarek Potiuk
Sure :) if you are willing to sync and reconcile it at release tiem - I am all for it :). Happy to help along the process too as needed and try out and improve automation as we go (hopefully it means not too much of a chaos). I am likely more on being perfectionist (which has good and bad sides)

Re: [DISCUSS] Approach for new providers of the community

2022-04-13 Thread Alex Ott
Hello all I want to try to explain a motivation behind submission of the Delta Sharing provider: - Let me start with the fact that the original issue was created against Airflow repository, and it was accepted as potential new functionality. And discussion about new providers has

Re: "Release Notes" - rethinking our CHANGELOG and UPDATING docs

2022-04-13 Thread Jed Cunningham
A few snippets from Jarek I'd like to comment on: So if we have some way of explaining what to do and we think we can explain both committers and contributors what to do and we are ready to deal with the aftermath of those being misunderstood/forgotten/not followed, it's fine to

Status of testing Providers that were prepared on April 13, 2022

2022-04-13 Thread Jarek Potiuk
Hey all, I have just cut the Airflow Providers Databricks RC2 package for release. This email is calling a vote on the release, which will last for 72 hours - which means that it will end on Sat 16 Apr 16:4 0 CEST 2022. Consider this my (binding) +1. Only Dataricks provider with an RC2 (bugfix

[DISCUSS] Experimental Prod ARM64 image for 2.3.0 ?

2022-04-13 Thread Jarek Potiuk
Hey everyone, We have a CI image multi-platform image (including ARM64) platform for a few weeks and - to be perfectly honest - it's heaven and earth compared to the emulated image. Except running tests and supporting mssql and mysql - we **could** if we want to push a multiplatform image when

Data Engineering track at ApacheCon (October 3-6, New Orleans)

2022-04-13 Thread Jarek Potiuk
Hello Everyone. There is an ApacheCon NA coming this year in October ( https://apachecon.com/acna2022/) and it's going to be an "ONSITE" event - 3-6 October, New Orleans, Louisiana! It's one of the best events ever when it comes to community building at Apache so I heartily invite everyone.