Re: [DISCUSS] DRAFT AIP-68 Extended Plugin Interface + AIP-69 Remote Executor

2024-04-23 Thread Brent Bovenzi
I like AIP-68. I have been thinking about the exact same thing. I think it can fit into either 2.x or 3.0. Before we take it out of draft I need to play with plugins more to get a good sense of how to actually implement it. On Tue, Apr 23, 2024 at 12:38 AM Amogh Desai wrote: > Good work on the

Re: [DISCUSS] DRAFT AIP-68 Extended Plugin Interface + AIP-69 Remote Executor

2024-04-22 Thread Amogh Desai
Good work on the AIPs @Scheffler Jens (XC-DX/ETV5) ! I spent some time understanding your thoughts and I like the ideas and the direction you are heading too. I also agree with Jarek, that we might need to start thinking in terms of Airflow 3, especially now that you brought up AIP 68. Thanks &

Re: [DISCUSS] DRAFT AIP-68 Extended Plugin Interface + AIP-69 Remote Executor

2024-04-20 Thread Jarek Potiuk
Hey Jens, I looked at the AIPs when you created them and I very much like the directions put there - but it also got me into a lot of thinking on the future of Airflow and AIPs. See the thread I started https://lists.apache.org/thread/3chvg9964zvh15mtrbl073f4oj3nlzp2 - about Airflow 3. I think

[DISCUSS] DRAFT AIP-68 Extended Plugin Interface + AIP-69 Remote Executor

2024-04-19 Thread Scheffler Jens (XC-AS/EAE-ADA-T)
Dear Dev-Community, mainly triggered by the deadline for CFP for Summit I dropped two “brand new” AIP’s as ideas that are running in my head for a longer time. Note these are DRAFT versions as a first write-up as solution concept and are lagging technical design and implementation yet. I’d