Hi Hussein,

Thanks for creating this. @Daniel Standish
<[email protected]>, @Tzu-ping
Chung <[email protected]> and I (well, mostly them :) ) will take a look. We
have started defining an implementation plan, but it's still early so
perfect timing.

Constance

On Sun, Aug 31, 2025 at 6:23 PM Hussein Awala <[email protected]> wrote:

> Hi all,
>
> I’m not sure if the Astronomer team has already started work on
> implementing *AIP-76*, but I’ve prepared a proposal for how we could
> approach the implementation.
>
> The proposal covers:
>
>    -
>
>    Extending the asset/event model to support partitions
>    -
>
>    A normalized schema for asset event partitions
>    -
>
>    Watermark- and completeness-based scheduling (daily/weekly/monthly and
>    optional rolling windows)
>    -
>
>    Handling of re-processed partitions
>
> You can find the proposal document here:
>
> https://docs.google.com/document/d/17RMpjronpNerqHBN-KwNn0jjscrSYJzSDhAakentfd0/edit?usp=sharing
>
> I’d appreciate your feedback and review. My suggestion is that we start
> implementation after the *Airflow 3.1 release.*
>
>
> Looking forward to your thoughts,
>
> Hussein
>

Reply via email to