Hey,
I'd like to announce a new proposal. It proposes instrumenting Airflow
Hooks and Object Storage to collect dataset updates automatically, to allow
gathering lineage from PythonOperator and custom operators. Let me know
what you think about this.

The scope of this proposal was initially larger, and I left most of it as
potential future work - I would love to get some comments about it, even if
it won't be done soon.

Thanks,
Maciej

Reply via email to