Hey, I'd like to announce a new proposal. It proposes instrumenting Airflow Hooks and Object Storage to collect dataset updates automatically, to allow gathering lineage from PythonOperator and custom operators. Let me know what you think about this.
The scope of this proposal was initially larger, and I left most of it as potential future work - I would love to get some comments about it, even if it won't be done soon. Thanks, Maciej