potiuk commented on issue #51978: URL: https://github.com/apache/airflow/issues/51978#issuecomment-2993372839
to be honest, I do not think airflow wants to be a "lineage" tool. It already emits all the events via open-lineager and you can connect it to other lineget tools (many of the lineage solutions already injest open-lineage events and allows to visualise and navigate data dependencies. Airflow is a workflow scheduling solution - execution platform that exposes APIs and provides extension points that other tools can make use of. We do not want Airflow to be "single solution to all your data needs" - that's a non-goal for us. I will turn it into discussion, but It's quite unlikely we will change our approach here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
