kacpermuda commented on PR #63499: URL: https://github.com/apache/airflow/pull/63499#issuecomment-4648649668
Thanks @shnhdan, I think we can work without overlap here, those two PRs have the same goal, but you're focusing on producing side and I'm taking care of consuming side, which makes sense. For this PR, I think we can go with the solution you proposed, but maybe we can add a new config in [lineage](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#lineage) section of config, something very similar to [default_deferrable](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#default-deferrable), and then we can use this value as default for `enable_hook_level_lineage` in init of the hooks, as we do with deferrable in operators . This way, we keep the ability to provide this for single hook, but we also have a way to disable for all with single flag. Then, we can add this gating flag to more hooks. If we clearly state in the config description that not all hooks can honor this, we should be fine. Not all operators support deferrable as well, but we still have a default config. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
