Hi folks. I am working on adding support for OpenTelemetry based on AIP-49 and
I think we have come to a point where it is worth discussing options.
Currently `airflow/stats.py`[1] contains classes for a base/NoStats option as
well as Statsd and DataDog, and I will be adding in another option for OTel. I
think it is getting to the point where we may want to break these out like we
do with provider packages and let the users install only the metrics backend(s)
they want.
If we do, then where would they live? Should they fall in with the service
provider packages at `airflow/providers/{statsd | datadog | otel}/`, or maybe a
new location like `airflow/stats/providers/{statsd | datadog | otel}`? If we
make the move, then we would also need to sort out how to handle the change.
Perhaps the provider packages for the existing options should be bundled with
core for now and later moved to fully-separated like all the other provide
packages?
I'd love to hear what you folks think.
- ferruzzi
[1] https://github.com/apache/airflow/blob/main/airflow/stats.py
