Re: [Discussion] Deprecate auto cleanup RenderedTaskInstanceFields and decouple k8s_pod_yaml

2023-01-28 Thread Andrey Anshin
First of all I want to highlight that this approach I guess worked well until Dynamic Task Mappings introduced. > The main reason for adding that cleanup was -- if you don't do that, you will have many rows, similar to the TaskInstance table The problem itself is not how big your table/indexes, r

Re: [Discussion] Deprecate auto cleanup RenderedTaskInstanceFields and decouple k8s_pod_yaml

2023-01-28 Thread Kaxil Naik
> > Potentially it is a good idea to deprecate this option and recommend for > users to set it to 0? WDYT? Maybe someone has already tried or investigated > this? The main reason for adding that cleanup was -- if you don't do that, you will have many rows, similar to the TaskInstance table. And t

Re: AIP-49 OpenTelemetry Support - Take Three

2023-01-28 Thread Howard Yoo
Hi everybody. Howard Yoo here. I authored the AIP-49, and just to give you all some updates, I haven't been successful in making much progress on this proposal, due to the fact that my original intention was to publish AIP-49 after my POC on open telemetry, and wanted to hand it over to whomever w

[Discussion] Deprecate auto cleanup RenderedTaskInstanceFields and decouple k8s_pod_yaml

2023-01-28 Thread Andrey Anshin
Greetings! During migrating our ORM syntax to compatible with SQLAlchemy 2.0 I probably found skeletons in the closet. Let's start from the beginning, initially I got this warning airflow/models/renderedtifields.py:245 RemovedIn20Warning('ORDER BY columns added implicitly due to DISTINCT is depr