Re: [I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-21 Thread via GitHub
kaxil commented on issue #40282: URL: https://github.com/apache/airflow/issues/40282#issuecomment-2177277145 >@raphaelauv Thank you for your ideas, but I think this can be not directly related to this exact issue with adding exact logs to output. Maybe it will be more efficient to create a

Re: [I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-18 Thread via GitHub
VladaZakharova commented on issue #40282: URL: https://github.com/apache/airflow/issues/40282#issuecomment-2175592531 @eladkal @potiuk @kaxil Let's continue here our discussion about adding more logs in our output @raphaelauv Thank you for your ideas, but I think this can be not direct

Re: [I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-18 Thread via GitHub
raphaelauv commented on issue #40282: URL: https://github.com/apache/airflow/issues/40282#issuecomment-2175479486 AIRFLOW__SECRETS__USE_CACHE is by default at false and yes this feature will no more be usefull when DAG_PARSING_METADATABASE_CALL_FORBIDEN is set to True -- This is an automa

Re: [I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-17 Thread via GitHub
troxil commented on issue #40282: URL: https://github.com/apache/airflow/issues/40282#issuecomment-2174562083 @raphaelauv Wouldn't such a feature conflict with the theory of the Secrets Cache that was recently released too? -- This is an automated message from the Apache Git Service. To r

Re: [I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-17 Thread via GitHub
raphaelauv commented on issue #40282: URL: https://github.com/apache/airflow/issues/40282#issuecomment-2173875452 Good idea ! I would also love a global airflow option `DAG_PARSING_METADATA_CALL_FORBIDEN` that could be set to True , so parsing of dags with variable / connecti

[I] Number of queries to Airflow database in "DAG File Processing Stats" [airflow]

2024-06-17 Thread via GitHub
MaksYermak opened a new issue, #40282: URL: https://github.com/apache/airflow/issues/40282 ### Description This new feature will add a new column to the "DAG File Processing Stats" of DAG processor logs. This column will store information about the number of queries to the Airflow da