Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-09-18 Thread via GitHub
vincbeck closed issue #33647: Airflow Triggerer facing frequent restarts URL: https://github.com/apache/airflow/issues/33647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-07-04 Thread via GitHub
josephangbc commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-2208326475 Hi @eladkal, we have raised PR #40487. Could you help us to review it? Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-05-15 Thread via GitHub
eladkal commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-2112474170 Hi @arunravimv you can open PR with your suggested code changes and we can review specific suggestion on the PR itself -- This is an automated message from the Apache Git Service

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-05-04 Thread via GitHub
arunravimv commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-2094577106 Hi Airflow Community, we faced the same issue on Airflow 2.7.3 (using AWS RDS MySql 8.0.35). For large airflow deployments with 1000s of active dags and large volume of records

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-01-02 Thread via GitHub
shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1874060345 @QuintenBruynseraede we are doing somewhat the same thing, as mentioned we are deleting all tasks instances before 90 days, but will check this as well Thanks for help

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2024-01-02 Thread via GitHub
QuintenBruynseraede commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1874054112 For what it's worth, I managed to fix this issue by cleaning up some old records from the `trigger` table. The table only had 88 rows, of which none were old than ±2 mo

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-12-08 Thread via GitHub
tirkarthi commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1846989815 @shubhransh-eb Can you please add the previous version of Airflow where it worked fine? We upgraded from Airflow 2.3.4 to 2.7.2. We are also using mysql 8 and faced the query tak

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-29 Thread via GitHub
shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1831579882 When you ran the query, did it show a historic query or a current running as well? In our case, it returns in about 5 seconds, but when the issue is reported, it runs for a l

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-29 Thread via GitHub
QuintenBruynseraede commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1831573438 Thanks for the response. I ran the commands [in this article](https://www.shanelynn.ie/postgresql-find-slow-long-running-and-blocked-queries/) to show long-running quer

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-28 Thread via GitHub
shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1831178128 @QuintenBruynseraede , From what I observe, every min triggerer runs a query to find the number of triggers that are running at a given time. If query doesnt return an

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-28 Thread via GitHub
QuintenBruynseraede commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1830753096 @shubhransh-eb I believe we're seeing the same issue on Airflow 2.7.2, though we are using an RDS Postgres instance. I'm looking for a starting point to do some more in

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-08 Thread via GitHub
shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1801327618 Thank you for the input and advice @potiuk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-08 Thread via GitHub
potiuk commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1801324111 There is no other source of information for that than public issues if there are no updates, it means that there are no updates, generally. Possibly at some point in time before the

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-11-07 Thread via GitHub
shubhransh-eb commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1801095909 Hello, Just wanted to know if we have any update on this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub