Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3190562516 I haven't seen this occur again. Therefore, I'm assuming that it has been fixed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 closed issue #52906: test_otel.py::TestOtelIntegration is flaky URL: https://github.com/apache/airflow/issues/52906 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3041699484 Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
potiuk commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3041534754 > I've opened a PR with a fix. For more info, check the PR description. Merged. Let's see. Thanks for the super-quick and in-depth analysis,. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3041429685 I've opened a PR with a fix. For more info, check the PR description. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3041171107 During these failures, the paused scheduler thread never comes back. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3041168665 I've concluded that the issue is with the 2nd test, `test_scheduler_change_after_the_first_task_finishes`. The test * uses 2 schedulers * pauses the 1st scheduler thread so that the 2nd will pick up processing the dag_run * once the dag_run has finished, it resumes the paused scheduler to check that it makes the needed updates to the db Once that fails, then the rest fail as well. After commenting it out, there are no more failures. 40/40 successful executions where there used to be 12-15 failures in 40 runs. https://github.com/xBis7/airflow/actions/runs/16096527407 https://github.com/xBis7/airflow/actions/runs/16096660040 https://github.com/xBis7/airflow/actions/runs/16096742809 https://github.com/xBis7/airflow/actions/runs/16096823166 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3039038067 > Are you going to mark it as flaky ? If so you can even add comment and link to that issue. I'm trying to fix it. If it takes longer than expected then I'll mark it as flaky. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
potiuk commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3038882282 Are you going to mark it as flaky ? If so you can even add comment and link to that issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3038867076 @potiuk Thank you! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
potiuk commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3038865865 Assigned it to the project . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
Re: [I] test_otel.py::TestOtelIntegration is flaky [airflow]
boring-cyborg[bot] commented on issue #52906: URL: https://github.com/apache/airflow/issues/52906#issuecomment-3038856448 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
[I] test_otel.py::TestOtelIntegration is flaky [airflow]
xBis7 opened a new issue, #52906: URL: https://github.com/apache/airflow/issues/52906 ### Apache Airflow version main (development) ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? The test class has a 20% failure rate. https://github.com/xBis7/airflow/actions/runs/16086980198 https://github.com/xBis7/airflow/actions/runs/16087424463 https://github.com/xBis7/airflow/actions/runs/16087596566 I'm attaching a file with the logs [fail_logs.txt](https://github.com/user-attachments/files/21076055/fail_logs.txt) ### What you think should happen instead? _No response_ ### How to reproduce I can't reproduce it locally, it's occurring only on the remote CI. It can be reproduced by running the test on the CI on repeat. Increasing execution concurrency makes it more likely to occur ``` max-parallel: 10 ``` ### Operating System The CI uses ubuntu-22.04. ### Versions of Apache Airflow Providers _No response_ ### Deployment Docker-Compose ### Deployment details _No response_ ### Anything else? _No response_ ### Are you willing to submit PR? - [x] Yes I am willing to submit a PR! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
