Re: [PR] Opensearch operator set connection type [airflow]

2024-06-07 Thread via GitHub
eladkal merged PR #39788: URL: https://github.com/apache/airflow/pull/39788 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: feat: OpenSearchQueryOperator using an endpoint with a self-signed certificate (#39788)

2024-06-07 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1a61eb3afd feat: OpenSearchQueryOperator using an

Re: [PR] Don't pass auth to opensearch client with empty login and password [airflow]

2024-06-07 Thread via GitHub
eladkal commented on PR #39982: URL: https://github.com/apache/airflow/pull/39982#issuecomment-2155822194 cc @cjames23 can you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Resolve azure provider deprecations in tests [airflow]

2024-06-07 Thread via GitHub
eladkal commented on code in PR #40132: URL: https://github.com/apache/airflow/pull/40132#discussion_r1631883009 ## tests/providers/microsoft/azure/hooks/test_adx.py: ## @@ -279,20 +279,28 @@ def test_run_query(self, mock_execute, mocked_connection): assert

Re: [PR] Resolve azure provider deprecations in tests [airflow]

2024-06-07 Thread via GitHub
eladkal commented on code in PR #40132: URL: https://github.com/apache/airflow/pull/40132#discussion_r1631883009 ## tests/providers/microsoft/azure/hooks/test_adx.py: ## @@ -279,20 +279,28 @@ def test_run_query(self, mock_execute, mocked_connection): assert

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
dirrao commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155794504 Tested #39834, #39829 and #40020. They looks good to me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] Tasks Stuck at Scheduled State [airflow]

2024-06-07 Thread via GitHub
hbc-acai commented on issue #40106: URL: https://github.com/apache/airflow/issues/40106#issuecomment-2155759269 Thanks @jedcunningham. I upgraded `apache-airflow-providers-cncf-kubernetes==8.3.0` and I have not seen the same error in the last few hours. -- This is an automated message

Re: [PR] Add rpc server to helm chart [airflow]

2024-06-07 Thread via GitHub
dstandish commented on PR #38549: URL: https://github.com/apache/airflow/pull/38549#issuecomment-2155732789 > Yes I am talking about the helm chart docs. Consider someone who came across this rpc feature. The most basic question is what do I need this for? What value does it bring? If this

Re: [PR] Add rpc server to helm chart [airflow]

2024-06-07 Thread via GitHub
dstandish commented on code in PR #38549: URL: https://github.com/apache/airflow/pull/38549#discussion_r1631797694 ## helm_tests/webserver/test_rpc_server.py: ## @@ -0,0 +1,923 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [I] GCStoS3 Operator [airflow]

2024-06-07 Thread via GitHub
github-actions[bot] commented on issue #39737: URL: https://github.com/apache/airflow/issues/39737#issuecomment-2155715349 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

[PR] Allow executors to be specified with only the class name of the Executor [airflow]

2024-06-07 Thread via GitHub
syedahsn opened a new pull request, #40131: URL: https://github.com/apache/airflow/pull/40131 Currently, specifying executors is done by an alias, or the full module path of the Executor. This change allows users to also use the class name of the executor to specify which executor to run

Re: [PR] Add rpc server to helm chart [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on code in PR #38549: URL: https://github.com/apache/airflow/pull/38549#discussion_r1631711428 ## helm_tests/webserver/test_rpc_server.py: ## @@ -0,0 +1,923 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [PR] Add warning to deprecated api docs that access control isn't applied [airflow]

2024-06-07 Thread via GitHub
jedcunningham merged PR #40129: URL: https://github.com/apache/airflow/pull/40129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Add warning to deprecated api docs that access control isn't applied (#40129)

2024-06-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 85be1867a6 Add warning to deprecated api

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155467578 Cool :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
dondaum commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155465725 Sure. Please assign it to me. Happy to help here. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155461492 > I can have a look at it and see if and how we could enable or at least optional enable it. PRs to add it back are always most welcome -- This is an automated message

(airflow) branch constraints-main updated: Updating constraints. Github run id:9421049843

2024-06-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 60fb517032 Updating

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
dondaum commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155430863 In 1.10.12 the postgres operator logged all notices after running the sql command. I think this happens

[PR] Add warning to deprecated api docs that access control isn't applied [airflow]

2024-06-07 Thread via GitHub
jedcunningham opened a new pull request, #40129: URL: https://github.com/apache/airflow/pull/40129 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
gopidesupavan commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155396462 Thanks @arollet-decathlon for testing #40051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
gopidesupavan commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155395154 Tested both #40014 and #39923 working fine. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] Upgrade to codecov@v4 [airflow]

2024-06-07 Thread via GitHub
potiuk opened a new pull request, #40128: URL: https://github.com/apache/airflow/pull/40128 Codecov3 uses deprecated node version and generates warnings. --- **^ Add meaningful description above** Read the **[Pull Request

Re: [I] Tasks Stuck at Scheduled State [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on issue #40106: URL: https://github.com/apache/airflow/issues/40106#issuecomment-2155322756 It's this one, `apache-airflow-providers-cncf-kubernetes==8.1.1`, sorry, I tend to just refer to it as the "k8s provider", but its actually named "CNCF Kubernetes".

Re: [I] Amazon Provider v8.23.0 `importlib_metadata` module import error [airflow]

2024-06-07 Thread via GitHub
boring-cyborg[bot] commented on issue #40127: URL: https://github.com/apache/airflow/issues/40127#issuecomment-2155321374 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Amazon Provider v8.23.0 `importlib_metadata` module import error [airflow]

2024-06-07 Thread via GitHub
aiell0 opened a new issue, #40127: URL: https://github.com/apache/airflow/issues/40127 ### Apache Airflow Provider(s) amazon ### Versions of Apache Airflow Providers Amazon provider v8.23.0 ### Apache Airflow version 2.7.0 ### Operating System

[PR] Add GenerationConfig and SafetySettings parameters to Google Cloud Multimodal Model Operators [airflow]

2024-06-07 Thread via GitHub
CYarros10 opened a new pull request, #40126: URL: https://github.com/apache/airflow/pull/40126 Gemini / Multimodal model Airflow Hooks/Operators should mimic typical usage as defined in the sample code block below. This provides fine-tuning model output via the additional configurations

Re: [PR] Handle db isolation for mapped operators and task groups [airflow]

2024-06-07 Thread via GitHub
dstandish commented on PR #39259: URL: https://github.com/apache/airflow/pull/39259#issuecomment-2155287687 @uranusjr you have any concerns here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] AIP-64: Add TaskInstance history table [airflow]

2024-06-07 Thread via GitHub
dstandish commented on code in PR #39951: URL: https://github.com/apache/airflow/pull/39951#discussion_r1631530597 ## airflow/models/taskinstancehistory.py: ## @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [I] Tasks Stuck at Scheduled State [airflow]

2024-06-07 Thread via GitHub
hbc-acai commented on issue #40106: URL: https://github.com/apache/airflow/issues/40106#issuecomment-2155269930 @jedcunningham Yes, I do not see more than 10 more pods show in READY=0/1 and Status=complete states when I run `kubectl get pods -n airflow`. Sorry, how can I export

(airflow) branch main updated: Fix openai 1.32 breaking openai tests (#40110)

2024-06-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 65dbf86f72 Fix openai 1.32 breaking openai tests

Re: [PR] Fix openai 1.32 breaking openai tests [airflow]

2024-06-07 Thread via GitHub
potiuk merged PR #40110: URL: https://github.com/apache/airflow/pull/40110 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[I] Password autocompletion set to off on login page [airflow]

2024-06-07 Thread via GitHub
datta90 opened a new issue, #40125: URL: https://github.com/apache/airflow/issues/40125 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.1 ### What happened? my company

Re: [I] Password autocompletion set to off on login page [airflow]

2024-06-07 Thread via GitHub
boring-cyborg[bot] commented on issue #40125: URL: https://github.com/apache/airflow/issues/40125#issuecomment-2155250306 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

Re: [PR] Fix openai 1.32 breaking openai tests [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40110: URL: https://github.com/apache/airflow/pull/40110#issuecomment-2155250244 Yep. Pinning UV to 0.2.5 fixes the problem. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Added kube-prometheus-stack servicemonitor to gather metrics from Airflow statsd exporter [airflow]

2024-06-07 Thread via GitHub
lucasfcnunes commented on PR #31040: URL: https://github.com/apache/airflow/pull/31040#issuecomment-2155246358 > Hi @sudeepgupta90 I also have use case where id like to have the serviceMonitor integrated into the airflow chart (currently i create my own serviceMonitor, airflow chart is a

Re: [I] Tasks Stuck at Scheduled State [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on issue #40106: URL: https://github.com/apache/airflow/issues/40106#issuecomment-2155244202 Assuming you haven't installed a different version of the k8s provider, you're running on 8.1.1. @hbc-acai @bangnh1 do either of you see pods stacking and not being

Re: [I] Kubernetes is not reporting back workers status to Airflow [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on issue #39200: URL: https://github.com/apache/airflow/issues/39200#issuecomment-2155237405 @aru-trackunit, can you try with k8s provider 8.3.0? It contains #39551, which will hopefully solve your issue. -- This is an automated message from the Apache Git

Re: [I] moving single object with `GCSToGCSOperator` differs from gsutil mv command [airflow]

2024-06-07 Thread via GitHub
boraberke commented on issue #37576: URL: https://github.com/apache/airflow/issues/37576#issuecomment-2155234476 Would like to work on this issue, @eladkal could you please assign? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] Numerous error reports in airflow logs due to function argument mismatch [airflow]

2024-06-07 Thread via GitHub
leakec commented on issue #40011: URL: https://github.com/apache/airflow/issues/40011#issuecomment-2155175285 Can confirm `3.7.2rc1` is working for me as well. Will also post in #40015. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
leakec commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155170930 Tested `celery: 3.7.2rc1` and verified it implements #40012 and that it fixes #40011. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Add run_id to event logs API [airflow]

2024-06-07 Thread via GitHub
boraberke commented on issue #34211: URL: https://github.com/apache/airflow/issues/34211#issuecomment-2155166330 Seems like #37731 added `run_id`. @Taragolis maybe this issue can be closed? -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
yehoshuadimarsky commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155160571 Tested Amazon provider, works for me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Fix openai 1.32 breaking openai tests [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40110: URL: https://github.com/apache/airflow/pull/40110#issuecomment-2155153373 I was too eager to upgrade UV this morning :facepalm: The bug in uv crossed with attempts to fix the dependencies (@hussein-awala - this is why earlier I warned to be a bit

Re: [PR] Fix openai 1.32 breaking openai tests [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40110: URL: https://github.com/apache/airflow/pull/40110#issuecomment-2155148060 Hah it turned out that it is likely a bug introduced in uv==0.2.6 and for now we should limit uv to 0.2.5 See https://github.com/astral-sh/uv/issues/4136 for details --

Re: [PR] add git-sync-ssh secret template [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on code in PR #39936: URL: https://github.com/apache/airflow/pull/39936#discussion_r1631421462 ## chart/templates/secrets/git-ssh-key-secret.yaml: ## @@ -0,0 +1,34 @@ +{{/* + Licensed to the Apache Software Foundation (ASF) under one + or more

Re: [PR] add git-sync-ssh secret template [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on code in PR #39936: URL: https://github.com/apache/airflow/pull/39936#discussion_r1631413379 ## helm_tests/other/test_git_sync_scheduler.py: ## @@ -211,6 +211,45 @@ def test_validate_if_ssh_params_are_added(self): "secret": {"secretName":

Re: [PR] feat: enable mysql keda support for triggerer [airflow]

2024-06-07 Thread via GitHub
jedcunningham merged PR #37365: URL: https://github.com/apache/airflow/pull/37365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Chart: enable mysql keda support for triggerer (#37365)

2024-06-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 44a5300594 Chart: enable mysql keda support

Re: [PR] doc: helm chart airflow version [airflow]

2024-06-07 Thread via GitHub
jedcunningham commented on code in PR #40087: URL: https://github.com/apache/airflow/pull/40087#discussion_r1631394809 ## chart/README.md: ## @@ -40,9 +40,9 @@ cluster using the [Helm](https://helm.sh) package manager. * Supported AWS executors with AWS provider version

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155084921 > The weird thing is that they were being printed in the version we were using previously (`1.10.12`), but not in the new one. Are you aware of any major changes made to the

(airflow) branch main updated: Fix param order in PythonOperator docstring (#40122)

2024-06-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b49db97b8e Fix param order in

Re: [PR] Fix param order in PythonOperator docstring [airflow]

2024-06-07 Thread via GitHub
jedcunningham merged PR #40122: URL: https://github.com/apache/airflow/pull/40122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Title: Error When Using Multiple DataSets as Triggers in Apache AirFlow [airflow]

2024-06-07 Thread via GitHub
boraberke commented on issue #36837: URL: https://github.com/apache/airflow/issues/36837#issuecomment-2155078649 Hi @SoftDed, I think the problem happens after `xcom_pull` is called. If one collect `source_task_instances` first and then calls `xcom_pull`, then it works without any

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
hpereira98 commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155063742 The weird thing is that they were being printed in the version we were using previously (`1.10.12`), but not in the new one. Are you aware of any major changes made to the

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2155059142 For anyone who would like to implement it (maybe you @hpereira98 ? This is the most certain way to get it done, otherwise it will have to wait for someone who will volunteer to

Re: [I] Tasks Stuck at Scheduled State [airflow]

2024-06-07 Thread via GitHub
hbc-acai commented on issue #40106: URL: https://github.com/apache/airflow/issues/40106#issuecomment-2155035279 I upgraded from 2.7.3 directly to 2.9.1 and this issue showed up. We did not catch it during testing because it only happened after running the scheduler for some time. Today I

Re: [PR] AIP-64: Add TaskInstance history table [airflow]

2024-06-07 Thread via GitHub
ephraimbuddy commented on code in PR #39951: URL: https://github.com/apache/airflow/pull/39951#discussion_r1631349690 ## airflow/models/taskinstance.py: ## @@ -3186,6 +3189,14 @@ def fetch_handle_failure_context( if task and fail_stop:

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
arollet-decathlon commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2155006252 Tested #40051 it fixed #39970 ! Huge thanks @gopidesupavan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] AIP-64: Add TaskInstance history table [airflow]

2024-06-07 Thread via GitHub
ephraimbuddy commented on code in PR #39951: URL: https://github.com/apache/airflow/pull/39951#discussion_r1631328804 ## airflow/models/taskinstance.py: ## @@ -553,6 +553,26 @@ def clear_task_instances( session.flush() +def record_task_instance_history(ti, session): +

Re: [PR] AIP-64: Add TaskInstance history table [airflow]

2024-06-07 Thread via GitHub
ephraimbuddy commented on code in PR #39951: URL: https://github.com/apache/airflow/pull/39951#discussion_r1631324752 ## airflow/models/taskinstancehistory.py: ## @@ -0,0 +1,103 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [I] EmrServerlessStartJobOperator causes dag load failure when using XComArg [airflow]

2024-06-07 Thread via GitHub
fjmacagno commented on issue #40103: URL: https://github.com/apache/airflow/issues/40103#issuecomment-2154975696 ``` from datetime import datetime from airflow import DAG from airflow.providers.amazon.aws.operators.emr import ( EmrServerlessCreateApplicationOperator,

[PR] Fix param order in PythonOperator docstring [airflow]

2024-06-07 Thread via GitHub
jedcunningham opened a new pull request, #40122: URL: https://github.com/apache/airflow/pull/40122 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
hpereira98 commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2154951296 Added example function and DAG! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Add CloudRunServiceHook and operator (create) [airflow]

2024-06-07 Thread via GitHub
jx2lee commented on PR #40008: URL: https://github.com/apache/airflow/pull/40008#issuecomment-2154947068 @shahar1 CI test that was failed have now passed! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Add CloudRunServiceHook and operator (create) [airflow]

2024-06-07 Thread via GitHub
jx2lee commented on code in PR #40008: URL: https://github.com/apache/airflow/pull/40008#discussion_r1631292615 ## tests/system/providers/google/cloud/cloud_run/example_cloud_run_service.py: ## @@ -0,0 +1,93 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +#

Re: [I] Numerous error reports in airflow logs due to function argument mismatch [airflow]

2024-06-07 Thread via GitHub
PHameete commented on issue #40011: URL: https://github.com/apache/airflow/issues/40011#issuecomment-2154899492 Can confirm 3.7.2rc1 is working fine for me. Thank you for all the fast action and trying to get 3.7.2 released fast  -- This is an automated message from the Apache Git

(airflow) branch main updated: Implement CloudComposerDAGRunSensor (#40088)

2024-06-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 86e613029b Implement CloudComposerDAGRunSensor

Re: [PR] Implement CloudComposerDAGRunSensor [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40088: URL: https://github.com/apache/airflow/pull/40088#issuecomment-2154892621 Interesting feature :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Implement CloudComposerDAGRunSensor [airflow]

2024-06-07 Thread via GitHub
potiuk merged PR #40088: URL: https://github.com/apache/airflow/pull/40088 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2154888699 BTW. It would be great for somoeone who might want to look at it, if you posted example of the functions and how you are calling them @hpereira98 - otherwise it might be difficult

Re: [I] Operator `SQLExecuteQueryOperator` not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40116: URL: https://github.com/apache/airflow/issues/40116#issuecomment-2154881083 If someone would like to investigate it, I marked it as good first issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[PR] doc: metrics allow_list complet example [airflow]

2024-06-07 Thread via GitHub
raphaelauv opened a new pull request, #40120: URL: https://github.com/apache/airflow/pull/40120 would be great to show the full list of available metrics in the doc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] dag callbacks not called on SSHOperator (base operator?) [airflow]

2024-06-07 Thread via GitHub
boring-cyborg[bot] commented on issue #40119: URL: https://github.com/apache/airflow/issues/40119#issuecomment-2154844051 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] dag callbacks not called on SSHOperator (base operator?) [airflow]

2024-06-07 Thread via GitHub
trlopes1974 opened a new issue, #40119: URL: https://github.com/apache/airflow/issues/40119 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.2 ### What happened? Failure

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2154816673 Yep. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Fix openai 1.32 breaking openai tests [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40110: URL: https://github.com/apache/airflow/pull/40110#issuecomment-2154810092 It turns out we need to add a bit more limits to google and facebook provider to make sure the lower-direct limits work (otherwise it attempts to build old versions of libraries that

Re: [I] Schedular going down for 1-2 minute on every 10 minute as increase completed pods in EKS [airflow]

2024-06-07 Thread via GitHub
ephraimbuddy commented on issue #22612: URL: https://github.com/apache/airflow/issues/22612#issuecomment-2154809346 > > @dviru , why would you set the pods not to be deleted? This leads to OOM because the pods occupy some space. Just trying to understand your needs and see if we should

[I] Rendered Template Fields missing for some tasks [airflow]

2024-06-07 Thread via GitHub
raphaelauv opened a new issue, #40118: URL: https://github.com/apache/airflow/issues/40118 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? for the exact same task , in success

(airflow) branch main updated: sftp_sensor: fixing resource management with sensor (#40022)

2024-06-07 Thread pankajkoti
This is an automated email from the ASF dual-hosted git repository. pankajkoti pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f5c8059553 sftp_sensor: fixing resource

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti merged PR #40022: URL: https://github.com/apache/airflow/pull/40022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Close open connections for deferrable SFTPSensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti closed issue #39922: Close open connections for deferrable SFTPSensor URL: https://github.com/apache/airflow/issues/39922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti commented on code in PR #40022: URL: https://github.com/apache/airflow/pull/40022#discussion_r1631159143 ## airflow/providers/sftp/hooks/sftp.py: ## @@ -558,13 +558,17 @@ async def get_mod_time(self, path: str) -> str: :param path: full path to the remote

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
tanvn commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154775211 Tested https://github.com/apache/airflow/pull/39406 by installing [cncf.kubernetes: 8.3.1rc1](https://pypi.org/project/apache-airflow-providers-cncf-kubernetes/8.3.1rc1) upon my

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pateash commented on code in PR #40022: URL: https://github.com/apache/airflow/pull/40022#discussion_r1631152676 ## airflow/providers/sftp/hooks/sftp.py: ## @@ -558,13 +558,17 @@ async def get_mod_time(self, path: str) -> str: :param path: full path to the remote

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti commented on code in PR #40022: URL: https://github.com/apache/airflow/pull/40022#discussion_r1631147608 ## airflow/providers/sftp/hooks/sftp.py: ## @@ -558,13 +558,17 @@ async def get_mod_time(self, path: str) -> str: :param path: full path to the remote

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti commented on code in PR #40022: URL: https://github.com/apache/airflow/pull/40022#discussion_r1631147608 ## airflow/providers/sftp/hooks/sftp.py: ## @@ -558,13 +558,17 @@ async def get_mod_time(self, path: str) -> str: :param path: full path to the remote

Re: [PR] sftp_sensor: fixing resource management with sensor [airflow]

2024-06-07 Thread via GitHub
pankajkoti commented on code in PR #40022: URL: https://github.com/apache/airflow/pull/40022#discussion_r1631147608 ## airflow/providers/sftp/hooks/sftp.py: ## @@ -558,13 +558,17 @@ async def get_mod_time(self, path: str) -> str: :param path: full path to the remote

[I] EKS Overrides for AWS Batch submit_job [airflow]

2024-06-07 Thread via GitHub
eladkal opened a new issue, #40117: URL: https://github.com/apache/airflow/issues/40117 ### Body Similar to https://github.com/apache/airflow/pull/39903 but for EKS ### Committer - [X] I acknowledge that I am a maintainer/committer of the Apache Airflow project. --

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
fdemiane commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154739211 No issues from my side -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Add link to Google Providers Package System Tests Public Dashboard [airflow]

2024-06-07 Thread via GitHub
fdemiane commented on PR #40102: URL: https://github.com/apache/airflow/pull/40102#issuecomment-2154712386 @potiuk Still a draft, testing a few last things before making the link accessible -- This is an automated message from the Apache Git Service. To respond to the message, please log

(airflow) branch openlineage-process-execution updated (2c96acba20 -> 44ba855e1e)

2024-06-07 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git discard 2c96acba20 openlineage: execute extraction and message sending in separate process

(airflow) branch openlineage-process-execution updated (a5ac1a4b48 -> 2c96acba20)

2024-06-07 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git discard a5ac1a4b48 openlineage: execute extraction and message sending in separate process

(airflow) branch listener-task-timeout updated (ec1b19417c -> f0128ced4c)

2024-06-07 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch listener-task-timeout in repository https://gitbox.apache.org/repos/asf/airflow.git omit ec1b19417c local task job: add timeout, to not kill on_task_instance_success listener

[I] Operator SQLExecuteQueryOperator not logging `RAISE NOTICE` statements in PostgreSQL functions [airflow]

2024-06-07 Thread via GitHub
hpereira98 opened a new issue, #40116: URL: https://github.com/apache/airflow/issues/40116 ### Apache Airflow Provider(s) postgres ### Versions of Apache Airflow Providers apache-airflow-providers-postgres==5.7.1 ### Apache Airflow version 2.9.1 ###

Re: [PR] CI: Introduce cross-provider backwards-compatiblity tests. [airflow]

2024-06-07 Thread via GitHub
JDarDagran commented on PR #40053: URL: https://github.com/apache/airflow/pull/40053#issuecomment-2154590048 Also: I'm not sure how to deal with running all providers and airflow core from HEAD but selected providers to be installed and used from downloaded released package. So far I've

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
dondaum commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154570689 Tested #39654, works as expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154564543 Yenked 3.7.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Status of testing Providers that were prepared on June 07, 2024 [airflow]

2024-06-07 Thread via GitHub
potiuk commented on issue #40115: URL: https://github.com/apache/airflow/issues/40115#issuecomment-2154529846 My changes were just in tests but I tested that indeed the new celery provider fixes the problem with celery executor reported in #40011 (Impacting also previous versions of

Re: [PR] Upgrade google-ads version [airflow]

2024-06-07 Thread via GitHub
potiuk commented on PR #40079: URL: https://github.com/apache/airflow/pull/40079#issuecomment-2154502469 > So I think this PR can close without merge I will prepare a new PR with the new API version. Yeah. Thanks for the context. Agree. Seems like Google Ads should be bumped earlier

  1   2   >