Re: [PR] Add explanation about cleaning logs with helm [airflow]

2023-11-22 Thread via GitHub
romsharon98 commented on code in PR #35783: URL: https://github.com/apache/airflow/pull/35783#discussion_r1403006626 ## docs/helm-chart/manage-logs.rst: ## @@ -90,3 +90,8 @@ See the :doc:`Elasticsearch providers guide

Re: [PR] Add explanation about cleaning logs with helm [airflow]

2023-11-22 Thread via GitHub
romsharon98 commented on code in PR #35783: URL: https://github.com/apache/airflow/pull/35783#discussion_r1403005501 ## airflow/config_templates/config.yml: ## @@ -658,6 +658,8 @@ logging: description: | Whether the local log files for GCS, S3, WASB and OSS

(airflow) 36/37: Update version to 2.8.0

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 20cb92e52a9762da3eb1e64cf9c3791b9dadfa38 Author: Ephraim Anierobi AuthorDate: Mon Nov 20 22:48:45 2023

(airflow) 34/37: Updated docstring: `check_key_async` is now in line with description of `_check_key_async` (#35799)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 840707cedf75a65b297645e671f467148b704f10 Author: Aman Gupta AuthorDate: Wed Nov 22 22:24:29 2023 +0530

(airflow) 31/37: feat: K8S resource operator - CRD (#35600)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d568543d879d4a56c675dd1d510e14143f201c5e Author: raphaelauv AuthorDate: Wed Nov 22 11:23:46 2023 +0100

(airflow) 37/37: Update RELEASE_NOTES.rst

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5bbc46005f20c20380d18907899b0ddff33eecde Author: Ephraim Anierobi AuthorDate: Mon Nov 20 22:51:30 2023

(airflow) 13/37: Improve ownership fixing for Breeze (#35759)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 26d5e3f4e72c349b9f041fbb11f2e4791e6da1db Author: Jarek Potiuk AuthorDate: Tue Nov 21 10:30:50 2023 +0100

(airflow) 26/37: Update emr.py (#35787)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e0736092a89b1b8c46d389554c5e6abadcf8de21 Author: Tony Zhang <45370652+t...@users.noreply.github.com>

(airflow) 24/37: Remove pendulum as dependency of breeze (#35786)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2a240e65d5a9da93eb1008e8e0a9ef93eb216190 Author: Jarek Potiuk AuthorDate: Tue Nov 21 22:29:37 2023 +0100

(airflow) 17/37: Move `BaseOperatorLink` into the separate module (#35032)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 4454fc870cda6924cdac100c3ca8e81d53716d40 Author: Andrey Anshin AuthorDate: Tue Nov 21 21:10:40 2023 +0400

(airflow) 01/37: Add v2-8 branches to codecov.yml and .asf.yaml (#35750)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 1fc0633f894ed8902b8a73af21421eeb380af839 Author: Ephraim Anierobi AuthorDate: Mon Nov 20 15:10:37 2023

(airflow) 11/37: Extend task context logging support for remote logging using Elasticsearch (#32977)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d9cfdd8131d797735b406554674282ea0f8dcbae Author: Pankaj Koti AuthorDate: Tue Nov 21 11:55:03 2023 +0530

(airflow) 06/37: feature(providers): added `OpsgenieNotifier` (#35530)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit bd644fab3e548fa8d1cedc56bf35787772d0f14b Author: Eric Mendes

(airflow) 25/37: Reflect drop/add support of DB Backends versions in documentation (#35785)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 58743f28d5d362c6f4eda9cc10c51eaecd9ad6ab Author: Andrey Anshin AuthorDate: Wed Nov 22 01:43:16 2023 +0400

(airflow) 18/37: Add OpenLineage support to GCSToBigQueryOperator (#35778)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b51aaf59d2280e4341807ed39e3a110a26627426 Author: Kacper Muda AuthorDate: Tue Nov 21 18:14:36 2023 +0100

(airflow) 21/37: Remove --force-build command in cache steps in CI (#35784)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 528d2bc51be862950ff86e815c33fdd78c71c175 Author: Jarek Potiuk AuthorDate: Tue Nov 21 19:40:02 2023 +0100

(airflow) 22/37: Fix DataFusion example type annotations (#35753)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 599189e41e27a3b30a2e2d3f598f9b45a96b8547 Author: Andrey Anshin AuthorDate: Tue Nov 21 23:44:09 2023 +0400

(airflow) 10/37: Add basic metrics to stats collector. (#35368)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5d69fc142d9c475940d11b1bbb56bf1a6c36c7fb Author: Jakub Dardzinski AuthorDate: Tue Nov 21 06:45:04 2023

(airflow) 02/37: Update minor release command (#35751)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 70e2f419e69987715b195a5fae7b3f73d10024f9 Author: Ephraim Anierobi AuthorDate: Mon Nov 20 15:10:55 2023

(airflow) 23/37: Fix permission check on menus (#35781)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b904523c5a2d8e7d0c359d45eef8514297b1f52c Author: Vincent <97131062+vincb...@users.noreply.github.com>

(airflow) 07/37: Rename --aditional-extras flag to --aditional-airflow-extras (#35760)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 38afe9ffb1e723528ebaa3f005f880aeadd8e926 Author: Jarek Potiuk AuthorDate: Mon Nov 20 22:38:35 2023 +0100

(airflow) 04/37: OpenLineage integration tried to use non-existed method in SnowflakeHook (#35752)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b88d0d7ce2944b5ed3c04d30fffcac37eaaa1859 Author: Andrey Anshin AuthorDate: Mon Nov 20 19:55:30 2023 +0400

(airflow) 05/37: Remove usage of deprecated method from BigQueryToBigQueryOperator (#35605)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 25990d159c1f2350a2ee678d719251da888f27cd Author: Maksim AuthorDate: Mon Nov 20 21:12:02 2023 +0100

(airflow) branch v2-8-test updated (d6c7d33d43 -> 5bbc46005f)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit d6c7d33d43 Update RELEASE_NOTES.rst omit 729c1df9eb Update version to 2.8.0 new 1fc0633f89 Add

(airflow) 29/37: Added retry strategy parameter to Amazon AWS provider Batch Operator to allow dynamic Batch retry strategies (#35789)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 0e6b5d8f8e71df326d237c2028940d5cbf3bac2c Author: Evgeny AuthorDate: Wed Nov 22 04:26:42 2023 -0500

(airflow) 32/37: Upgrade to Pydantic v2 (#35551)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b331cb2e0e3c47e3e2322decba29cba1d6f1aecf Author: Sin-Woo Bang AuthorDate: Wed Nov 22 20:56:43 2023 +0900

(airflow) 27/37: Add missing docker test_exceptions.py (#35674)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7937cba0dc7e2d6db80209cfaf80aafe1d3b1a4c Author: Riyas P K <16943217+rp...@users.noreply.github.com>

(airflow) 12/37: Remove backcompat inheritance for DbApiHook (#35754)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 73106932771ba3a1e8a08de3905b569d5462c416 Author: Andrey Anshin AuthorDate: Tue Nov 21 11:12:56 2023 +0400

(airflow) 28/37: added Topic params for schema_settings and message_retention_duration. (#35767)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 08785f50f15a419e91a3eec03a60d9d0b9173343 Author: dmedora <21352998+dmed...@users.noreply.github.com>

(airflow) 33/37: Fix HttpOperator pagination with `str` data (#35782)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e02271003931c2d9df58a2b769c89cac8d4eb0a2 Author: Joffrey Bienvenu AuthorDate: Wed Nov 22 15:34:34 2023

(airflow) 19/37: Implement login and logout in AWS auth manager (#35488)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e2e89668d46363bc0ecfa31058d02bc3e041de88 Author: Vincent <97131062+vincb...@users.noreply.github.com>

(airflow) 30/37: Fix for infinite recursion due to secrets_masker (#35048)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 673f7f837fa00471008ebae88b192f7cec729d55 Author: Usiel Riedl AuthorDate: Wed Nov 22 18:19:04 2023 +0800

(airflow) 20/37: Check attr on parent not self re TaskContextLogger set_context (#35780)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit feaeb8c5fb246f945be5aa96ba49441c6700ae39 Author: Daniel Standish

(airflow) 35/37: Add borderWidthRight to grid for Firefox scrollbar (#35346)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 55914e14cbb587e6712c027e039929bb5bb105c0 Author: Victor Chiapaikeo AuthorDate: Wed Nov 22 11:58:10 2023

(airflow) 09/37: Update README.md to reflect changes we agreed to the versioning (#35764)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7642b29f5c0eaef898839579304ba0c8223801f1 Author: Jarek Potiuk AuthorDate: Mon Nov 20 23:59:16 2023 +0100

(airflow) 08/37: More detail on mandatory task arguments (#35740)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9b832f6acd79ec1329ad235e65a7abd2be93a0eb Author: Cai Parry-Jones <97813242+cai...@users.noreply.github.com>

(airflow) 15/37: Set mark_end_on_close after set_context (#35761)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f40e1c17ee07ebeb6ebf1494e1fc845a00e599dc Author: Daniel Standish

(airflow) 14/37: Fix broken link to Weaviate docs (#35776)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 1df306a337c8951b7e8cf06ae6331313b8b23e9c Author: Pankaj Koti AuthorDate: Tue Nov 21 17:34:50 2023 +0530

(airflow) 03/37: Remove backcompat with Airflow 2.3/2.4 in providers (#35727)

2023-11-22 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 619855884356abbd2e6d8a4f7956e4a0510b8c9e Author: Andrey Anshin AuthorDate: Mon Nov 20 18:11:54 2023 +0400

Re: [PR] Connecting airflow containers with shareProcessNamespace [airflow]

2023-11-22 Thread via GitHub
pankajkoti commented on PR #35748: URL: https://github.com/apache/airflow/pull/35748#issuecomment-1823904072 @amoghrajesh just if you wonder if Jed is jot able to respond anytime soon, Jed is on parental leave  -- This is an automated message from the Apache Git Service. To respond to

[PR] improved visibility of tasks in ActionModal for taskInstance [airflow]

2023-11-22 Thread via GitHub
theaadya opened a new pull request, #35810: URL: https://github.com/apache/airflow/pull/35810 The ActionModal (for both Clear and Mark as Success/Failed) for taskInstance wasn't completely visible on my screen when several tasks were present. Adjusted the maximum box height according to

Re: [PR] fix(helm): add recreate strategy support [airflow]

2023-11-22 Thread via GitHub
romsharon98 commented on code in PR #35362: URL: https://github.com/apache/airflow/pull/35362#discussion_r1402957838 ## chart/templates/_helpers.yaml: ## @@ -995,3 +995,11 @@ capabilities: app: keda-operator {{- end }} {{- end }} + +{{- define

Re: [I] No response from gunicorn master within 120 seconds After Changing Worker Class [airflow]

2023-11-22 Thread via GitHub
tharhtetsan commented on issue #10964: URL: https://github.com/apache/airflow/issues/10964#issuecomment-1823851363 Hello @potiuk I read the recommendations and I tested various ways. I also checked with these commands for db connections. And all commands are success. ``` airflow

Re: [PR] Connecting airflow containers with shareProcessNamespace [airflow]

2023-11-22 Thread via GitHub
amoghrajesh commented on PR #35748: URL: https://github.com/apache/airflow/pull/35748#issuecomment-1823829483 > I think we have ways to generate different resources for 1.28+ . I believe helm takes K8s version into account when generating resources. Look in our chart I think we have a few

(airflow) branch main updated: Fix Batch operator's retry_strategy (#35808)

2023-11-22 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a794e0d020 Fix Batch operator's retry_strategy

Re: [PR] Fix recent change to Batch operator's retry_strategy [airflow]

2023-11-22 Thread via GitHub
eladkal merged PR #35808: URL: https://github.com/apache/airflow/pull/35808 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Add EC2HibernateInstanceOperator and EC2RebootInstanceOperator [airflow]

2023-11-22 Thread via GitHub
dashton90 commented on code in PR #35790: URL: https://github.com/apache/airflow/pull/35790#discussion_r1402836371 ## tests/system/providers/amazon/aws/example_ec2.py: ## @@ -142,6 +145,22 @@ def parse_response(instance_ids: list): ) # [END

Re: [PR] Added Feature: retry strategy parameter to Amazon AWS Batch Operator [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on code in PR #35789: URL: https://github.com/apache/airflow/pull/35789#discussion_r1402826636 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -201,6 +204,7 @@ def __init__( self.scheduling_priority_override = scheduling_priority_override

Re: [PR] Fix recent change to Batch operator's retry_strategy [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on PR #35808: URL: https://github.com/apache/airflow/pull/35808#issuecomment-1823694970 One possible point to discuss: The value must be between 1 and 10. The API will return a ClientError if a value outside that range is provided. Do we want to catch that at init

[PR] Fix recent change to Batch operator's retry_strategy [airflow]

2023-11-22 Thread via GitHub
ferruzzi opened a new pull request, #35808: URL: https://github.com/apache/airflow/pull/35808 Should fix https://github.com/apache/airflow/pull/35789 "attempts" is a required field is retry_strategy is used. By doing it this way, we can also verify that a user-provided

(airflow) branch main updated: Fix pre-commit script output (#35807)

2023-11-22 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d35578e210 Fix pre-commit script output (#35807)

Re: [PR] Fix pre-commit script output [airflow]

2023-11-22 Thread via GitHub
potiuk merged PR #35807: URL: https://github.com/apache/airflow/pull/35807 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Sanitize filenames in MySQLHook [airflow]

2023-11-22 Thread via GitHub
github-actions[bot] commented on PR #33328: URL: https://github.com/apache/airflow/pull/33328#issuecomment-1823681701 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Warning when viewing docs for previous versions of Airflow [airflow]

2023-11-22 Thread via GitHub
github-actions[bot] closed pull request #34639: Warning when viewing docs for previous versions of Airflow URL: https://github.com/apache/airflow/pull/34639 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Added Feature: retry strategy parameter to Amazon AWS Batch Operator [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on code in PR #35789: URL: https://github.com/apache/airflow/pull/35789#discussion_r1402798016 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -201,6 +204,7 @@ def __init__( self.scheduling_priority_override = scheduling_priority_override

Re: [PR] Added Feature: retry strategy parameter to Amazon AWS Batch Operator [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on code in PR #35789: URL: https://github.com/apache/airflow/pull/35789#discussion_r1402798016 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -201,6 +204,7 @@ def __init__( self.scheduling_priority_override = scheduling_priority_override

Re: [PR] Fix pre-commit script output [airflow]

2023-11-22 Thread via GitHub
o-nikolas commented on PR #35807: URL: https://github.com/apache/airflow/pull/35807#issuecomment-1823623620 Retried the failed job, looks unrelated to the change -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Added Feature: retry strategy parameter to Amazon AWS Batch Operator [airflow]

2023-11-22 Thread via GitHub
o-nikolas commented on PR #35789: URL: https://github.com/apache/airflow/pull/35789#issuecomment-1823621645 Looks like this change has broken the example_batch system test: https://aws-mwaa.github.io/#/open-source/system-tests/dashboard.html ``` File

(airflow) branch constraints-main updated: Updating constraints. Github run id:6963221360

2023-11-22 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 6fa48f049b Updating

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-22 Thread via GitHub
Bisk1 closed pull request #35712: Fix 'scheme' and 'schema' handling in HttpHook URL: https://github.com/apache/airflow/pull/35712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] Fix 'scheme' and 'schema' handling in HttpHook [airflow]

2023-11-22 Thread via GitHub
Bisk1 commented on PR #35712: URL: https://github.com/apache/airflow/pull/35712#issuecomment-1823605262 I analysed possible refactoring of this to take the feedback @Taragolis into account but I think right now there are many dependencies on current syntax, like authentication which

Re: [PR] allow multiple elements in impersonation chain [airflow]

2023-11-22 Thread via GitHub
melugoyal commented on PR #35694: URL: https://github.com/apache/airflow/pull/35694#issuecomment-1823578502 test DAG: ``` from airflow.providers.google.cloud.operators.gcs import GCSCreateBucketOperator from airflow import DAG from datetime import datetime with DAG(

Re: [PR] Make EksPodOperator exec config not rely on log level [airflow]

2023-11-22 Thread via GitHub
o-nikolas merged PR #35771: URL: https://github.com/apache/airflow/pull/35771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Make EksPodOperator exec config not rely on log level (#35771)

2023-11-22 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ac977c4e57 Make EksPodOperator exec config not

[PR] Fix pre-commit script output [airflow]

2023-11-22 Thread via GitHub
vincbeck opened a new pull request, #35807: URL: https://github.com/apache/airflow/pull/35807 `breeze setup regenerate-command images` does not exist but `breeze setup regenerate-command-images` does. --- **^ Add meaningful description above** Read

Re: [PR] Make core compatible with `pendulum` 3 [airflow]

2023-11-22 Thread via GitHub
Taragolis commented on PR #34744: URL: https://github.com/apache/airflow/pull/34744#issuecomment-1823532506 I've cherry picked changes into the #35798 and it fail in multiple new places, so I would suggest to close this one, and And continue working in that PR so we would sure that changes

Re: [PR] Use pre-release version of pendulum in CI and breeze [airflow]

2023-11-22 Thread via GitHub
Taragolis commented on PR #35798: URL: https://github.com/apache/airflow/pull/35798#issuecomment-1823525469 Well, at least it show errors in place where I didn't except to see or in another word in places where I didn't test it 藍 -- This is an automated message from the Apache Git

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are an important number of lines changed located in the OpenAPI spec. All simple

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are an important number of lines changed located in the OpenAPI spec. All simple

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are an important number of lines changed located in the OpenAPI spec. All simple

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are an important number of line changed located in the OpenAPI spec. All simple

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are an important number of line changed located in the OpenAPI spec. All simple

Re: [PR] Add DagModel attributes before dumping DagDetailSchema for get_dag_details API endpoint [airflow]

2023-11-22 Thread via GitHub
pierrejeambrun commented on code in PR #34947: URL: https://github.com/apache/airflow/pull/34947#discussion_r1402713472 ## airflow/api_connexion/openapi/v1.yaml: ## Review Comment: There are a important number of changes located in the OpenAPI spec that just change simple

Re: [PR] Add plugin folder to breeze env [airflow]

2023-11-22 Thread via GitHub
utkarsharma2 closed pull request #32117: Add plugin folder to breeze env URL: https://github.com/apache/airflow/pull/32117 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Reduce memory usage in `S3Hook` [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on issue #35449: URL: https://github.com/apache/airflow/issues/35449#issuecomment-1823483591 I'd love to see someone take/make the time to do a full rewrite on the S3Hook. It's so convoluted and nothing like any of the other hooks. Knowing what we know now about how to

Re: [I] Use base aws classes in amazon provider Operators/Sensors/Triggers [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on issue #35278: URL: https://github.com/apache/airflow/issues/35278#issuecomment-1823482278 Thanks for getting this set up! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[I] triggerer block_watchdog is crying "wolf!" [airflow]

2023-11-22 Thread via GitHub
dlesco opened a new issue, #35806: URL: https://github.com/apache/airflow/issues/35806 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened The triggerer emits "Triggerer's async thread was blocked for x.xx seconds" messages even

[I] apache-airflow-providers-amazon [airflow]

2023-11-22 Thread via GitHub
scnerd opened a new issue, #35805: URL: https://github.com/apache/airflow/issues/35805 ### Apache Airflow version 2.7.3 ### What happened When RedshiftSQLHook attempts to auto-fetch credentials when `iam=True`, it uses a cluster-specific approach to obtaining

Re: [I] apache-airflow-providers-amazon [airflow]

2023-11-22 Thread via GitHub
boring-cyborg[bot] commented on issue #35805: URL: https://github.com/apache/airflow/issues/35805#issuecomment-1823478430 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
JDarDagran commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402686751 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
JDarDagran commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402687254 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
JDarDagran commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402686751 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
JDarDagran commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402679860 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

Re: [PR] Added table of content in CONTRIBUTE.md and enhanced the documentation. [airflow-site]

2023-11-22 Thread via GitHub
pierrejeambrun commented on PR #897: URL: https://github.com/apache/airflow-site/pull/897#issuecomment-1823459056 +1 for auto generated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Make core compatible with `pendulum` 3 [airflow]

2023-11-22 Thread via GitHub
bolkedebruin commented on code in PR #34744: URL: https://github.com/apache/airflow/pull/34744#discussion_r1402673852 ## airflow/utils/timezone.py: ## @@ -18,14 +18,20 @@ from __future__ import annotations import datetime as dt +from functools import lru_cache from typing

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
ferruzzi commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402660284 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

Re: [PR] openlineage, aws: add OpenLineage support for Redshift SQL. [airflow]

2023-11-22 Thread via GitHub
o-nikolas commented on code in PR #35794: URL: https://github.com/apache/airflow/pull/35794#discussion_r1402643538 ## airflow/providers/amazon/aws/hooks/redshift_sql.py: ## @@ -174,3 +175,63 @@ def get_conn(self) -> RedshiftConnection: conn_kwargs_dejson =

(airflow) branch constraints-main updated: Updating constraints. Github run id:6961563404

2023-11-22 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new db5f49f6a9 Updating

Re: [PR] Add EC2HibernateInstanceOperator and EC2RebootInstanceOperator [airflow]

2023-11-22 Thread via GitHub
o-nikolas commented on code in PR #35790: URL: https://github.com/apache/airflow/pull/35790#discussion_r1402634064 ## airflow/providers/amazon/aws/operators/ec2.py: ## @@ -254,3 +255,128 @@ def execute(self, context: Context): "MaxAttempts":

[PR] Implement `is_authorized_variable` in AWS auth manager [airflow]

2023-11-22 Thread via GitHub
vincbeck opened a new pull request, #35804: URL: https://github.com/apache/airflow/pull/35804 Leverage Amazon Verified Permissions to check user permissions related to variables in AWS auth manager. This PR is the first one to implement a `is_authorize_*` method in AWS auth manager, and as

(airflow) branch main updated: Add OpenLineage support to S3Operators - Copy, Delete and Create Object (#35796)

2023-11-22 Thread onikolas
This is an automated email from the ASF dual-hosted git repository. onikolas pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9e159fc48d Add OpenLineage support to

Re: [PR] Add OpenLineage support to S3Operators - Copy, Delete and Create Object [airflow]

2023-11-22 Thread via GitHub
o-nikolas merged PR #35796: URL: https://github.com/apache/airflow/pull/35796 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Add OpenLineage support to S3Operators - Copy, Delete and Create Object [airflow]

2023-11-22 Thread via GitHub
vincbeck commented on PR #35796: URL: https://github.com/apache/airflow/pull/35796#issuecomment-1823275031 Got it! Thanks for the details :) That makes more sense now. Code looks good to me -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] fix(bigquery.py): pass correct project_id to triggerer [airflow]

2023-11-22 Thread via GitHub
mokshasoul commented on PR #35200: URL: https://github.com/apache/airflow/pull/35200#issuecomment-1823257362 bump -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Consolidate environment variable calculation in ShellParams in Breeze [airflow]

2023-11-22 Thread via GitHub
potiuk commented on PR #35801: URL: https://github.com/apache/airflow/pull/35801#issuecomment-1823216669 Some celery URL passing problem - will take a look tomorrow :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Use pre-release version of pendulum in CI and breeze [airflow]

2023-11-22 Thread via GitHub
potiuk commented on PR #35798: URL: https://github.com/apache/airflow/pull/35798#issuecomment-1823215372 FYI: There will be some changes needed (but it will be generally way better in simpler after I merge https://github.com/apache/airflow/pull/35801 -- This is an automated message from

Re: [I] Allow dynamically set `pool_slots` for potentially heavy tasks. [airflow]

2023-11-22 Thread via GitHub
boring-cyborg[bot] commented on issue #35803: URL: https://github.com/apache/airflow/issues/35803#issuecomment-1823195066 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] Allow dynamically set `pool_slots` for potentially heavy tasks. [airflow]

2023-11-22 Thread via GitHub
Digoya opened a new issue, #35803: URL: https://github.com/apache/airflow/issues/35803 ### Description Allow to set pool_slots for a task based on the result of another task. One task may require different amount of resources for runtime depending on its inputs. However we can

(airflow) branch pendulum-prerelease updated (340978b8e1 -> f106e4e4d0)

2023-11-22 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch pendulum-prerelease in repository https://gitbox.apache.org/repos/asf/airflow.git from 340978b8e1 Lax pip check dependencies when install pre-release version of pendulum add

(airflow) branch main updated: Avoid breeze self-upgrade run in some pre-commits. (#35802)

2023-11-22 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fcb91f47c9 Avoid breeze self-upgrade run in some

  1   2   3   >