[PR] Remove validate-operators-init from v2-* static check branches [airflow]

2024-02-07 Thread via GitHub
potiuk opened a new pull request, #37238: URL: https://github.com/apache/airflow/pull/37238 In v2-7* branches we usually don't cherry-pick provider changes and we generally skip all the provider-related static checks and tests. --- **^ Add meaningful

(airflow) branch v2-8-test updated: Fix failing static/unit tests.

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-8-test by this push: new 655f3326ad Fix failing static/unit

Re: [PR] Change docs type in insert_many to list of dicts [airflow]

2024-02-07 Thread via GitHub
MezentsevIlya commented on code in PR #37230: URL: https://github.com/apache/airflow/pull/37230#discussion_r1482518593 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -210,7 +210,7 @@ def insert_one( return collection.insert_one(doc, **kwargs) def insert_many(

Re: [PR] Adding certificate validation for ssl in mongo hook [airflow]

2024-02-07 Thread via GitHub
potiuk commented on code in PR #37214: URL: https://github.com/apache/airflow/pull/37214#discussion_r1482507876 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -75,6 +74,23 @@ def __init__(self, mongo_conn_id: str = default_conn_name, *args, **kwargs) -> N

Re: [PR] Adding certificate validation for ssl in mongo hook [airflow]

2024-02-07 Thread via GitHub
potiuk commented on code in PR #37214: URL: https://github.com/apache/airflow/pull/37214#discussion_r1482507709 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -75,6 +74,23 @@ def __init__(self, mongo_conn_id: str = default_conn_name, *args, **kwargs) -> N

Re: [PR] Adding certificate validation for ssl in mongo hook [airflow]

2024-02-07 Thread via GitHub
potiuk commented on code in PR #37214: URL: https://github.com/apache/airflow/pull/37214#discussion_r1482505496 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -75,6 +74,23 @@ def __init__(self, mongo_conn_id: str = default_conn_name, *args, **kwargs) -> N

Re: [PR] Adding certificate validation for ssl in mongo hook [airflow]

2024-02-07 Thread via GitHub
potiuk commented on code in PR #37214: URL: https://github.com/apache/airflow/pull/37214#discussion_r1482504765 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -75,6 +74,23 @@ def __init__(self, mongo_conn_id: str = default_conn_name, *args, **kwargs) -> N

Re: [PR] Pass proxies config when using ClientSecretCredential in AzureDataLakeStorageV2Hook [airflow]

2024-02-07 Thread via GitHub
Lee-W commented on code in PR #37103: URL: https://github.com/apache/airflow/pull/37103#discussion_r1482489951 ## airflow/providers/microsoft/azure/transfers/local_to_adls.py: ## @@ -96,3 +96,53 @@ def execute(self, context: Context) -> None:

Re: [PR] Pass proxies config when using ClientSecretCredential in AzureDataLakeStorageV2Hook [airflow]

2024-02-07 Thread via GitHub
Lee-W commented on code in PR #37103: URL: https://github.com/apache/airflow/pull/37103#discussion_r1482489398 ## airflow/providers/microsoft/azure/transfers/local_to_adls.py: ## @@ -96,3 +96,53 @@ def execute(self, context: Context) -> None:

Re: [I] Double execution of failure callback for task [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #27614: URL: https://github.com/apache/airflow/issues/27614#issuecomment-1933465468 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Task's state is updated (the session is flushed) after on-failure, on-retry callbacks [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #27615: URL: https://github.com/apache/airflow/issues/27615#issuecomment-1933465444 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Task's state is updated (the session is flushed) after on-failure, on-retry callbacks [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #27615: Task's state is updated (the session is flushed) after on-failure, on-retry callbacks URL: https://github.com/apache/airflow/issues/27615 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] Double execution of failure callback for task [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #27614: Double execution of failure callback for task URL: https://github.com/apache/airflow/issues/27614 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
kevgeo commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1482467030 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

Re: [I] Wrong order of parameters in WebUI [airflow]

2024-02-07 Thread via GitHub
huruifeng commented on issue #35944: URL: https://github.com/apache/airflow/issues/35944#issuecomment-1933406474 this also happens to me, I am using 2.8.0, the ordering of the parameters in WebUI is totally different from the ordering in code? Has this been solved or how can I order my

(airflow) branch constraints-main updated: Updating constraints. Github run id:7825022019

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new e3fe15677f Updating

svn commit: r67240 - /release/airflow/KEYS

2024-02-07 Thread jedcunningham
Author: jedcunningham Date: Thu Feb 8 05:27:36 2024 New Revision: 67240 Log: Update expiration for jedcunninghams gpg key Modified: release/airflow/KEYS Modified: release/airflow/KEYS == --- release/airflow/KEYS

Re: [PR] Adding certificate validation for ssl in mongo hook [airflow]

2024-02-07 Thread via GitHub
amoghrajesh commented on PR #37214: URL: https://github.com/apache/airflow/pull/37214#issuecomment-1933376396 @potiuk this has been tested out with the following combinations: ``` { "mongo_http": { "conn_type": "mongo", "description": "", "login": "",

Re: [PR] Adding airflow operator to submit and monitor Spark Apps/App Env on DPGDC clusters [airflow]

2024-02-07 Thread via GitHub
akashsriv07 commented on code in PR #37223: URL: https://github.com/apache/airflow/pull/37223#discussion_r1482416871 ## airflow/providers/google/cloud/operators/dataprocgdc.py: ## @@ -0,0 +1,300 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [PR] Adding airflow operator to submit and monitor Spark Apps/App Env on DPGDC clusters [airflow]

2024-02-07 Thread via GitHub
dirrao commented on code in PR #37223: URL: https://github.com/apache/airflow/pull/37223#discussion_r1482409590 ## airflow/providers/google/cloud/operators/dataprocgdc.py: ## @@ -0,0 +1,300 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more

(airflow) branch main updated: Upgrade to just released `pip 24.0` (#37236)

2024-02-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e27f76e98a Upgrade to just released `pip

Re: [PR] Upgrade to just released `pip 24.0` [airflow]

2024-02-07 Thread via GitHub
jedcunningham merged PR #37236: URL: https://github.com/apache/airflow/pull/37236 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Simplified configuration parsing in Apprise Connection [airflow]

2024-02-07 Thread via GitHub
dirrao commented on PR #37202: URL: https://github.com/apache/airflow/pull/37202#issuecomment-1933351952 > config Does airflow consumers needs to update the environment variables without escaping the double quotes? -- This is an automated message from the Apache Git Service. To

(airflow) branch main updated: Chart: bump version for 1.12.0 (#37235)

2024-02-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3ad1dee190 Chart: bump version for 1.12.0

Re: [PR] Chart: bump version for 1.12.0 [airflow]

2024-02-07 Thread via GitHub
jedcunningham merged PR #37235: URL: https://github.com/apache/airflow/pull/37235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Cluster policies on mapped tasks cause broken DAGs [airflow]

2024-02-07 Thread via GitHub
eladkal commented on issue #37013: URL: https://github.com/apache/airflow/issues/37013#issuecomment-1933341352 @cccs-seb will you have time to check if this is a regression due to #28313 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
dirrao commented on code in PR #37237: URL: https://github.com/apache/airflow/pull/37237#discussion_r1482341323 ## airflow/providers/google/cloud/hooks/gcs.py: ## @@ -1295,37 +1300,45 @@ def _prepare_sync_plan( destination_object: str | None, recursive: bool,

[PR] Fix GCSSynchronizeBucketsOperator timeout error [airflow]

2024-02-07 Thread via GitHub
kevgeo opened a new pull request, #37237: URL: https://github.com/apache/airflow/pull/37237 This PR fixes issue #27488. It solves the timeout error when trying to synchronize large files by using the `rewrite` function instead of `copy`. There was also previously a bug when

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-07 Thread via GitHub
Lee-W commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1482304716 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -4101,6 +4267,35 @@ components: description: The dataset event creation time nullable: false +

(airflow) branch main updated: Upgrade mypy to 1.8.0 (#36428)

2024-02-07 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90e2b12d6b Upgrade mypy to 1.8.0 (#36428)

Re: [PR] Upgrade mypy to 1.8.0 [airflow]

2024-02-07 Thread via GitHub
hussein-awala merged PR #36428: URL: https://github.com/apache/airflow/pull/36428 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] CloudBatchSubmitJobOperator runnable.container.commands does not interpret jinja templates [airflow]

2024-02-07 Thread via GitHub
yassun7010 commented on issue #37217: URL: https://github.com/apache/airflow/issues/37217#issuecomment-1933186780 I am looking at this [PR](https://github.com/apache/airflow/pull/20905). I had added `job` to `template_fields` but it did not work. Cloud Batch job is a deep

Re: [PR] Change docs type in insert_many to list of dicts [airflow]

2024-02-07 Thread via GitHub
jedcunningham commented on code in PR #37230: URL: https://github.com/apache/airflow/pull/37230#discussion_r1482279552 ## airflow/providers/mongo/hooks/mongo.py: ## @@ -210,7 +210,7 @@ def insert_one( return collection.insert_one(doc, **kwargs) def insert_many(

(airflow) branch main updated: Remove legacy dag details page and redirect to grid (#37232)

2024-02-07 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 8cebfa7c82 Remove legacy dag details page

Re: [PR] Remove legacy dag details page and redirect to grid [airflow]

2024-02-07 Thread via GitHub
jedcunningham merged PR #37232: URL: https://github.com/apache/airflow/pull/37232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-07 Thread via GitHub
Lee-W commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1482271942 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -986,6 +986,163 @@ paths: "404": $ref: "#/components/responses/NotFound" +

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-07 Thread via GitHub
Lee-W commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1482270771 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -986,6 +986,163 @@ paths: "404": $ref: "#/components/responses/NotFound" +

[PR] Upgrade to just released `pip 24.0` [airflow]

2024-02-07 Thread via GitHub
potiuk opened a new pull request, #37236: URL: https://github.com/apache/airflow/pull/37236 --- **^ Add meaningful description above** Read the **[Pull Request

(airflow) 01/01: Fix security manager inheritance in fab provider (#36538)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 384d062e40a6cb13e421d5061292fb42088c9a6a Author: Vincent <97131062+vincb...@users.noreply.github.com> AuthorDate:

(airflow) branch v2-8-test updated (676e910375 -> 384d062e40)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 676e910375 Fix security manager inheritance in fab provider (#36538) new 384d062e40 Fix security manager

(airflow) branch constraints-main updated: Updating constraints. Github run id:7821724260

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new a6b6eea4b3 Updating

Re: [I] Airflow progressive slowness [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] closed issue #32928: Airflow progressive slowness URL: https://github.com/apache/airflow/issues/32928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Airflow progressive slowness [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #32928: URL: https://github.com/apache/airflow/issues/32928#issuecomment-1933149224 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]

2024-02-07 Thread via GitHub
github-actions[bot] commented on issue #34644: URL: https://github.com/apache/airflow/issues/34644#issuecomment-1933149008 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [PR] Upgrade mypy to 1.8.0 [airflow]

2024-02-07 Thread via GitHub
potiuk commented on PR #36428: URL: https://github.com/apache/airflow/pull/36428#issuecomment-1933147688 Seems it works. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] Chart: bump version for 1.12.0 [airflow]

2024-02-07 Thread via GitHub
jedcunningham opened a new pull request, #37235: URL: https://github.com/apache/airflow/pull/37235 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch python3.12 updated (400bdca67c -> 221f8e0123)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch python3.12 in repository https://gitbox.apache.org/repos/asf/airflow.git omit 400bdca67c python 3.12 support add 221f8e0123 python 3.12 support This update added new revisions after

Re: [PR] Upgrade mypy to 1.8.0 [airflow]

2024-02-07 Thread via GitHub
potiuk commented on code in PR #36428: URL: https://github.com/apache/airflow/pull/36428#discussion_r1482240350 ## airflow/providers/http/hooks/http.py: ## @@ -258,7 +258,8 @@ def run_with_advanced_retry(self, _retry_args: dict[Any, Any], *args: Any, **kwa """

Re: [PR] Upgrade mypy to 1.8.0 [airflow]

2024-02-07 Thread via GitHub
hussein-awala commented on code in PR #36428: URL: https://github.com/apache/airflow/pull/36428#discussion_r1482238171 ## airflow/providers/http/hooks/http.py: ## @@ -258,7 +258,8 @@ def run_with_advanced_retry(self, _retry_args: dict[Any, Any], *args: Any, **kwa """

(airflow) 01/02: Upgrade to FAB 4.3.11 (#37233)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit f0893e20045c483874e6b79f7062db8aad65a9ea Author: Jarek Potiuk AuthorDate: Wed Feb 7 22:43:10 2024 +0100

(airflow) branch v2-8-test updated (235255e79e -> 676e910375)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 235255e79e Upgrade to FAB 4.3.11 (#37233) new f0893e2004 Upgrade to FAB 4.3.11 (#37233) new 676e910375

(airflow) 02/02: Fix security manager inheritance in fab provider (#36538)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 676e91037572502c4c73e3a56c92820feef94ed1 Author: Vincent <97131062+vincb...@users.noreply.github.com> AuthorDate:

(airflow) branch python3.12 updated (568eadb259 -> 400bdca67c)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch python3.12 in repository https://gitbox.apache.org/repos/asf/airflow.git omit 568eadb259 python 3.12 support add 4778c49ce7 Fix upgrade docs to reflect true cli flags available

(airflow) branch v2-8-test updated (c080754770 -> 235255e79e)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard c080754770 Upgrade to FAB 4.3.11 new 12e4be2024 Upgrade to FAB 4.3.11 new 498c650ca2 Limit

Re: [I] Dynamic task gets "upstream_failed" when with trigger_rule='none_failed' and upstream skipped. [airflow]

2024-02-07 Thread via GitHub
stevenschaerer commented on issue #37091: URL: https://github.com/apache/airflow/issues/37091#issuecomment-1933029781 I'm happy to take a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] Names for expanded tasks [airflow]

2024-02-07 Thread via GitHub
RNHTTR commented on issue #23020: URL: https://github.com/apache/airflow/issues/23020#issuecomment-1933020783 > @RNHTTR are you working on it? yep! https://github.com/apache/airflow/pull/36797 -- This is an automated message from the Apache Git Service. To respond to the message,

(airflow) branch main updated: Update default value for `BatchSensor` (#37234)

2024-02-07 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1f1fa2f7e3 Update default value for

Re: [PR] Update default value for `BatchSensor` [airflow]

2024-02-07 Thread via GitHub
vincbeck merged PR #37234: URL: https://github.com/apache/airflow/pull/37234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Aws BatchSensor max_retries should change with deferrable framework [airflow]

2024-02-07 Thread via GitHub
vincbeck closed issue #37120: Aws BatchSensor max_retries should change with deferrable framework URL: https://github.com/apache/airflow/issues/37120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [I] CloudBatchSubmitJobOperator runnable.container.commands does not interpret jinja templates [airflow]

2024-02-07 Thread via GitHub
jscheffl commented on issue #37217: URL: https://github.com/apache/airflow/issues/37217#issuecomment-1932988640 Reason for not templating is probably that the Google Operator in https://github.com/apache/airflow/blob/main/airflow/providers/google/cloud/operators/cloud_batch.py#L60 does not

(airflow) branch main updated: Upgrade to FAB 4.3.11 (#37233)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e99cfbbd51 Upgrade to FAB 4.3.11 (#37233)

Re: [PR] Upgrade to FAB 4.3.11 [airflow]

2024-02-07 Thread via GitHub
potiuk merged PR #37233: URL: https://github.com/apache/airflow/pull/37233 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] Airflow CLI command "dags list" command returning unexpected output [airflow]

2024-02-07 Thread via GitHub
jscheffl commented on issue #37228: URL: https://github.com/apache/airflow/issues/37228#issuecomment-1932975964 Can you please post some more details about the unexpected details? Can you please post the full CLI you used? Also if possible the full output would be good. Redacted as

Re: [PR] Remove legacy dag details page and redirect to grid [airflow]

2024-02-07 Thread via GitHub
bbovenzi commented on code in PR #37232: URL: https://github.com/apache/airflow/pull/37232#discussion_r1482106833 ## airflow/www/views.py: ## @@ -1320,76 +1320,7 @@ def legacy_dag_details(self): @provide_session def dag_details(self, dag_id, session: Session =

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-02-07 Thread via GitHub
karakanb commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1932916658 Please keep this open. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

(airflow) branch v2-8-test updated: Upgrade to FAB 4.3.11

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch v2-8-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-8-test by this push: new c080754770 Upgrade to FAB 4.3.11

Re: [I] Aws BatchSensor max_retries should change with deferrable framework [airflow]

2024-02-07 Thread via GitHub
vincbeck commented on issue #37120: URL: https://github.com/apache/airflow/issues/37120#issuecomment-1932834902 I created the fix here: #37234. Sorry @0x26res is you have already started to work on it but the fix was pretty easy and the bug could be frustrating for users so I went ahead.

[PR] Update default value for `BatchSensor` [airflow]

2024-02-07 Thread via GitHub
vincbeck opened a new pull request, #37234: URL: https://github.com/apache/airflow/pull/37234 Resolves #37120 --- **^ Add meaningful description above** Read the **[Pull Request

(airflow) branch main updated (4778c49ce7 -> 70e55e5874)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4778c49ce7 Fix upgrade docs to reflect true cli flags available (#37231) add 70e55e5874 Fix the otel config

Re: [PR] Fix the otel config descriptions [airflow]

2024-02-07 Thread via GitHub
potiuk merged PR #37229: URL: https://github.com/apache/airflow/pull/37229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] CUSTOM_SECURITY_MANAGER must extend FabAirflowSecurityManagerOverride not FAB's own security manager [airflow]

2024-02-07 Thread via GitHub
potiuk closed issue #37227: CUSTOM_SECURITY_MANAGER must extend FabAirflowSecurityManagerOverride not FAB's own security manager URL: https://github.com/apache/airflow/issues/37227 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] CUSTOM_SECURITY_MANAGER must extend FabAirflowSecurityManagerOverride not FAB's own security manager [airflow]

2024-02-07 Thread via GitHub
potiuk commented on issue #37227: URL: https://github.com/apache/airflow/issues/37227#issuecomment-1932825477 Duplicate of #https://github.com/apache/airflow/issues/36342 - will be fixed in upcoming 2.8.2 -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] fix inheritance checking of security manager in FabAuthManager [airflow]

2024-02-07 Thread via GitHub
potiuk commented on PR #36343: URL: https://github.com/apache/airflow/pull/36343#issuecomment-1932824275 > Moved this to 2.9.0 since FabAuthManager has been moved to providers cc @vincbeck @potiuk I reassigned it to 2.8.2 as other people are complaining and it's easy to cherry-pick

Re: [PR] Remove legacy dag details page and redirect to grid [airflow]

2024-02-07 Thread via GitHub
vincbeck commented on code in PR #37232: URL: https://github.com/apache/airflow/pull/37232#discussion_r1482048850 ## airflow/www/views.py: ## @@ -1320,76 +1320,7 @@ def legacy_dag_details(self): @provide_session def dag_details(self, dag_id, session: Session =

[PR] Upgrade to FAB 4.3.11 [airflow]

2024-02-07 Thread via GitHub
potiuk opened a new pull request, #37233: URL: https://github.com/apache/airflow/pull/37233 --- **^ Add meaningful description above** Read the **[Pull Request

[PR] Remove legacy dag details page and redirect to grid [airflow]

2024-02-07 Thread via GitHub
bbovenzi opened a new pull request, #37232: URL: https://github.com/apache/airflow/pull/37232 For dag details, we should just use the page in grid view when a user has no runs or tasks selected. --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] Fix system test gcs_sensor [airflow]

2024-02-07 Thread via GitHub
shardbread commented on PR #37209: URL: https://github.com/apache/airflow/pull/37209#issuecomment-1932780324 not ready -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Fix system test gcs_sensor [airflow]

2024-02-07 Thread via GitHub
shardbread closed pull request #37209: Fix system test gcs_sensor URL: https://github.com/apache/airflow/pull/37209 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch main updated: Fix upgrade docs to reflect true cli flags available (#37231)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4778c49ce7 Fix upgrade docs to reflect true cli

Re: [PR] Fix upgrade docs to reflect true cli flags available [airflow]

2024-02-07 Thread via GitHub
boring-cyborg[bot] commented on PR #37231: URL: https://github.com/apache/airflow/pull/37231#issuecomment-1932765117 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

Re: [PR] Fix upgrade docs to reflect true cli flags available [airflow]

2024-02-07 Thread via GitHub
potiuk merged PR #37231: URL: https://github.com/apache/airflow/pull/37231 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch python3.12 updated (ed1ee91eeb -> 568eadb259)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch python3.12 in repository https://gitbox.apache.org/repos/asf/airflow.git omit ed1ee91eeb python 3.12 support add 7ea7abc75d Adjust graph node layout (#37207) add f8c0d8109d Release

Re: [PR] Fix upgrade docs to reflect true cli arguments available [airflow]

2024-02-07 Thread via GitHub
boring-cyborg[bot] commented on PR #37231: URL: https://github.com/apache/airflow/pull/37231#issuecomment-1932713179 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

[PR] Fix upgrade docs to reflect true cli arguments available [airflow]

2024-02-07 Thread via GitHub
jdistler opened a new pull request, #37231: URL: https://github.com/apache/airflow/pull/37231 The upgrade docs section concerning [Offline SQL migration scripts](https://airflow.apache.org/docs/apache-airflow/stable/installation/upgrading.html#offline-sql-migration-scripts) are incorrect

[PR] Change docs type in insert_many to list of dicts [airflow]

2024-02-07 Thread via GitHub
MezentsevIlya opened a new pull request, #37230: URL: https://github.com/apache/airflow/pull/37230 Hello! In the `insert_many` method signature docs argument type is `dict`, but actually it must be list of dicts: `list[dict]` --- **^ Add meaningful

Re: [PR] Change docs type in insert_many to list of dicts [airflow]

2024-02-07 Thread via GitHub
boring-cyborg[bot] commented on PR #37230: URL: https://github.com/apache/airflow/pull/37230#issuecomment-1932689311 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our

Re: [I] Names for expanded tasks [airflow]

2024-02-07 Thread via GitHub
damjad commented on issue #23020: URL: https://github.com/apache/airflow/issues/23020#issuecomment-1932675131 @RNHTTR are you working on it? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

(airflow) branch main updated: Fix metadata override for ComputeEngineSSHHook (#37192)

2024-02-07 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 6b49bb3a4f Fix metadata override for

Re: [I] ComputeEngineSSHHook unintentionally deletes instance metadata [airflow]

2024-02-07 Thread via GitHub
utkarsharma2 closed issue #35171: ComputeEngineSSHHook unintentionally deletes instance metadata URL: https://github.com/apache/airflow/issues/35171 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Fix metadata override for ComputeEngineSSHHook [airflow]

2024-02-07 Thread via GitHub
utkarsharma2 merged PR #37192: URL: https://github.com/apache/airflow/pull/37192 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch constraints-main updated: Updating constraints. Github run id:7819019943

2024-02-07 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 8bd3d41606 Updating

[PR] Fix the otel config descriptions [airflow]

2024-02-07 Thread via GitHub
DjVinnii opened a new pull request, #37229: URL: https://github.com/apache/airflow/pull/37229 The descriptions of the otel config variables are incorrect. This is being addressed in this PR. --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-07 Thread via GitHub
cmarteepants commented on PR #37176: URL: https://github.com/apache/airflow/pull/37176#issuecomment-1932641038 > might be good for @bbovenzi to have a look. i suspect there wants to be a UI component here for management of the queue if it gets to undesirable state. @cmarteepants is that

Re: [I] Mapped Task details view "success" counts are off [airflow]

2024-02-07 Thread via GitHub
bbovenzi commented on issue #29988: URL: https://github.com/apache/airflow/issues/29988#issuecomment-1932605688 I know I replicated this a while ago, but then got distracted. Could anyone please provide an example dag that this happens with consistently? -- This is an automated message

(airflow) branch main updated: Avoid log-groomer container failures when log persistence is enabled (#37222)

2024-02-07 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b39a2bfd9b Avoid log-groomer container failures

Re: [PR] Avoid log-groomer container failures when log persistence is enabled [airflow]

2024-02-07 Thread via GitHub
boring-cyborg[bot] commented on PR #37222: URL: https://github.com/apache/airflow/pull/37222#issuecomment-1932573485 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional

Re: [PR] Avoid log-groomer container failures when log persistence is enabled [airflow]

2024-02-07 Thread via GitHub
potiuk merged PR #37222: URL: https://github.com/apache/airflow/pull/37222 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] log-groomer container crashing with .Values.logs.persistence enabled [airflow]

2024-02-07 Thread via GitHub
potiuk closed issue #37220: log-groomer container crashing with .Values.logs.persistence enabled URL: https://github.com/apache/airflow/issues/37220 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-07 Thread via GitHub
dstandish commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1481861065 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -986,6 +986,163 @@ paths: "404": $ref: "#/components/responses/NotFound" +

Re: [I] KubernetesPodOperator does not return XCOM on pod failure [airflow]

2024-02-07 Thread via GitHub
marlena-hammond commented on issue #8792: URL: https://github.com/apache/airflow/issues/8792#issuecomment-1932522623 I am interested in this feature. For, my usecase, it is very helpful being able to retry the task/DAG based on the exception that is returned. -- This is an automated

  1   2   >