Re: [I] TypeError: cannot pickle 'module' object [airflow]

2024-03-15 Thread via GitHub
github-actions[bot] commented on issue #28879: URL: https://github.com/apache/airflow/issues/28879#issuecomment-1999052375 This issue has been automatically marked as stale because it has been open for 365 days without any activity. There has been several Airflow releases since last activit

[I] Adding max_consecutive_failed_dag_runs in UI for dag [airflow]

2024-03-15 Thread via GitHub
pateash opened a new issue, #38171: URL: https://github.com/apache/airflow/issues/38171 ### Description We are adding the ability to automatically turn off DAG after X number of consecutive failures. There are 2 ways to configure this in DAG() using max_consecutive_fail

[I] Timezone information should be shown in Next Run details [airflow]

2024-03-15 Thread via GitHub
pateash opened a new issue, #38172: URL: https://github.com/apache/airflow/issues/38172 ### Description We currently do not show the Timezone information in Next Run information, although user can hover over and check this in ToolTip, we can also show this upfront. https://gith

Re: [PR] Migrating issue generation to breeze release-management [airflow]

2024-03-15 Thread via GitHub
amoghrajesh commented on PR #38062: URL: https://github.com/apache/airflow/pull/38062#issuecomment-1999103939 The job has passed now: https://github.com/apache/airflow/actions/runs/8292193216/job/22693362907?pr=38062 If all is ok, we can send this one in and I will pick up the follow

Re: [PR] Rename mlengine's operators' fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
shahar1 commented on PR #38053: URL: https://github.com/apache/airflow/pull/38053#issuecomment-1999117860 > is this change backward compatible? As all renamed attributes were private, there shouldn't be a risk of backward incompatibility. -- This is an automated message from the Ap

Re: [PR] Adding ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
pateash commented on PR #36935: URL: https://github.com/apache/airflow/pull/36935#issuecomment-1999156115 @eladkal some myPy checks are failing due to issues in azure/cosmos provider ``` airflow/providers/microsoft/azure/hooks/cosmos.py:228: error: Argument "partition_key" to "create

[PR] Add platform markers for the tests [airflow]

2024-03-15 Thread via GitHub
Taragolis opened a new pull request, #38173: URL: https://github.com/apache/airflow/pull/38173 Add markers for skip run specific test on-non linux platform and/or not in breeze environment --- **^ Add meaningful description above** Read the **[Pull Request G

Re: [PR] Rename mlengine's operators' fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
shahar1 commented on PR #38053: URL: https://github.com/apache/airflow/pull/38053#issuecomment-1999189068 Need to fix `tests/providers/google/cloud/utils/test_mlengine_operator_utils.py` -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[I] DAGs scheduled on February 29th are not executed. [airflow]

2024-03-15 Thread via GitHub
lanhhv84 opened a new issue, #38174: URL: https://github.com/apache/airflow/issues/38174 ### Apache Airflow version 2.8.3 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? If the DAG is scheduled on Feb 29th, it will neve

Re: [I] DAGs scheduled on February 29th are not executed. [airflow]

2024-03-15 Thread via GitHub
boring-cyborg[bot] commented on issue #38174: URL: https://github.com/apache/airflow/issues/38174#issuecomment-1999239674 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] Fix incorrect serialisation of the FixedTimezone [airflow]

2024-03-15 Thread via GitHub
millin commented on code in PR #38139: URL: https://github.com/apache/airflow/pull/38139#discussion_r1526017190 ## airflow/serialization/serialized_objects.py: ## @@ -483,7 +483,7 @@ def serialize( return cls._encode(var.timestamp(), type_=DAT.DATETIME) eli

Re: [PR] Implement wait_until_job_complete parameter for KubernetesJobOperator [airflow]

2024-03-15 Thread via GitHub
VladaZakharova commented on PR #37998: URL: https://github.com/apache/airflow/pull/37998#issuecomment-1999327179 Hi @potiuk @eladkal ! Can you please take a look at the changes here? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please l

Re: [PR] Adding MSGraphOperator in Microsoft Azure provider [airflow]

2024-03-15 Thread via GitHub
dabla commented on PR #38111: URL: https://github.com/apache/airflow/pull/38111#issuecomment-1999330233 Why are there suddenly tests failing of classes I didn't even touch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] Create DeleteKubernetesJobOperator and GKEDeleteJobOperator operators [airflow]

2024-03-15 Thread via GitHub
VladaZakharova commented on PR #37793: URL: https://github.com/apache/airflow/pull/37793#issuecomment-1999330440 Hi @potiuk ! Can you please check the changes in this PR? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] Add the deferrable mode to `DataflowJobAutoScalingEventsSensor` and `DataflowJobMessagesSensor`. [airflow]

2024-03-15 Thread via GitHub
VladaZakharova commented on PR #37693: URL: https://github.com/apache/airflow/pull/37693#issuecomment-1999339694 Hi @eladkal @Lee-W @hussein-awala ! Can you please the changes? Thanks :) -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[PR] Limit azure-cosmos [airflow]

2024-03-15 Thread via GitHub
eladkal opened a new pull request, #38175: URL: https://github.com/apache/airflow/pull/38175 [azure-cosmos version 4.6.0](https://pypi.org/project/azure-cosmos/4.6.0/) released today and it breaks mypy ``` airflow/providers/microsoft/azure/hooks/cosmos.py:228: error: Argument "p

Re: [PR] Limit azure-cosmos<4.6.0 [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #38175: URL: https://github.com/apache/airflow/pull/38175 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (00cd44e4cc -> 832571c6f3)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 00cd44e4cc Airflow 2.8.3 has been released (#38034) add 832571c6f3 Limit azure-cosmos (#38175) No new revisions

Re: [PR] Adding ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
eladkal commented on PR #36935: URL: https://github.com/apache/airflow/pull/36935#issuecomment-1999401863 > @eladkal some myPy checks are failing due to issues in azure/cosmos provider > > ``` > airflow/providers/microsoft/azure/hooks/cosmos.py:228: error: Argument > "partition_

[I] constraint "dag_run_dag_id_execution_date_key" not using dag_run [airflow]

2024-03-15 Thread via GitHub
raphaelauv opened a new issue, #38176: URL: https://github.com/apache/airflow/issues/38176 ### Apache Airflow version 2.8.3 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? I want run multiple dag_run with the same execu

[I] Allow Pause on Task instance level [airflow]

2024-03-15 Thread via GitHub
Pad71 opened a new issue, #38177: URL: https://github.com/apache/airflow/issues/38177 ### Description Currently, the Airflow UI will allow you to pause the Dag. Airflow UI should also allow to use similar functionality for the task instance. The Functionality similar to the Da

Re: [PR] Fix excessive permission changing for log permissions [airflow]

2024-03-15 Thread via GitHub
Frank-T-Johansen commented on code in PR #38164: URL: https://github.com/apache/airflow/pull/38164#discussion_r1526118302 ## tests/utils/test_log_handlers.py: ## @@ -754,3 +754,15 @@ def test_permissions_for_new_directories(): os.umask(old_umask) finally:

(airflow) branch dependabot/npm_and_yarn/airflow/www/follow-redirects-1.15.6 updated (cfcc0b8d88 -> 176c8f8486)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch dependabot/npm_and_yarn/airflow/www/follow-redirects-1.15.6 in repository https://gitbox.apache.org/repos/asf/airflow.git discard cfcc0b8d88 Bump follow-redirects from 1.15.4 to 1.15.6 in /air

Re: [PR] refactor: Refactored __new__ magic method of BaseOperatorMeta to avoid bad mixing classic and decorated operators [airflow]

2024-03-15 Thread via GitHub
dabla commented on PR #37937: URL: https://github.com/apache/airflow/pull/37937#issuecomment-1999477793 > > (as long as tests are fixed that is :) ) > > That maybe good example when use `dag_maker` and move as db-tests is better than use try to mock everything in sqlalchemy and TaskIn

[PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis opened a new pull request, #38178: URL: https://github.com/apache/airflow/pull/38178 Originally reported in [Slack](https://apache-airflow.slack.com/archives/CCQ7EGB1P/p1710437655032589) --- Hi everyone! :nyanparrot: I just upgraded the airflow packages

[PR] fix: dag_run_dag_id_execution_date_key [airflow]

2024-03-15 Thread via GitHub
raphaelauv opened a new pull request, #38179: URL: https://github.com/apache/airflow/pull/38179 fix: 38176 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [PR] Add `ADLSCreateObjectOperator` [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #37821: URL: https://github.com/apache/airflow/pull/37821 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (832571c6f3 -> 60b95c75cd)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 832571c6f3 Limit azure-cosmos (#38175) add 60b95c75cd Add `ADLSCreateObjectOperator` (#37821) No new revisions w

Re: [PR] Rename `DeleteCustomTrainingJobOperator`'s fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #38048: URL: https://github.com/apache/airflow/pull/38048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (60b95c75cd -> 83060e16e1)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 60b95c75cd Add `ADLSCreateObjectOperator` (#37821) add 83060e16e1 Rename `DeleteCustomTrainingJobOperator`'s fiel

Re: [PR] Adding ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #36935: URL: https://github.com/apache/airflow/pull/36935 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

Re: [I] Add ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
eladkal closed issue #36239: Add ability to automatically set DAG to off after X times it failed sequentially URL: https://github.com/apache/airflow/issues/36239 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

(airflow) branch main updated (83060e16e1 -> 777a2169e2)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 83060e16e1 Rename `DeleteCustomTrainingJobOperator`'s fields' names to comply with templated fields validation (#3804

Re: [PR] Adding ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
eladkal commented on PR #36935: URL: https://github.com/apache/airflow/pull/36935#issuecomment-1999508072 🎉 🎉 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [PR] refactor: Refactored __new__ magic method of BaseOperatorMeta to avoid bad mixing classic and decorated operators [airflow]

2024-03-15 Thread via GitHub
dabla commented on code in PR #37937: URL: https://github.com/apache/airflow/pull/37937#discussion_r1526179389 ## tests/models/test_baseoperatormeta.py: ## @@ -0,0 +1,64 @@ +import os +from typing import Any +from unittest import TestCase +from unittest.mock import Mock, patch,

Re: [PR] Add `ADLSCreateObjectOperator` [airflow]

2024-03-15 Thread via GitHub
dabla commented on PR #37821: URL: https://github.com/apache/airflow/pull/37821#issuecomment-1999513697 Thanks @eladkal :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
eladkal commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526185292 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | Non

[PR] Remove incorrect warning about scheduled_duration metric [airflow]

2024-03-15 Thread via GitHub
kzosabe opened a new pull request, #38180: URL: https://github.com/apache/airflow/pull/38180 closes: https://github.com/apache/airflow/issues/34493 The previous PR (#34771) is stuck due to the complexity of the problem. This incorrect warning is causing inconvenienc

Re: [PR] Suppress false warning when TI state is QUEUED and TI doesn't have a start_date [airflow]

2024-03-15 Thread via GitHub
kzosabe commented on PR #34771: URL: https://github.com/apache/airflow/pull/34771#issuecomment-1999531279 @gil-tober I'm ready to take the necessary actions but have not yet received a response. To simplify the problem, I re-submitted the PR to remove this incorrect warning. This

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526201587 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | N

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526207708 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | N

Re: [I] Allow Pause on Task instance level [airflow]

2024-03-15 Thread via GitHub
Taragolis closed issue #38177: Allow Pause on Task instance level URL: https://github.com/apache/airflow/issues/38177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [I] Allow Pause on Task instance level [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on issue #38177: URL: https://github.com/apache/airflow/issues/38177#issuecomment-1999553148 This one required significant changes in Airflow. It should comes thought AIP (Airflow Improvement Proposals) first, see: https://cwiki.apache.org/confluence/display/AIRFLOW/Ai

Re: [I] Allow Pause on Task instance level [airflow]

2024-03-15 Thread via GitHub
Taragolis closed issue #38177: Allow Pause on Task instance level URL: https://github.com/apache/airflow/issues/38177 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526219506 ## tests/providers/amazon/aws/operators/test_ecs.py: ## @@ -680,6 +681,23 @@ def test_execute_complete(self, client_mock): # task gets described to assert

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526230744 ## tests/providers/amazon/aws/operators/test_ecs.py: ## @@ -680,6 +681,23 @@ def test_execute_complete(self, client_mock): # task gets described to assert

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis closed pull request #38178: Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` URL: https://github.com/apache/airflow/pull/38178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526233196 ## tests/providers/amazon/aws/operators/test_ecs.py: ## @@ -680,6 +681,23 @@ def test_execute_complete(self, client_mock): # task gets described to assert

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526233196 ## tests/providers/amazon/aws/operators/test_ecs.py: ## @@ -680,6 +681,23 @@ def test_execute_complete(self, client_mock): # task gets described to assert

Re: [PR] Update deferring.rst [airflow]

2024-03-15 Thread via GitHub
9uzman7 commented on PR #38122: URL: https://github.com/apache/airflow/pull/38122#issuecomment-1999591289 @dirrao @pankajastro thanks for the approvals! not sure who can merge this in -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [PR] Adding ability to automatically set DAG to off after X times it failed sequentially [airflow]

2024-03-15 Thread via GitHub
pateash commented on PR #36935: URL: https://github.com/apache/airflow/pull/36935#issuecomment-1999613179 > 🎉 🎉 🎉 Thanks a lot @eladkal -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] Rename Vertex AI AutoML operators fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #38049: URL: https://github.com/apache/airflow/pull/38049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated: Rename Vertex AI AutoML operators fields' names to comply with templated fields validation (#38049)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9442435b87 Rename Vertex AI AutoML operators field

Re: [PR] Rename `MLEngine` operators' fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal commented on PR #38053: URL: https://github.com/apache/airflow/pull/38053#issuecomment-1999617885 Mypy test is failing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [I] In the DAG Graph view, all DAG runs disappear after selecting a Run State [airflow]

2024-03-15 Thread via GitHub
eladkal commented on issue #37966: URL: https://github.com/apache/airflow/issues/37966#issuecomment-1999623654 @bbovenzi do we have a task here? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[PR] Updating INTHEWILD.md [airflow]

2024-03-15 Thread via GitHub
pateash opened a new pull request, #38182: URL: https://github.com/apache/airflow/pull/38182 **Description** Adding Prophecy as a user. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[I] Mapping key "cluster-autoscaler.kubernetes.io/safe-to-evict" already defined [airflow]

2024-03-15 Thread via GitHub
nuvme-devops opened a new issue, #38183: URL: https://github.com/apache/airflow/issues/38183 ### Official Helm Chart version 1.13.0 (latest released) ### Apache Airflow version 2.8 ### Kubernetes Version 2.8.2 ### Helm Chart configuration ```

Re: [I] Mapping key "cluster-autoscaler.kubernetes.io/safe-to-evict" already defined [airflow]

2024-03-15 Thread via GitHub
boring-cyborg[bot] commented on issue #38183: URL: https://github.com/apache/airflow/issues/38183#issuecomment-1999635195 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] Convert DagFileProcessor.execute_callbacks to Internal API [airflow]

2024-03-15 Thread via GitHub
vandonr commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1526276182 ## airflow/models/taskinstance.py: ## @@ -375,6 +379,795 @@ def _creator_note(val): return TaskInstanceNote(*val) +def _execute_task(task_instance, conte

Re: [PR] Convert DagFileProcessor.execute_callbacks to Internal API [airflow]

2024-03-15 Thread via GitHub
vandonr commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1526277558 ## airflow/models/taskinstance.py: ## @@ -1692,69 +2411,14 @@ def signal_handler(signum, frame): Stats.incr("operator_successes", tags={**self.stats_tags, "t

Re: [PR] Updating INTHEWILD.md [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on PR #38182: URL: https://github.com/apache/airflow/pull/38182#issuecomment-1999655951 @pateash please move your record between `Pronto Tools` and `ProSiebenSat.1` See: https://github.com/apache/airflow/actions/runs/8296676397/job/22706236398?pr=38182 ```di

[PR] Add a templating test to `SparkSqlOperator` [airflow]

2024-03-15 Thread via GitHub
shahar1 opened a new pull request, #38184: URL: https://github.com/apache/airflow/pull/38184 related: #38045 Add a templating test to `SparkSqlOperator` (as done in the other operators) --- **^ Add meaningful description above** Read the **[Pull

Re: [PR] Rename `MLEngine` operators' fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
shahar1 commented on PR #38053: URL: https://github.com/apache/airflow/pull/38053#issuecomment-1999664637 > Mypy test is failing Should be ok now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-03-15 Thread via GitHub
karakanb commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1999680202 keep it open please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Updating INTHEWILD.md [airflow]

2024-03-15 Thread via GitHub
Taragolis merged PR #38182: URL: https://github.com/apache/airflow/pull/38182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated (9442435b87 -> a9da0f7fb4)

2024-03-15 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9442435b87 Rename Vertex AI AutoML operators fields' names to comply with templated fields validation (#38049)

Re: [I] ExternalTask: Check if the most recent task succeeds [airflow]

2024-03-15 Thread via GitHub
eladkal closed issue #24734: ExternalTask: Check if the most recent task succeeds URL: https://github.com/apache/airflow/issues/24734 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] KubernetesJobOperator [airflow]

2024-03-15 Thread via GitHub
eladkal closed issue #17490: KubernetesJobOperator URL: https://github.com/apache/airflow/issues/17490 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: c

Re: [I] KubernetesJobOperator [airflow]

2024-03-15 Thread via GitHub
eladkal commented on issue #17490: URL: https://github.com/apache/airflow/issues/17490#issuecomment-1999716452 Solved in #36847 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

Re: [PR] Make the method `BaseAuthManager.is_authorized_custom_view` abstract [airflow]

2024-03-15 Thread via GitHub
vincbeck merged PR #37915: URL: https://github.com/apache/airflow/pull/37915 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch main updated: Make the method `BaseAuthManager.is_authorized_custom_view` abstract (#37915)

2024-03-15 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2e35854a05 Make the method `BaseAuthManager.is_au

[I] Cloud Composer (Google managed Airflow) sometimes does not retry tasks detected as zombies [airflow]

2024-03-15 Thread via GitHub
lopezvit opened a new issue, #38186: URL: https://github.com/apache/airflow/issues/38186 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.6.3 ### What happened? The problem is t

Re: [I] Cloud Composer (Google managed Airflow) sometimes does not retry tasks detected as zombies [airflow]

2024-03-15 Thread via GitHub
boring-cyborg[bot] commented on issue #38186: URL: https://github.com/apache/airflow/issues/38186#issuecomment-1999730279 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
vincbeck commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526333491 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | No

Re: [PR] Migrate to connexion v3 [airflow]

2024-03-15 Thread via GitHub
Satoshi-Sh commented on PR #37638: URL: https://github.com/apache/airflow/pull/37638#issuecomment-1999794704 > > breeze testing tests tests/api_connexion/endpoints/test_connection_endpoint.py > > It might be my environment that is wrongly set up ... When I run `breeze testing tests t

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526384300 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | N

Re: [PR] Fix `region` argument in partial for bases on `AwsBaseOperator` / `AwsBaseSensor` [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on code in PR #38178: URL: https://github.com/apache/airflow/pull/38178#discussion_r1526387882 ## airflow/providers/amazon/aws/operators/base_aws.py: ## @@ -85,10 +86,12 @@ def __init__( region_name: str | None = None, verify: bool | str | N

Re: [I] Support multiple buttons from `operator_extra_links` [airflow]

2024-03-15 Thread via GitHub
eladkal commented on issue #28870: URL: https://github.com/apache/airflow/issues/28870#issuecomment-1999849798 Noting that https://github.com/apache/airflow/issues/25243 is resolved. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] Migrate to connexion v3 [airflow]

2024-03-15 Thread via GitHub
vincbeck commented on PR #37638: URL: https://github.com/apache/airflow/pull/37638#issuecomment-1999885728 > > > breeze testing tests tests/api_connexion/endpoints/test_connection_endpoint.py > > > > > > It might be my environment that is wrongly set up ... When I run `breeze tes

Re: [I] Add/Edit Connection in REST API should reject non-JSON "extra" field [airflow]

2024-03-15 Thread via GitHub
harsh-doshii commented on issue #38163: URL: https://github.com/apache/airflow/issues/38163#issuecomment-1999890616 Hi @bbovenzi can you please assign this to me? This looks like a good first issue that I can work on. Thank you! -- This is an automated message from the Apache Git Service.

Re: [PR] Introduce configuration to disable md5 used for security [airflow]

2024-03-15 Thread via GitHub
umamaheswar52 commented on PR #31171: URL: https://github.com/apache/airflow/pull/31171#issuecomment-110153 @longslvr - one quick confirmation needed pls. Suppose that if I install Apache Airflow 2.6.1 (or <= 2.7.3) successfully on FIPS enabled Ubuntu OS, shall I ensure myself Airflow (

(airflow) branch main updated (2e35854a05 -> cbb0cad49c)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 2e35854a05 Make the method `BaseAuthManager.is_authorized_custom_view` abstract (#37915) add cbb0cad49c Rename m

Re: [PR] Rename `MLEngine` operators' fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #38053: URL: https://github.com/apache/airflow/pull/38053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

Re: [PR] Rename `DatabricksSqlOperator`'s fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal merged PR #38052: URL: https://github.com/apache/airflow/pull/38052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (cbb0cad49c -> 4742fc0ea5)

2024-03-15 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from cbb0cad49c Rename mlengine's operators' fields' names to comply with templated fields validation (#38053) add 47

Re: [PR] Add a templating test to `SparkSqlOperator` [airflow]

2024-03-15 Thread via GitHub
eladkal commented on PR #38184: URL: https://github.com/apache/airflow/pull/38184#issuecomment-121175 Static tests fail -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Rename `SparkSubmitOperator`/`SparkJDBCOperator` fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
eladkal commented on PR #38051: URL: https://github.com/apache/airflow/pull/38051#issuecomment-122501 There are conflicts :( -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[I] Connection to Postgres failed due to special characters in a password [airflow]

2024-03-15 Thread via GitHub
DEworkerDE opened a new issue, #38187: URL: https://github.com/apache/airflow/issues/38187 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.7.1 ### What happened? "Airflow UI te

Re: [PR] Add a templating test to `SparkSqlOperator` [airflow]

2024-03-15 Thread via GitHub
shahar1 commented on PR #38184: URL: https://github.com/apache/airflow/pull/38184#issuecomment-127994 > Static tests fail Fixed, forgot to remove an unused import. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Rename `SparkSubmitOperator`/`SparkJDBCOperator` fields' names to comply with templated fields validation [airflow]

2024-03-15 Thread via GitHub
shahar1 commented on PR #38051: URL: https://github.com/apache/airflow/pull/38051#issuecomment-134890 > There are conflicts :( Fixed; it's expected as we remove an entry in each PR from `.pre-commit-config.yaml`, and sometimes GIT can't resolve it :) -- This is an automated me

Re: [PR] Update deferring.rst [airflow]

2024-03-15 Thread via GitHub
potiuk merged PR #38122: URL: https://github.com/apache/airflow/pull/38122 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Update deferring.rst [airflow]

2024-03-15 Thread via GitHub
boring-cyborg[bot] commented on PR #38122: URL: https://github.com/apache/airflow/pull/38122#issuecomment-156335 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: Update deferring.rst (#38122)

2024-03-15 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new bbb03a7c17 Update deferring.rst (#38122) bbb03a7c17

[PR] Cleanup Airflow Configurations environment variables before run the tests [airflow]

2024-03-15 Thread via GitHub
Taragolis opened a new pull request, #38188: URL: https://github.com/apache/airflow/pull/38188 Developers usual use breeze environment for the different purposes: check something in airflow, run tests, etc. Also for configuration it is pretty common to use `/files/airflow

Re: [I] Mapping key "cluster-autoscaler.kubernetes.io/safe-to-evict" already defined [airflow]

2024-03-15 Thread via GitHub
nuvme-devops commented on issue #38183: URL: https://github.com/apache/airflow/issues/38183#issuecomment-179226 Update: We succeeded in the installation using the values below: ``` workers: safeToEvict: false scheduler: safeToEvict: false t

[I] UI button to run task_failed_deps on tasks in scheduled state [airflow]

2024-03-15 Thread via GitHub
collinmcnulty opened a new issue, #38189: URL: https://github.com/apache/airflow/issues/38189 ### Description There is a cli command `task_failed_deps` that produces a human-readable explanation for what dependencies a task needs to meet to progress to queued. I think when you click

Re: [I] Connection to Postgres failed due to special characters in a password [airflow]

2024-03-15 Thread via GitHub
DEworkerDE commented on issue #38187: URL: https://github.com/apache/airflow/issues/38187#issuecomment-223105 I think it it because of special characters in at the start of the password (i.e. first char is special char) -- This is an automated message from the Apache Git Service. To r

[PR] Ignore mypy complain about `directives._directives` in docs [airflow]

2024-03-15 Thread via GitHub
Taragolis opened a new pull request, #38190: URL: https://github.com/apache/airflow/pull/38190 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#

Re: [PR] [AIP-49] OpenTelemetry Traces for Apache Airflow [airflow]

2024-03-15 Thread via GitHub
ferruzzi commented on code in PR #37948: URL: https://github.com/apache/airflow/pull/37948#discussion_r1526555009 ## airflow/traces/otel_tracer.py: ## @@ -0,0 +1,316 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. S

Re: [PR] Ignore mypy complain about `directives._directives` in docs [airflow]

2024-03-15 Thread via GitHub
Taragolis commented on PR #38190: URL: https://github.com/apache/airflow/pull/38190#issuecomment-250852 That is 4th change from the last 4 days. so maybe we would like to exclude [entire file](https://mypy.readthedocs.io/en/stable/common_issues.html#ignoring-a-whole-file) from mypy?

  1   2   >