[GitHub] [airflow-client-python] litalkat opened a new issue, #95: TaskInstances- "get instance batch" is getting timeout after 1 minute, status code- 504 (~1000 records)

2023-09-21 Thread via GitHub
litalkat opened a new issue, #95: URL: https://github.com/apache/airflow-client-python/issues/95 is there a way to increase this timeout? Does pulling data for other airflow instances affect it? I tried to use _request-timeout=180 but it didn't help -- This is an automated message fr

[GitHub] [airflow] potiuk commented on pull request #33955: Fetch test

2023-09-21 Thread via GitHub
potiuk commented on PR #33955: URL: https://github.com/apache/airflow/pull/33955#issuecomment-1730804703 rebase? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

[GitHub] [airflow] potiuk commented on pull request #34042: AIP44 Fix DAG serialization

2023-09-21 Thread via GitHub
potiuk commented on PR #34042: URL: https://github.com/apache/airflow/pull/34042#issuecomment-1730798074 2 tasks failing, -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] potiuk commented on a diff in pull request #28900: Convert DagFileProcessor.execute_callbacks to Internal API

2023-09-21 Thread via GitHub
potiuk commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1333867561 ## airflow/models/taskinstance.py: ## @@ -190,23 +192,24 @@ def set_current_context(context: Context) -> Generator[Context, None, None]: ) -def _stop

[GitHub] [airflow] potiuk commented on a diff in pull request #28900: Convert DagFileProcessor.execute_callbacks to Internal API

2023-09-21 Thread via GitHub
potiuk commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1333867561 ## airflow/models/taskinstance.py: ## @@ -190,23 +192,24 @@ def set_current_context(context: Context) -> Generator[Context, None, None]: ) -def _stop

[GitHub] [airflow] huymq1710 commented on issue #16621: Open up breeze container ssh access to support IDE remote development

2023-09-21 Thread via GitHub
huymq1710 commented on issue #16621: URL: https://github.com/apache/airflow/issues/16621#issuecomment-1730784681 Background: I would like to debug and try to fix the issue I just found in `backfill_job_runner.py` in Pycharm Pro via breeze I already watched [your video](https://www.youtub

[GitHub] [airflow] potiuk commented on a diff in pull request #33213: Implement `is_authorized()` in auth manager

2023-09-21 Thread via GitHub
potiuk commented on code in PR #33213: URL: https://github.com/apache/airflow/pull/33213#discussion_r1333860330 ## airflow/www/views.py: ## @@ -1313,23 +1290,12 @@ def last_dagruns(self, session: Session = NEW_SESSION): return flask.json.jsonify(resp) @expose("/c

[GitHub] [airflow] Bowrna commented on pull request #34532: Keeping consistency in Statsd metrics description

2023-09-21 Thread via GitHub
Bowrna commented on PR #34532: URL: https://github.com/apache/airflow/pull/34532#issuecomment-1730780638 Congrats on your first commit :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[airflow] branch main updated: AIP-44 Migrate Job to Internal API (#34026)

2023-09-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7a5b6a39c9 AIP-44 Migrate Job to Internal API (#340

[GitHub] [airflow] potiuk merged pull request #34026: AIP-44 Migrate Job to Internal API

2023-09-21 Thread via GitHub
potiuk merged PR #34026: URL: https://github.com/apache/airflow/pull/34026 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk commented on pull request #34026: AIP-44 Migrate Job to Internal API

2023-09-21 Thread via GitHub
potiuk commented on PR #34026: URL: https://github.com/apache/airflow/pull/34026#issuecomment-1730779345 LGTM after deeper review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[GitHub] [airflow] huymq1710 commented on issue #16621: Open up breeze container ssh access to support IDE remote development

2023-09-21 Thread via GitHub
huymq1710 commented on issue #16621: URL: https://github.com/apache/airflow/issues/16621#issuecomment-1730779320 @potiuk Thank you I already run ``` cd /GitHub/airflow breeze start-airflow ``` > Add two source mappings from local source to container: /airflow ->

[GitHub] [airflow] potiuk commented on issue #16621: Open up breeze container ssh access to support IDE remote development

2023-09-21 Thread via GitHub
potiuk commented on issue #16621: URL: https://github.com/apache/airflow/issues/16621#issuecomment-1730774722 https://www.jetbrains.com/help/pycharm/configuring-remote-interpreters-via-ssh.html#ssh - > but you need to have PRO version of Pycharm -- This is an automated message from the A

[airflow] branch avoid-wsl2-desktop-linux-context updated (b6dfdd3563 -> 08b45ba09f)

2023-09-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch avoid-wsl2-desktop-linux-context in repository https://gitbox.apache.org/repos/asf/airflow.git from b6dfdd3563 Avoid WSL2 ones when finding a context for Breeze add 08b45ba09f fixup! Avo

[GitHub] [airflow] huymq1710 commented on issue #16621: Open up breeze container ssh access to support IDE remote development

2023-09-21 Thread via GitHub
huymq1710 commented on issue #16621: URL: https://github.com/apache/airflow/issues/16621#issuecomment-1730764333 Do we have any document for setting breeze with Pycharm ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[airflow] branch avoid-wsl2-desktop-linux-context created (now b6dfdd3563)

2023-09-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch avoid-wsl2-desktop-linux-context in repository https://gitbox.apache.org/repos/asf/airflow.git at b6dfdd3563 Avoid WSL2 ones when finding a context for Breeze This branch includes the foll

[GitHub] [airflow] potiuk opened a new pull request, #34538: Avoid WSL2 ones when finding a context for Breeze

2023-09-21 Thread via GitHub
potiuk opened a new pull request, #34538: URL: https://github.com/apache/airflow/pull/34538 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)*

[airflow] 01/01: Avoid WSL2 ones when finding a context for Breeze

2023-09-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch avoid-wsl2-desktop-linux-context in repository https://gitbox.apache.org/repos/asf/airflow.git commit b6dfdd35631db3b574a758528dcd9b41c5376f0d Author: Tzu-ping Chung AuthorDate: Sun Aug 20 14:55:

[GitHub] [airflow] potiuk opened a new pull request, #34537: Support rootless mode for docker.

2023-09-21 Thread via GitHub
potiuk opened a new pull request, #34537: URL: https://github.com/apache/airflow/pull/34537 In case docker is run in rootless mode, the host UID is mapped to root user automatically and host user id is mapped to 100999 (unknown) so changing ownership for created files in rootless mode is pr

[airflow] branch constraints-main updated: Updating constraints. Github run id:6268176274

2023-09-21 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 025c488863 Updating con

[GitHub] [airflow] peloyeje commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333675946 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, sess

[GitHub] [airflow] github-actions[bot] closed issue #13827: ExternalTaskMarker with user_defined_macros do not work in Airflow 2.0 or with store_serialized_dags = True in Airflow 1.10.*

2023-09-21 Thread via GitHub
github-actions[bot] closed issue #13827: ExternalTaskMarker with user_defined_macros do not work in Airflow 2.0 or with store_serialized_dags = True in Airflow 1.10.* URL: https://github.com/apache/airflow/issues/13827 -- This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] github-actions[bot] closed pull request #28626: Introduce logging integration for Apache WebHDFS

2023-09-21 Thread via GitHub
github-actions[bot] closed pull request #28626: Introduce logging integration for Apache WebHDFS URL: https://github.com/apache/airflow/pull/28626 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [airflow] github-actions[bot] commented on pull request #32915: Fix handling of single quotes in RedshiftToS3Operator

2023-09-21 Thread via GitHub
github-actions[bot] commented on PR #32915: URL: https://github.com/apache/airflow/pull/32915#issuecomment-1730517779 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

[GitHub] [airflow] potiuk commented on pull request #34531: Add more exemptions to lengthy metric list

2023-09-21 Thread via GitHub
potiuk commented on PR #34531: URL: https://github.com/apache/airflow/pull/34531#issuecomment-1730488305 🎉 Congrats! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[airflow] branch main updated: Add more exemptions to lengthy metric list (#34531)

2023-09-21 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fa6ca5d531 Add more exemptions to lengthy metric li

[GitHub] [airflow] potiuk merged pull request #34531: Add more exemptions to lengthy metric list

2023-09-21 Thread via GitHub
potiuk merged PR #34531: URL: https://github.com/apache/airflow/pull/34531 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] potiuk commented on pull request #34530: warn level for deprecated set to stacklevel 2

2023-09-21 Thread via GitHub
potiuk commented on PR #34530: URL: https://github.com/apache/airflow/pull/34530#issuecomment-1730485411 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [airflow] peloyeje commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333675946 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, sess

[GitHub] [airflow] fritz-astronomer commented on issue #34535: Unable to retrieve logs for nested task group when parent is mapped

2023-09-21 Thread via GitHub
fritz-astronomer commented on issue #34535: URL: https://github.com/apache/airflow/issues/34535#issuecomment-1730450973 If this is known/expected behavior, I don't see mention of it here: https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/dags.html#taskgroups or here:

[GitHub] [airflow] fritz-astronomer opened a new issue, #34535: Unable to retrieve logs for nested task group when parent is mapped

2023-09-21 Thread via GitHub
fritz-astronomer opened a new issue, #34535: URL: https://github.com/apache/airflow/issues/34535 ### Apache Airflow version 2.7.1 ### What happened Unable to retrieve logs for task inside task group inside mapped task group. Got `404 "TaskInstance not found"` in networ

[GitHub] [airflow] peloyeje commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333668145 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, sess

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34506: Update operator_extra_links property

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34506: URL: https://github.com/apache/airflow/pull/34506#issuecomment-1730437013 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

[airflow] branch main updated: Update `BatchOperator` operator_extra_links property (#34506)

2023-09-21 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 04515ef008 Update `BatchOperator` operator_extra

[GitHub] [airflow] Taragolis merged pull request #34506: Update operator_extra_links property

2023-09-21 Thread via GitHub
Taragolis merged PR #34506: URL: https://github.com/apache/airflow/pull/34506 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[airflow] branch main updated: Respect 'soft_fail' argument when running DatabricksPartitionSensor (#34517)

2023-09-21 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3813ed69c7 Respect 'soft_fail' argument when run

[GitHub] [airflow] Taragolis merged pull request #34517: Respect 'soft_fail' argument when running DatabricksPartitionSensor

2023-09-21 Thread via GitHub
Taragolis merged PR #34517: URL: https://github.com/apache/airflow/pull/34517 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[airflow] branch main updated: Ban import AirflowException from airflow (#34512)

2023-09-21 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e27325afad Ban import AirflowException from airf

[GitHub] [airflow] Taragolis merged pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
Taragolis merged PR #34512: URL: https://github.com/apache/airflow/pull/34512 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
ephraimbuddy commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333641645 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/ela

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
ephraimbuddy commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333641645 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/ela

[GitHub] [airflow] hussein-awala commented on a diff in pull request #34533: Defined constants for repo routes in databricks hook

2023-09-21 Thread via GitHub
hussein-awala commented on code in PR #34533: URL: https://github.com/apache/airflow/pull/34533#discussion_r1333638432 ## airflow/providers/databricks/hooks/databricks.py: ## @@ -526,7 +530,7 @@ def update_repo(self, repo_id: str, json: dict[str, Any]) -> dict: :param

[GitHub] [airflow] westonplatter opened a new issue, #34534: Datasets - trigger DAG run when any dataset is updated

2023-09-21 Thread via GitHub
westonplatter opened a new issue, #34534: URL: https://github.com/apache/airflow/issues/34534 ### Description On [this doc page](https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/datasets.html#multiple-datasets), Airflow explicitly says all datasets need

[GitHub] [airflow] boring-cyborg[bot] commented on issue #34534: Datasets - trigger DAG run when any dataset is updated

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on issue #34534: URL: https://github.com/apache/airflow/issues/34534#issuecomment-1730342854 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[GitHub] [airflow] peloyeje commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333611036 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, sess

[GitHub] [airflow] peloyeje commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333607409 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, sess

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34533: Defined constants for repo routes in databricks hook

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34533: URL: https://github.com/apache/airflow/pull/34533#issuecomment-1730282603 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] philipgray opened a new pull request, #34533: Defined constants for repo routes in databricks hook

2023-09-21 Thread via GitHub
philipgray opened a new pull request, #34533: URL: https://github.com/apache/airflow/pull/34533 Hi, this is my first PR, so I'm sorry if this isn't perfect. Per #34521 I created three new constants for the routes, and then modified said functions to use those constants

[GitHub] [airflow] Taragolis commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
Taragolis commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333584121 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/elasti

[GitHub] [airflow] hussein-awala commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
hussein-awala commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333557853 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances,

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
ephraimbuddy commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333554717 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/ela

[GitHub] [airflow] Taragolis commented on a diff in pull request #34492: Fix datetime deserialization by replacing timezone short code by its name in serialized values

2023-09-21 Thread via GitHub
Taragolis commented on code in PR #34492: URL: https://github.com/apache/airflow/pull/34492#discussion_r1333533797 ## airflow/serialization/serializers/datetime.py: ## @@ -62,12 +68,30 @@ def deserialize(classname: str, version: int, data: dict | str) -> datetime.date fr

[GitHub] [airflow] SamWheating commented on a diff in pull request #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
SamWheating commented on code in PR #34529: URL: https://github.com/apache/airflow/pull/34529#discussion_r1333530895 ## airflow/www/views.py: ## @@ -5803,21 +5853,42 @@ def duration_f(self): @provide_session @action_logging def action_clear(self, task_instances, s

[GitHub] [airflow] Taragolis commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
Taragolis commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333521508 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/elasti

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
ephraimbuddy commented on code in PR #34512: URL: https://github.com/apache/airflow/pull/34512#discussion_r1333484466 ## pyproject.toml: ## @@ -144,6 +145,9 @@ combine-as-imports = true "tests/providers/elasticsearch/log/elasticmock/__init__.py" = ["E402"] "tests/providers/ela

[GitHub] [airflow] hussein-awala commented on pull request #34532: Keeping consistency in Statsd metrics description

2023-09-21 Thread via GitHub
hussein-awala commented on PR #34532: URL: https://github.com/apache/airflow/pull/34532#issuecomment-1730129843 Congrats on your first commit :tada: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[airflow] branch main updated: using seconds for failed scenarios too (#34532)

2023-09-21 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 117e404908 using seconds for failed scenarios

[GitHub] [airflow] hussein-awala merged pull request #34532: Keeping consistency in Statsd metrics description

2023-09-21 Thread via GitHub
hussein-awala merged PR #34532: URL: https://github.com/apache/airflow/pull/34532 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] hussein-awala closed issue #33377: Statsd metrics description is incorrect

2023-09-21 Thread via GitHub
hussein-awala closed issue #33377: Statsd metrics description is incorrect URL: https://github.com/apache/airflow/issues/33377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. T

[GitHub] [airflow] avramdj commented on issue #28723: Fix all deprecations for SQLAlchemy 2.0

2023-09-21 Thread via GitHub
avramdj commented on issue #28723: URL: https://github.com/apache/airflow/issues/28723#issuecomment-1730120627 Hi everyone, what's the current state of this and is it known when we can expect SA2.0 support? -- This is an automated message from the Apache Git Service. To respond to the mes

[airflow] branch main updated: warn level for deprecated set to stacklevel 2 (#34530)

2023-09-21 Thread amoghdesai
This is an automated email from the ASF dual-hosted git repository. amoghdesai pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 08729eddbd warn level for deprecated set to sta

[GitHub] [airflow] amoghrajesh merged pull request #34530: warn level for deprecated set to stacklevel 2

2023-09-21 Thread via GitHub
amoghrajesh merged PR #34530: URL: https://github.com/apache/airflow/pull/34530 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

[GitHub] [airflow] cbuffett commented on issue #34497: ExternalTaskSensor doesn't timeout if external DAG doesn't exist - dag.test()

2023-09-21 Thread via GitHub
cbuffett commented on issue #34497: URL: https://github.com/apache/airflow/issues/34497#issuecomment-1730092505 @utkarsharma2 Yes, that script should easily reproduce the infinite rescheduling. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34532: Keeping consistency in Statsd metrics description

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34532: URL: https://github.com/apache/airflow/pull/34532#issuecomment-1730056139 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] shubhamraj-git opened a new pull request, #34532: Keeping consistency in Statsd metrics description

2023-09-21 Thread via GitHub
shubhamraj-git opened a new pull request, #34532: URL: https://github.com/apache/airflow/pull/34532 There was a inconsistency in the Statsd metrics description, this PR solves it. closes: #33377 --- **^ Add meaningful description above** Read the **[Pull

[GitHub] [airflow] hussein-awala commented on pull request #34527: add warn stacklevel=2 to ssh hook

2023-09-21 Thread via GitHub
hussein-awala commented on PR #34527: URL: https://github.com/apache/airflow/pull/34527#issuecomment-1730049819 Congrats on your first commit 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[airflow] branch main updated: add warn stacklevel=2 to ssh hook (#34527)

2023-09-21 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 06965e604c add warn stacklevel=2 to ssh hook

[GitHub] [airflow] hussein-awala merged pull request #34527: add warn stacklevel=2 to ssh hook

2023-09-21 Thread via GitHub
hussein-awala merged PR #34527: URL: https://github.com/apache/airflow/pull/34527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

[GitHub] [airflow] hussein-awala closed issue #34422: Consolidate stacklevel in ssh hooks warning

2023-09-21 Thread via GitHub
hussein-awala closed issue #34422: Consolidate stacklevel in ssh hooks warning URL: https://github.com/apache/airflow/issues/34422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [airflow] richsuca closed pull request #34525: Fix typing for get_provider_name_from_short_hand and its usages

2023-09-21 Thread via GitHub
richsuca closed pull request #34525: Fix typing for get_provider_name_from_short_hand and its usages URL: https://github.com/apache/airflow/pull/34525 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34531: Add more exemptions to lengthy metric list

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34531: URL: https://github.com/apache/airflow/pull/34531#issuecomment-1730041301 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] sa1 opened a new pull request, #34531: Add more exemptions to lengthy metric list

2023-09-21 Thread via GitHub
sa1 opened a new pull request, #34531: URL: https://github.com/apache/airflow/pull/34531 This commit adds more metrics to the set of OTEL metric names which are exempted from max length check. This will temporarily fix the issue that raises exceptions and prevents tasks from run

[GitHub] [airflow] daxmahoney opened a new pull request, #34530: warn level for deprecated set to stacklevel 2

2023-09-21 Thread via GitHub
daxmahoney opened a new pull request, #34530: URL: https://github.com/apache/airflow/pull/34530 I added the category to the warning class closes: https://github.com/apache/airflow/issues/34423 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [airflow] peloyeje opened a new pull request, #34529: Add ability to clear downstream tis in "List Task Instances" view

2023-09-21 Thread via GitHub
peloyeje opened a new pull request, #34529: URL: https://github.com/apache/airflow/pull/34529 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines

[GitHub] [airflow] Bowrna opened a new pull request, #34528: previous end date success

2023-09-21 Thread via GitHub
Bowrna opened a new pull request, #34528: URL: https://github.com/apache/airflow/pull/34528 related: #33375 closes: #33375 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTR

[GitHub] [airflow] bolkedebruin commented on a diff in pull request #34492: Fix datetime deserialization by replacing timezone short code by its name in serialized values

2023-09-21 Thread via GitHub
bolkedebruin commented on code in PR #34492: URL: https://github.com/apache/airflow/pull/34492#discussion_r172959 ## airflow/serialization/serializers/datetime.py: ## @@ -62,12 +68,30 @@ def deserialize(classname: str, version: int, data: dict | str) -> datetime.date

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34527: add warn stacklevel=2 to ssh hook

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34527: URL: https://github.com/apache/airflow/pull/34527#issuecomment-1729996486 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] daxmahoney opened a new pull request, #34527: add warn stacklevel=2 to ssh hook

2023-09-21 Thread via GitHub
daxmahoney opened a new pull request, #34527: URL: https://github.com/apache/airflow/pull/34527 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelin

[GitHub] [airflow] bfeif opened a new issue, #34526: BaseBranchOperator should allow passing of a Taskgroup group_id.

2023-09-21 Thread via GitHub
bfeif opened a new issue, #34526: URL: https://github.com/apache/airflow/issues/34526 ### Description At present, `BaseBranchOperator` only accepts `task_id`'s as possible branches. This can be awkward in the case that a `Taskgroup` is one of the branches: for example if the `Taskgro

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #34525: Fix typing for get_provider_name_from_short_hand and its usages

2023-09-21 Thread via GitHub
boring-cyborg[bot] commented on PR #34525: URL: https://github.com/apache/airflow/pull/34525#issuecomment-1729991647 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] richsuca opened a new pull request, #34525: Fix typing for get_provider_name_from_short_hand and its usages

2023-09-21 Thread via GitHub
richsuca opened a new pull request, #34525: URL: https://github.com/apache/airflow/pull/34525 Removed the type cast --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTIN

[GitHub] [airflow] hainenber commented on pull request #34486: feat(ui/graph): enhance task status visibility

2023-09-21 Thread via GitHub
hainenber commented on PR #34486: URL: https://github.com/apache/airflow/pull/34486#issuecomment-1729934733 I think your proposal works pretty fine. I've made a draft change and the selected task looks identifiable re: its status here. Do let me know what you think https://github.com

[GitHub] [airflow] bbovenzi commented on a diff in pull request #34486: feat(ui/graph): enhance task status visibility

2023-09-21 Thread via GitHub
bbovenzi commented on code in PR #34486: URL: https://github.com/apache/airflow/pull/34486#discussion_r111801 ## airflow/www/static/js/dag/details/graph/Node.tsx: ## @@ -107,8 +112,8 @@ export const BaseNode = ({ >

[GitHub] [airflow] bbovenzi commented on pull request #34486: feat(ui/graph): enhance task status visibility

2023-09-21 Thread via GitHub
bbovenzi commented on PR #34486: URL: https://github.com/apache/airflow/pull/34486#issuecomment-1729886865 I'm still a bit stuck on the border color signifying two different things, task state and if its selected. And when I have a selected node, it would become less clear what the status i

[GitHub] [airflow] bbovenzi commented on a diff in pull request #34486: feat(ui/graph): enhance task status visibility

2023-09-21 Thread via GitHub
bbovenzi commented on code in PR #34486: URL: https://github.com/apache/airflow/pull/34486#discussion_r108172 ## airflow/www/static/js/dag/details/graph/Node.tsx: ## @@ -93,6 +93,11 @@ export const BaseNode = ({ [, operatorTextColor] = labelStyle.split(":"); } + c

[GitHub] [airflow] pankajastro opened a new pull request, #34523: Restore EXISTING_ROLES from security.py

2023-09-21 Thread via GitHub
pankajastro opened a new pull request, #34523: URL: https://github.com/apache/airflow/pull/34523 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guideli

[GitHub] [airflow] pankajastro commented on a diff in pull request #33901: Fix inheritance chain in security manager

2023-09-21 Thread via GitHub
pankajastro commented on code in PR #33901: URL: https://github.com/apache/airflow/pull/33901#discussion_r1333264646 ## airflow/www/security.py: ## @@ -16,785 +16,25 @@ # under the License. from __future__ import annotations -import warnings -from typing import TYPE_CHECKING

[GitHub] [airflow] SamWheating commented on a diff in pull request #34172: Add support for driver pool, instance flexibility policy, and min_num_instances for Dataproc

2023-09-21 Thread via GitHub
SamWheating commented on code in PR #34172: URL: https://github.com/apache/airflow/pull/34172#discussion_r1333246174 ## airflow/providers/google/cloud/operators/dataproc.py: ## @@ -84,6 +117,7 @@ class ClusterGenerator: to create the cluster. (templated) :param num

[GitHub] [airflow] vincbeck commented on a diff in pull request #33901: Fix inheritance chain in security manager

2023-09-21 Thread via GitHub
vincbeck commented on code in PR #33901: URL: https://github.com/apache/airflow/pull/33901#discussion_r1333260908 ## airflow/www/security.py: ## @@ -16,785 +16,25 @@ # under the License. from __future__ import annotations -import warnings -from typing import TYPE_CHECKING, A

[airflow] branch main updated: Change two whitespaces to one (#34519)

2023-09-21 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a1bd871958 Change two whitespaces to one (#34519)

[GitHub] [airflow] bbovenzi merged pull request #34519: Change Hide/Show Details button title in Grid View

2023-09-21 Thread via GitHub
bbovenzi merged PR #34519: URL: https://github.com/apache/airflow/pull/34519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

[GitHub] [airflow] Taragolis commented on pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
Taragolis commented on PR #34512: URL: https://github.com/apache/airflow/pull/34512#issuecomment-1729806272 I think we also could do that. I think this "shortcuts" valuable for the endusers rather than in airflow codebase. -- This is an automated message from the Apache Git Service. To re

[GitHub] [airflow] liamalsopp commented on issue #34516: Jobs in Azure Containers restart infinitely if logger crashes, despite retries being set to off.

2023-09-21 Thread via GitHub
liamalsopp commented on issue #34516: URL: https://github.com/apache/airflow/issues/34516#issuecomment-1729792365 Here's the code that's run inside the Azure Container instance that can replicate this issue. `import re import pandas as pd import phonenumbers import tldextract

[GitHub] [airflow] frankcash opened a new issue, #34521: Finish constant variables for routes in databricks hook

2023-09-21 Thread via GitHub
frankcash opened a new issue, #34521: URL: https://github.com/apache/airflow/issues/34521 ### Apache Airflow version main (development) ### What happened Databricks hook utilizes some constant variables to define routes and the operations on them https://github.com/apac

[airflow] branch main updated: Decode response in f-string (#34518)

2023-09-21 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 966c2bce9f Decode response in f-string (#34518) 9

[GitHub] [airflow] vincbeck commented on pull request #34512: Ban import AirflowException from airflow

2023-09-21 Thread via GitHub
vincbeck commented on PR #34512: URL: https://github.com/apache/airflow/pull/34512#issuecomment-1729764607 Nice! Should not we do the same with models? e.g. `from airflow.models.dagrun import DagRun` instead of `from airflow.models import DagRun` -- This is an automated message from the

[GitHub] [airflow] vincbeck merged pull request #34518: Decode response in f-string

2023-09-21 Thread via GitHub
vincbeck merged PR #34518: URL: https://github.com/apache/airflow/pull/34518 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

[GitHub] [airflow] RNHTTR commented on issue #34448: dag stuck in "running" status when running in backfill job

2023-09-21 Thread via GitHub
RNHTTR commented on issue #34448: URL: https://github.com/apache/airflow/issues/34448#issuecomment-1729762988 I've been able to reproduce this. Interacting with a task via the database (e.g. clearing or marking the task as failed) during a backfill DAG run results in tasks no longer being s

[GitHub] [airflow] vincbeck commented on a diff in pull request #33901: Fix inheritance chain in security manager

2023-09-21 Thread via GitHub
vincbeck commented on code in PR #33901: URL: https://github.com/apache/airflow/pull/33901#discussion_r1333196608 ## airflow/www/security.py: ## @@ -16,785 +16,25 @@ # under the License. from __future__ import annotations -import warnings -from typing import TYPE_CHECKING, A

[GitHub] [airflow] krisfur commented on issue #34516: Jobs in Azure Containers restart infinitely if logger crashes, despite retries being set to off.

2023-09-21 Thread via GitHub
krisfur commented on issue #34516: URL: https://github.com/apache/airflow/issues/34516#issuecomment-1729601114 A snippet of the log when this issue happens: `[2023-09-21, 13:26:28 UTC] {container_instances.py:344} ERROR - Exception while getting container groups Traceback (most rec

  1   2   >