Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
potiuk commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2151467274 And yes we are doing it alread - merged 2 days ago :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
potiuk commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2151466854 > That's why the --resolution lowest flag on uv is appealing btw, it'll let us identify when we've missed bumping the min on a dep :) (though I'm not sure if we are doing that yet or

Re: [PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-05 Thread via GitHub
Lee-W commented on PR #40050: URL: https://github.com/apache/airflow/pull/40050#issuecomment-2151466061 Looks like we'll need https://github.com/apache/airflow/commit/79042cff416296c8bdbd64f2e0a5f4d46c93e882 to pass the mypy check -- This is an automated message from the Apache Git

Re: [I] Unable to Scroll Down to See All DAG Runs in Calendar View [airflow]

2024-06-05 Thread via GitHub
vatsrahul1001 commented on issue #40083: URL: https://github.com/apache/airflow/issues/40083#issuecomment-2151423297 discussed with @hkc-8010 in react calendar scroll is not available only. User had initiated a backfill till run_id 2015 and not able to scroll -- This is an automated

[I] Unable to Scroll Down to See All DAG Runs in Calendar View [airflow]

2024-06-05 Thread via GitHub
hkc-8010 opened a new issue, #40083: URL: https://github.com/apache/airflow/issues/40083 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? 2.9.1 ### What happened? I am unable to scroll down to see all the DAG runs in

Re: [I] duplicate key value violates unique constraint serialized_dag_pkey for dynamic dag generation [airflow]

2024-06-05 Thread via GitHub
boring-cyborg[bot] commented on issue #40082: URL: https://github.com/apache/airflow/issues/40082#issuecomment-2151363131 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] duplicate key value violates unique constraint serialized_dag_pkey for dynamic dag generation [airflow]

2024-06-05 Thread via GitHub
jiananyim opened a new issue, #40082: URL: https://github.com/apache/airflow/issues/40082 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.1 ### What happened? Hello,

[PR] add default gcp_conn_id to GoogleBaseAsyncHook [airflow]

2024-06-05 Thread via GitHub
Lee-W opened a new pull request, #40080: URL: https://github.com/apache/airflow/pull/40080 --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] Add task documentation to details tab in grid view. [airflow]

2024-06-05 Thread via GitHub
tirkarthi commented on PR #39899: URL: https://github.com/apache/airflow/pull/39899#issuecomment-2151291406 I have rebases and it still fails. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] catch sentry flush if exception happens in _execute_in_fork finally block [airflow]

2024-06-05 Thread via GitHub
Lee-W commented on code in PR #40060: URL: https://github.com/apache/airflow/pull/40060#discussion_r1628657678 ## airflow/providers/celery/executors/celery_executor_utils.py: ## @@ -175,7 +175,11 @@ def _execute_in_fork(command_to_exec: CommandType, celery_task_id: str | None

Re: [PR] Avoid resetting adopted task instances when retrying for kubernetes executor [airflow]

2024-06-05 Thread via GitHub
tanvn commented on PR #39406: URL: https://github.com/apache/airflow/pull/39406#issuecomment-2151259137 > is it possible to cover this fix with unit tests to avoid regression? @eladkal Let me take a look! -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Support checking for db path absoluteness on Windows [airflow]

2024-06-05 Thread via GitHub
uranusjr commented on code in PR #40069: URL: https://github.com/apache/airflow/pull/40069#discussion_r1628585916 ## airflow/settings.py: ## @@ -278,17 +280,29 @@ def remove(*args, **kwargs): pass +def _is_sqlite_db_path_relative(sqla_conn_str: str) -> bool: +

Re: [I] Airflow DAG Task Exits with Return Code 1 [airflow]

2024-06-05 Thread via GitHub
github-actions[bot] commented on issue #39601: URL: https://github.com/apache/airflow/issues/39601#issuecomment-2151152980 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Airflow DAG Task Exits with Return Code 1 [airflow]

2024-06-05 Thread via GitHub
github-actions[bot] closed issue #39601: Airflow DAG Task Exits with Return Code 1 URL: https://github.com/apache/airflow/issues/39601 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [I] Migration tool for Airflow config file [airflow]

2024-06-05 Thread via GitHub
github-actions[bot] commented on issue #39612: URL: https://github.com/apache/airflow/issues/39612#issuecomment-2151152962 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Migration tool for Airflow config file [airflow]

2024-06-05 Thread via GitHub
github-actions[bot] closed issue #39612: Migration tool for Airflow config file URL: https://github.com/apache/airflow/issues/39612 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] Bump google-ads version [airflow]

2024-06-05 Thread via GitHub
molcay opened a new pull request, #40079: URL: https://github.com/apache/airflow/pull/40079 Update the version of `google-ads` library --- **^ Add meaningful description above** Read the **[Pull Request

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2151062276 That's why the `--resolution lowest` flag on uv is appealing btw, it'll let us identify when we've missed bumping the min on a dep :) (though I'm not sure if we are doing that

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2151060724 Generally speaking, yes, we should set the min based on what we actually need from that dep. Of course, constraints can and will have the higher version. -- This is an

Re: [PR] Load Example Plugins with Example DAGs [airflow]

2024-06-05 Thread via GitHub
jscheffl commented on code in PR #3: URL: https://github.com/apache/airflow/pull/3#discussion_r1628493479 ## tests/plugins/workday.py: ## @@ -23,6 +23,9 @@ from __future__ import annotations -from airflow.example_dags.plugins.workday import AfterWorkdayTimetable,

Re: [PR] AIP-61 - Scheduler job: main loop and event processing for multi executors [airflow]

2024-06-05 Thread via GitHub
syedahsn commented on code in PR #40017: URL: https://github.com/apache/airflow/pull/40017#discussion_r1628474628 ## airflow/jobs/scheduler_job_runner.py: ## @@ -1844,6 +1895,58 @@ def _executor_to_tis(self, tis: list[TaskInstance]) -> dict[BaseExecutor, list[T

[PR] openlineage: isolate metadata extraction by executing OL methods in separate, forked process [airflow]

2024-06-05 Thread via GitHub
mobuchowski opened a new pull request, #40078: URL: https://github.com/apache/airflow/pull/40078 This PR builds on https://github.com/apache/airflow/pull/39890 After this change, OpenLineage will execute metadata extraction in separate, forked process. It's a technique modeled to

(airflow) branch openlineage-process-execution updated (449dd3c671 -> 2a1c57a346)

2024-06-05 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git discard 449dd3c671 openlineage: execute extraction and message sending in separate process

(airflow) branch openlineage-process-execution updated (2a1c57a346 -> 23849615a9)

2024-06-05 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git discard 2a1c57a346 openlineage: execute extraction and message sending in separate process

(airflow) 01/01: openlineage: execute extraction and message sending in separate process

2024-06-05 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git commit 23849615a93da2dafd9a9fa76af456fe9b69de2a Author: Maciej Obuchowski AuthorDate: Fri May 31

(airflow) branch listener-task-timeout updated (e2acd51121 -> ec1b19417c)

2024-06-05 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch listener-task-timeout in repository https://gitbox.apache.org/repos/asf/airflow.git omit e2acd51121 local task job: add timeout, to not kill on_task_instance_success listener

(airflow) 01/01: openlineage: execute extraction and message sending in separate process

2024-06-05 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git commit 2a1c57a34621a848e75d5f3642e9c60936fcee9b Author: Maciej Obuchowski AuthorDate: Fri May 31

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
ferruzzi commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2150959336 @jedcunningham We needed 1.34.90 for a feature that was requested, and I did that bump yesterday. So no, the bump from x.90 to x.106 isn't currently mandatory, but there are a lot

Re: [PR] Resolve dagbag deprecations in tests [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #39989: URL: https://github.com/apache/airflow/pull/39989 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated (f28ee5a694 -> 45bf7b9721)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from f28ee5a694 Resolve core operators deprecations in tests (#39992) add 45bf7b9721 Resolve dagbag

(airflow) branch main updated (16e0182025 -> f28ee5a694)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 16e0182025 Docs: Simpler command to check local scheduler is alive (#40074) add f28ee5a694 Resolve core

Re: [PR] Resolve core operators deprecations in tests [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #39992: URL: https://github.com/apache/airflow/pull/39992 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on PR #40073: URL: https://github.com/apache/airflow/pull/40073#issuecomment-2150921564 For my own edification, is there a reason we need to bump the min version? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

(airflow) branch v2-9-test updated (d1e1dc920c -> 688a7ac5c3)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard d1e1dc920c Update RELEASE_NOTES.rst discard 4708a353d8 Update version to 2.9.2 add 911740a037

(airflow) branch main updated (fcb9f87c55 -> 16e0182025)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from fcb9f87c55 fix typo and path to licences folder (#40067) add 16e0182025 Docs: Simpler command to check

(airflow) branch main updated (4dea367047 -> fcb9f87c55)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4dea367047 Add unit test to cover back compat case in celery (#40035) add fcb9f87c55 fix typo and path to

Re: [PR] Docs: Simpler command to check local scheduler is alive [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #40074: URL: https://github.com/apache/airflow/pull/40074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] fix typo and path to licences folder [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #40067: URL: https://github.com/apache/airflow/pull/40067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] AIP-61 - Scheduler job: main loop and event processing for multi executors [airflow]

2024-06-05 Thread via GitHub
ferruzzi commented on code in PR #40017: URL: https://github.com/apache/airflow/pull/40017#discussion_r1628366265 ## airflow/jobs/scheduler_job_runner.py: ## @@ -422,7 +423,15 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) -

Re: [I] Add support for SqlAlchemy statement in the SqlExecuteQueryOperator [airflow]

2024-06-05 Thread via GitHub
RNHTTR commented on issue #40066: URL: https://github.com/apache/airflow/issues/40066#issuecomment-2150845958 This feels kinda risky from a security perspective. Could you use SqlAlchemy to dump the SA query to a SQL string? -- This is an automated message from the Apache Git Service. To

(airflow) branch v2-9-test updated (bb937f6d49 -> d1e1dc920c)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit bb937f6d49 Update RELEASE_NOTES.rst omit 7f296e66e6 Update version to 2.9.2 omit 8c8c6cf066

Re: [PR] Add task documentation to details tab in grid view. [airflow]

2024-06-05 Thread via GitHub
jscheffl commented on PR #39899: URL: https://github.com/apache/airflow/pull/39899#issuecomment-2150831078 > I also noticed report where one another PR also has failing provider tests. > > [#40034 (comment)](https://github.com/apache/airflow/pull/40034#issuecomment-2146399933)

Re: [I] download log - Try number 0 is invalid [airflow]

2024-06-05 Thread via GitHub
eladkal commented on issue #40070: URL: https://github.com/apache/airflow/issues/40070#issuecomment-2150815534 Can you check if this is reproducible on main branch? There was segnificant change around `try_numver` which will be released in 2.10 -- This is an automated message from the

Re: [I] Databricks Provider (Version 6.1.0) seems to bump the airflow version to latest [airflow]

2024-06-05 Thread via GitHub
eladkal closed issue #40076: Databricks Provider (Version 6.1.0) seems to bump the airflow version to latest URL: https://github.com/apache/airflow/issues/40076 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Databricks Provider (Version 6.1.0) seems to bump the airflow version to latest [airflow]

2024-06-05 Thread via GitHub
eladkal commented on issue #40076: URL: https://github.com/apache/airflow/issues/40076#issuecomment-2150812736 This is not about Airflow. It's about how pip works. I recommand following the docs by doing so you will avoid such problems

Re: [I] Add dark theme, by @prefers-color-theme [airflow-site]

2024-06-05 Thread via GitHub
porwalshreyaa commented on issue #803: URL: https://github.com/apache/airflow-site/issues/803#issuecomment-2150804289 Hey @vitaly-zdanevich, are you still working on it? Or else I am willing to take this issue as no dark mode is too much trouble for me  -- This is an automated message

[I] Databricks Provider (Version 6.1.0) seems to bump the airflow version to latest [airflow]

2024-06-05 Thread via GitHub
Rutvijjs opened a new issue, #40076: URL: https://github.com/apache/airflow/issues/40076 ### Apache Airflow Provider(s) databricks ### Versions of Apache Airflow Providers 6.1.0 and above ### Apache Airflow version 2.6.3 ### Operating System

Re: [I] Databricks Provider (Version 6.1.0) seems to bump the airflow version to latest [airflow]

2024-06-05 Thread via GitHub
boring-cyborg[bot] commented on issue #40076: URL: https://github.com/apache/airflow/issues/40076#issuecomment-2150799455 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

Re: [I] SIGBUS Error on Airflow 2.9.1 with JDBC Connection to Hive on macOS with Apple M3 Pro [airflow]

2024-06-05 Thread via GitHub
Taragolis closed issue #40071: SIGBUS Error on Airflow 2.9.1 with JDBC Connection to Hive on macOS with Apple M3 Pro URL: https://github.com/apache/airflow/issues/40071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(airflow) branch v2-9-test updated (48320cb03c -> bb937f6d49)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 48320cb03c Update RELEASE_NOTES.rst omit fe49589d77 Update version to 2.9.2 omit 419672cc9d

Re: [I] Support `limit` and `offset` parameters for List task instances (batch) endpoint [airflow]

2024-06-05 Thread via GitHub
shahar1 commented on issue #40038: URL: https://github.com/apache/airflow/issues/40038#issuecomment-2150701418 > @shahar1 , [Documentation](https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/get_task_instances_batch) does not mention about

[PR] Docs: Simpler command to check local scheduler is alive [airflow]

2024-06-05 Thread via GitHub
jedcunningham opened a new pull request, #40074: URL: https://github.com/apache/airflow/pull/40074 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

(airflow) branch v2-9-test updated (ecc0eb9e71 -> 48320cb03c)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit ecc0eb9e71 Update RELEASE_NOTES.rst omit 87dc56bdfc Update version to 2.9.2 omit 77af06e390

Re: [PR] catch sentry flush if exception happens in _execute_in_fork finally block [airflow]

2024-06-05 Thread via GitHub
eladkal commented on code in PR #40060: URL: https://github.com/apache/airflow/pull/40060#discussion_r1628205388 ## airflow/providers/celery/executors/celery_executor_utils.py: ## @@ -175,7 +175,11 @@ def _execute_in_fork(command_to_exec: CommandType, celery_task_id: str |

(airflow) branch main updated: Add unit test to cover back compat case in celery (#40035)

2024-06-05 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4dea367047 Add unit test to cover back compat

Re: [PR] Unit test for celery change_state wrapper [airflow]

2024-06-05 Thread via GitHub
eladkal merged PR #40035: URL: https://github.com/apache/airflow/pull/40035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Bump botocore to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
ferruzzi commented on code in PR #40073: URL: https://github.com/apache/airflow/pull/40073#discussion_r1628186958 ## airflow/providers/amazon/provider.yaml: ## @@ -135,9 +135,9 @@ devel-dependencies: - aws_xray_sdk>=2.12.0 - moto[cloudformation,glue]>=5.0.0 -

[PR] Bump botocore to 1.34.106 [airflow]

2024-06-05 Thread via GitHub
ferruzzi opened a new pull request, #40073: URL: https://github.com/apache/airflow/pull/40073 Follow-up to https://github.com/apache/airflow/pull/40052 I was able to get it a little higher. After a bit more experimentation, this looks like the current practical version cap until

Re: [PR] AIP-61 - Add executor field to the task instance API [airflow]

2024-06-05 Thread via GitHub
syedahsn commented on code in PR #40034: URL: https://github.com/apache/airflow/pull/40034#discussion_r1628168153 ## airflow/www/static/js/dag/details/taskInstance/Details.tsx: ## @@ -53,6 +53,7 @@ const Details = ({ gridInstance, taskInstance, group }: Props) => { const

Re: [PR] AIP-61 - Add executor field to the task instance API [airflow]

2024-06-05 Thread via GitHub
syedahsn commented on code in PR #40034: URL: https://github.com/apache/airflow/pull/40034#discussion_r1628168153 ## airflow/www/static/js/dag/details/taskInstance/Details.tsx: ## @@ -53,6 +53,7 @@ const Details = ({ gridInstance, taskInstance, group }: Props) => { const

Re: [PR] AIP-61 - Add executor field to the task instance API [airflow]

2024-06-05 Thread via GitHub
syedahsn commented on code in PR #40034: URL: https://github.com/apache/airflow/pull/40034#discussion_r1628168153 ## airflow/www/static/js/dag/details/taskInstance/Details.tsx: ## @@ -53,6 +53,7 @@ const Details = ({ gridInstance, taskInstance, group }: Props) => { const

(airflow) branch main updated (ef1c9a2a2b -> e7f11b58b6)

2024-06-05 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from ef1c9a2a2b Chart: Allow AWS Executors (#38524) add e7f11b58b6 Resolve databricks deprecations in tests (#40068)

Re: [PR] Resolve databricks deprecations in tests [airflow]

2024-06-05 Thread via GitHub
eladkal merged PR #40068: URL: https://github.com/apache/airflow/pull/40068 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[PR] Resolve google cloud kubernetes operator and trigger deprecations in tests [airflow]

2024-06-05 Thread via GitHub
dirrao opened a new pull request, #40072: URL: https://github.com/apache/airflow/pull/40072 Resolve google cloud kubernetes operator and trigger deprecations in tests related: https://github.com/apache/airflow/issues/38642 -- This is an automated message from the Apache Git Service. To

Re: [I] DAG disappearing from Airflow in case of standalone DAG processor [airflow]

2024-06-05 Thread via GitHub
andyjianzhou commented on issue #39332: URL: https://github.com/apache/airflow/issues/39332#issuecomment-2150580125 Hey, is it okay if I get assigned to this issue? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

(airflow) branch v2-9-test updated (600da55c68 -> ecc0eb9e71)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 600da55c68 Update RELEASE_NOTES.rst discard 2208af9d0c Update version to 2.9.2 discard da5260f2f5

(airflow) branch main updated (ac2a1ef81d -> ef1c9a2a2b)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from ac2a1ef81d Expllicitly skip API tests for compatiblity tests on 2.7 and 2.8 (#40059) add ef1c9a2a2b

Re: [PR] Chart: Allow AWS ECS Executor [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #38524: URL: https://github.com/apache/airflow/pull/38524 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [I] SIGBUS Error on Airflow 2.9.1 with JDBC Connection to Hive on macOS with Apple M3 Pro [airflow]

2024-06-05 Thread via GitHub
boring-cyborg[bot] commented on issue #40071: URL: https://github.com/apache/airflow/issues/40071#issuecomment-2150495611 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

Re: [PR] Add metrics_allow_list and metrics_block_list to statsd deployments env [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on code in PR #38697: URL: https://github.com/apache/airflow/pull/38697#discussion_r1628091310 ## chart/templates/statsd/statsd-deployment.yaml: ## @@ -104,8 +104,17 @@ spec: - "--statsd.mapping-config=/etc/statsd-exporter/mappings.yml"

[I] SIGBUS Error on Airflow 2.9.1 with JDBC Connection to Hive on macOS with Apple M3 Pro [airflow]

2024-06-05 Thread via GitHub
drprolegend opened a new issue, #40071: URL: https://github.com/apache/airflow/issues/40071 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? **Description:** I encountered a fatal

Re: [I] Support `limit` and `offset` parameters for List task instances (batch) endpoint [airflow]

2024-06-05 Thread via GitHub
rawwar commented on issue #40038: URL: https://github.com/apache/airflow/issues/40038#issuecomment-2150486604 @shahar1 , [Documentation](https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/get_task_instances_batch) does not mention about `page_offset`

Re: [PR] add git-sync-ssh secret template [airflow]

2024-06-05 Thread via GitHub
romsharon98 commented on code in PR #39936: URL: https://github.com/apache/airflow/pull/39936#discussion_r1628030751 ## helm_tests/other/test_git_sync_scheduler.py: ## @@ -211,6 +211,45 @@ def test_validate_if_ssh_params_are_added(self): "secret": {"secretName":

Re: [PR] Avoid resetting adopted task instances when retrying for kubernetes executor [airflow]

2024-06-05 Thread via GitHub
eladkal commented on PR #39406: URL: https://github.com/apache/airflow/pull/39406#issuecomment-2150403242 @tanvn is it possiblw to cover this fix with unit tests to avoid regression? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[I] download log - Try number 0 is invalid [airflow]

2024-06-05 Thread via GitHub
raphaelauv opened a new issue, #40070: URL: https://github.com/apache/airflow/issues/40070 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? I can see the logs if I click on the task

Re: [PR] add git-sync-ssh secret template [airflow]

2024-06-05 Thread via GitHub
romsharon98 commented on code in PR #39936: URL: https://github.com/apache/airflow/pull/39936#discussion_r1628019783 ## chart/templates/secrets/git-ssh-key-secret.yaml: ## @@ -0,0 +1,34 @@ +{{/* + Licensed to the Apache Software Foundation (ASF) under one + or more contributor

Re: [PR] Chart Postgres:15.4.1 and airflow default version description: 2.9.1 update [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on code in PR #39879: URL: https://github.com/apache/airflow/pull/39879#discussion_r1628011777 ## chart/Chart.yaml: ## @@ -76,8 +76,8 @@ annotations: links: - name: '#37197' url: https://github.com/apache/airflow/pull/37197 --

Re: [PR] add git-sync-ssh secret template [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on code in PR #39936: URL: https://github.com/apache/airflow/pull/39936#discussion_r1627985449 ## chart/values.schema.json: ## @@ -7409,6 +7409,14 @@ ], "default": null },

[PR] Support checking for db path absoluteness on Windows [airflow]

2024-06-05 Thread via GitHub
Dev-iL opened a new pull request, #40069: URL: https://github.com/apache/airflow/pull/40069 --- Airflow isn't supported on Windows at the moment. However, various components of Airflow work perfectly fine when given the chance. I have a use case where I'm

Re: [PR] google: move bigquery openlineage imports inside methods [airflow]

2024-06-05 Thread via GitHub
ahidalgob commented on PR #40062: URL: https://github.com/apache/airflow/pull/40062#issuecomment-2150322121 sounds good to me, I will make the changes in this PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

(airflow) branch main updated (9bcf665570 -> ac2a1ef81d)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9bcf665570 Fix typos in overview.rst (#40061) add ac2a1ef81d Expllicitly skip API tests for compatiblity

Re: [PR] Expllicitly skip FAB tests for compatiblity tests on 2.7 and 2.8 [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #40059: URL: https://github.com/apache/airflow/pull/40059 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Expllicitly skip FAB tests for compatiblity tests on 2.7 and 2.8 [airflow]

2024-06-05 Thread via GitHub
jedcunningham commented on PR #40059: URL: https://github.com/apache/airflow/pull/40059#issuecomment-2150321967 Thanks Jarek! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow) branch main updated: Fix typos in overview.rst (#40061)

2024-06-05 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9bcf665570 Fix typos in overview.rst

Re: [PR] Fix typo in overview.rst [airflow]

2024-06-05 Thread via GitHub
jedcunningham merged PR #40061: URL: https://github.com/apache/airflow/pull/40061 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch v2-9-test updated (a55999854f -> 600da55c68)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit a55999854f Upgrade to FAB 4.5.0 (#39851) omit edc3a9d87a Fix mocking in kerberos integration test

Re: [I] Task is not able to be run - k8s Celery workers with stale resources [airflow]

2024-06-05 Thread via GitHub
keysersoza commented on issue #34013: URL: https://github.com/apache/airflow/issues/34013#issuecomment-2150271955 We could mitigate the issue a bit by setting these configs: ``` celery: task_publish_max_retries: 5 celery_broker_transport_options:

Re: [I] BigQuery task decorated functions failing in Airflow 2.9.1 [airflow]

2024-06-05 Thread via GitHub
florian-guily commented on issue #39541: URL: https://github.com/apache/airflow/issues/39541#issuecomment-2150181381 Oh i thought constraints were the recommended way to always install airflow. I forced the installation of the google-cloud-bigquery package in 3.20.1 without constraints as

Re: [PR] CI: Introduce cross-provider backwards-compatiblity tests. [airflow]

2024-06-05 Thread via GitHub
JDarDagran commented on PR #40053: URL: https://github.com/apache/airflow/pull/40053#issuecomment-2150155078 @potiuk seems like the general idea works. However, the fully automated way runs heavy tests for google/amazon multiple times. I wonder if there's a way to mark cross-provider tests

Re: [I] Subsequent Dag Run mapped task not scheduled due to removed mapped task in previous Dag Run [airflow]

2024-06-05 Thread via GitHub
nathadfield commented on issue #37154: URL: https://github.com/apache/airflow/issues/37154#issuecomment-2150129041 @JosephABC Thanks for this but I am still not able to replicate the behaviour you have documented based on the current Airflow version. Are you able to install a newer

(airflow) branch v2-9-test updated (e17fc0f674 -> a55999854f)

2024-06-05 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard e17fc0f674 Upgrade to FAB 4.5.0 (#39851) discard 50519b6377 Fix mocking in kerberos integration test

Re: [I] BigQuery task decorated functions failing in Airflow 2.9.1 [airflow]

2024-06-05 Thread via GitHub
potiuk commented on issue #39541: URL: https://github.com/apache/airflow/issues/39541#issuecomment-2150101704 > Could you also update the constraint file ? Constraints are updated only when they prevent things from being build. We never update constraints with new providers - they

Re: [PR] Fix dag task scheduled and queued duration metrics [airflow]

2024-06-05 Thread via GitHub
htpawel commented on PR #37936: URL: https://github.com/apache/airflow/pull/37936#issuecomment-2150075639 @eladkal @ferruzzi done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] fix typo and path to licences folder [airflow]

2024-06-05 Thread via GitHub
uzhastik opened a new pull request, #40067: URL: https://github.com/apache/airflow/pull/40067 --- **^ Add meaningful description above** Read the **[Pull Request

(airflow) branch v2-9-test updated (4dbe14d765 -> e17fc0f674)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git omit 4dbe14d765 Upgrade to FAB 4.5.0 (#39851) omit e7bc6005dc Fix mocking in kerberos integration test

Re: [PR] google: move bigquery openlineage imports inside methods [airflow]

2024-06-05 Thread via GitHub
JDarDagran commented on PR #40062: URL: https://github.com/apache/airflow/pull/40062#issuecomment-2149953301 How about having mixin only in, let's say, `airflow/providers/google/cloud/openlineage/mixins.py`, in which all imports are local? I can attempt to fix it in another PR or leave

(airflow) branch v2-9-test updated (a98a8593e7 -> 4dbe14d765)

2024-06-05 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard a98a8593e7 Upgrade to FAB 4.5.0 (#39851) discard 4ac1f50d32 Fix mocking in kerberos integration test

[I] Add support for SqlAlchemy statement in the SqlExecuteQueryOperator [airflow]

2024-06-05 Thread via GitHub
AlexisBRENON opened a new issue, #40066: URL: https://github.com/apache/airflow/issues/40066 ### Description Allow to pass a (list of) SqlAlchemy statement in addition to `str` to the `sql` parameter of the `SQLExecuteQueryOperator`. ### Use case/motivation I need to

Re: [I] Status of testing Providers that were prepared on May 26, 2024 [airflow]

2024-06-05 Thread via GitHub
danielbe11 commented on issue #39842: URL: https://github.com/apache/airflow/issues/39842#issuecomment-2149850220 I see it's closed, but all good with me too. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] BigQuery task decorated functions failing in Airflow 2.9.1 [airflow]

2024-06-05 Thread via GitHub
florian-guily commented on issue #39541: URL: https://github.com/apache/airflow/issues/39541#issuecomment-2149820003 Could you also update the constraint file ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

  1   2   >