Re: [I] webserver - acces task log | TypeError: '<' not supported between instances of 'Interval' and 'DateTime' [airflow]

2024-06-04 Thread via GitHub
raphaelauv commented on issue #39306: URL: https://github.com/apache/airflow/issues/39306#issuecomment-2148987904 no stale -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Include fatal reason for pod pending events [airflow]

2024-06-04 Thread via GitHub
romsharon98 commented on PR #39924: URL: https://github.com/apache/airflow/pull/39924#issuecomment-2148987775 Can we enter the elif and not print any log,therefore pass the else and still not print any log? -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] Expllicitly skip API tests for compatiblity tests on 2.7 and 2.8 [airflow]

2024-06-04 Thread via GitHub
potiuk commented on PR #40059: URL: https://github.com/apache/airflow/pull/40059#issuecomment-2148979944 should fix https://github.com/apache/airflow/actions/runs/9368174204/job/25789767854?pr=40028 -- This is an automated message from the Apache Git Service. To respond to the message, pl

[PR] Expllicitly skip API tests for compatiblity tests on 2.7 and 2.8 [airflow]

2024-06-04 Thread via GitHub
potiuk opened a new pull request, #40059: URL: https://github.com/apache/airflow/pull/40059 The API tests are generally excluded when backwards compatibility tests for 2.7 and 2.8 are run, however in some situation when selective checks determine that API tests should be run as well (for ex

[PR] add PID and return code to _execute_in_fork logging [airflow]

2024-06-04 Thread via GitHub
Lee-W opened a new pull request, #40058: URL: https://github.com/apache/airflow/pull/40058 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.

Re: [PR] Fix Pod Number Exception in the sync mode if reattach_on_restart parameter is False [airflow]

2024-06-04 Thread via GitHub
eladkal merged PR #39329: URL: https://github.com/apache/airflow/pull/39329 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (06a200d5fa -> 0f6e31f4b9)

2024-06-04 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 06a200d5fa Bump boto min versions (#40052) add 0f6e31f4b9 Fix reattach_on_restart parameter for the sync mode (#3

[PR] Prepare docs 1st wave June 2024 [airflow]

2024-06-04 Thread via GitHub
eladkal opened a new pull request, #40057: URL: https://github.com/apache/airflow/pull/40057 This is ad hoc wave as we needed RC2 for Amazon I also added celery and cncf.kubernetes as they have important fixes that I hope we will have enough time to include in Airflow 2.9.2 constraints

Re: [I] Airflow + CockroachDB throws DDL issues. [airflow]

2024-06-04 Thread via GitHub
saolof commented on issue #14438: URL: https://github.com/apache/airflow/issues/14438#issuecomment-2148852377 On cockroachdb as an airflow backend, it may be worth mentioning that CRDB is a lot easier to host and comes with a lot more observability out of the box, which is a valid reason to

(airflow) branch main updated: Bump boto min versions (#40052)

2024-06-04 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 06a200d5fa Bump boto min versions (#40052) 06a200d5

Re: [PR] Bump boto min versions [airflow]

2024-06-04 Thread via GitHub
potiuk merged PR #40052: URL: https://github.com/apache/airflow/pull/40052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] `__extra__` being passed to SQLalchemy engine url erroneously [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on issue #40056: URL: https://github.com/apache/airflow/issues/40056#issuecomment-2148785622 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] `__extra__` being passed to SQLalchemy engine url erroneously [airflow]

2024-06-04 Thread via GitHub
MialLewis opened a new issue, #40056: URL: https://github.com/apache/airflow/issues/40056 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.9.0 ### What happened? When using an a

Re: [I] job table missing `dag_id` and `executor_class` for BackfillJob type [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on issue #40055: URL: https://github.com/apache/airflow/issues/40055#issuecomment-2148780275 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] job table missing `dag_id` and `executor_class` for BackfillJob type [airflow]

2024-06-04 Thread via GitHub
Jie211 opened a new issue, #40055: URL: https://github.com/apache/airflow/issues/40055 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? When using the `airflow dags backfill` command to e

Re: [PR] Catch TypeError instead of AttributeError for change_state wrapper [airflow]

2024-06-04 Thread via GitHub
leakec commented on PR #40035: URL: https://github.com/apache/airflow/pull/40035#issuecomment-2148746618 @o-nikolas I think adding the test case is definitely worth it. Also, would be great to get feedback on whether that exception should be ```python except TypeError: ``` or

Re: [PR] Bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi commented on PR #40052: URL: https://github.com/apache/airflow/pull/40052#issuecomment-2148711698 seems fine locally. bumping the failed test ![image](https://github.com/apache/airflow/assets/1920178/ca714b64-0afe-415d-9002-dc8009b362f4) -- This is an automated message fr

Re: [I] Executor reports task instance (...) finished (failed) although the task says it's queued [airflow]

2024-06-04 Thread via GitHub
Lee-W commented on issue #39717: URL: https://github.com/apache/airflow/issues/39717#issuecomment-2148697763 Hello everyone, I'm currently investigating this issue, but I haven't been able to replicate it yet. Could you please try setting `AIRFLOW__CORE__EXECUTE_TASKS_NEW_PYTHON_INTE

Re: [PR] Bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi commented on PR #40052: URL: https://github.com/apache/airflow/pull/40052#issuecomment-2148695428 I haven't run into trouble on this test yet. Following the docs, I ran it locally in this branch for just the amazon provider and it appears to be passing fine: ![image](https

Re: [PR] Bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi commented on PR #40052: URL: https://github.com/apache/airflow/pull/40052#issuecomment-2148648367 well... it WAS all green. LOL -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] ADD prototype version dark mode for Airflow UI [airflow]

2024-06-04 Thread via GitHub
YounHS commented on code in PR #39355: URL: https://github.com/apache/airflow/pull/39355#discussion_r1626787988 ## airflow/www/templates/appbuilder/navbar.html: ## @@ -50,6 +50,13 @@ {% include 'appbuilder/navbar_menu.html' %} + + +

(airflow) branch main updated: Add `retry_from_failure` parameter to DbtCloudRunJobOperator (#38868)

2024-06-04 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 83c118413c Add `retry_from_failure` parameter to

Re: [PR] Add `retry_from_failure` parameter to DbtCloudRunJobOperator [airflow]

2024-06-04 Thread via GitHub
josh-fell merged PR #38868: URL: https://github.com/apache/airflow/pull/38868 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

Re: [I] dbt Cloud provider to support retry from point of failure [airflow]

2024-06-04 Thread via GitHub
josh-fell closed issue #35772: dbt Cloud provider to support retry from point of failure URL: https://github.com/apache/airflow/issues/35772 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] webserver - acces task log | TypeError: '<' not supported between instances of 'Interval' and 'DateTime' [airflow]

2024-06-04 Thread via GitHub
github-actions[bot] commented on issue #39306: URL: https://github.com/apache/airflow/issues/39306#issuecomment-2148609367 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [PR] Add `retry_from_failure` parameter to DbtCloudRunJobOperator [airflow]

2024-06-04 Thread via GitHub
josh-fell commented on code in PR #38868: URL: https://github.com/apache/airflow/pull/38868#discussion_r1626765360 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -439,6 +443,24 @@ def trigger_job_run( } payload.update(additional_run_config) +if re

Re: [I] Task is not able to be run - k8s Celery workers with stale resources [airflow]

2024-06-04 Thread via GitHub
keysersoza commented on issue #34013: URL: https://github.com/apache/airflow/issues/34013#issuecomment-2148596956 @potiuk I tried to disable the mini scheduler, but it did not fix the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi closed pull request #40052: Bump boto min versions URL: https://github.com/apache/airflow/pull/40052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Task is not able to be run - k8s Celery workers with stale resources [airflow]

2024-06-04 Thread via GitHub
keysersoza commented on issue #34013: URL: https://github.com/apache/airflow/issues/34013#issuecomment-2148580333 Hi @pavelpi , we are experiencing the same issue: https://github.com/apache/airflow/issues/40054 We could not observe any resource related issue; in our case, tasks go al

[I] Airflow Tasks Failing on Trigger because of: "dependency 'Task Instance State' FAILED: Task is in the 'failed' state." [airflow]

2024-06-04 Thread via GitHub
keysersoza opened a new issue, #40054: URL: https://github.com/apache/airflow/issues/40054 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.5.3 ### What happened? Suddenly tasks

[PR] CI: Introduce cross-provider backwards-compatiblity tests. [airflow]

2024-06-04 Thread via GitHub
JDarDagran opened a new pull request, #40053: URL: https://github.com/apache/airflow/pull/40053 There is no mechanism forcing user to upgrade downstream dependent provider package when upgrading other providers. For each downstream dependent provider it is being downgraded to latest release

Re: [PR] [DO NOT REVIEW] bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi commented on PR #40052: URL: https://github.com/apache/airflow/pull/40052#issuecomment-2148520849 Huh, seems to be passing just fine. I'll open it up for review/approval. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-04 Thread via GitHub
jedcunningham commented on code in PR #40050: URL: https://github.com/apache/airflow/pull/40050#discussion_r1626665175 ## RELEASE_NOTES.rst: ## @@ -21,6 +21,71 @@ .. towncrier release notes start +Airflow 2.9.2 (2024-06-04) +-- + +Significant Changes

Re: [PR] Add `retry_from_failure` parameter to DbtCloudRunJobOperator [airflow]

2024-06-04 Thread via GitHub
boraberke commented on code in PR #38868: URL: https://github.com/apache/airflow/pull/38868#discussion_r1626653075 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -439,6 +443,24 @@ def trigger_job_run( } payload.update(additional_run_config) +if re

(airflow) branch constraints-main updated: Updating constraints. Github run id:9374037353

2024-06-04 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 3bf4e6deeb Updating con

Re: [PR] Fix inital value for _batch_id attribute in livy operator [airflow]

2024-06-04 Thread via GitHub
alizademhdi closed pull request #38628: Fix inital value for _batch_id attribute in livy operator URL: https://github.com/apache/airflow/pull/38628 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
ferruzzi commented on PR #39983: URL: https://github.com/apache/airflow/pull/39983#issuecomment-2148438512 aiobotocore has been out limiting factor for a while, they pin botocore to a pretty old version. A couple weeks ago they released a new version with much newer botocore support. I'm

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
potiuk commented on PR #39983: URL: https://github.com/apache/airflow/pull/39983#issuecomment-2148433161 Yep. That is also okl -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [I] Improve development experience for `breeze k8s` suite of commands [airflow]

2024-06-04 Thread via GitHub
potiuk commented on issue #40005: URL: https://github.com/apache/airflow/issues/40005#issuecomment-2148430502 Cool :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

[PR] [DO NOT REVIEW] bump boto min versions [airflow]

2024-06-04 Thread via GitHub
ferruzzi opened a new pull request, #40052: URL: https://github.com/apache/airflow/pull/40052 aiobotocore's pinned botocore version has restricted us to botocore 1.34.0. aiobotocore released 2.13.0 a couple weeks ago which relaxes their boto restrictions to `botocore>=1.34.70,<1.34.107`.

(airflow) branch main updated: Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` (#39983)

2024-06-04 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 99dd24b436 Doc-only: mention minimum boto3 1.34.5

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
ferruzzi merged PR #39983: URL: https://github.com/apache/airflow/pull/39983 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [PR] Add `retry_from_failure` parameter to DbtCloudRunJobOperator [airflow]

2024-06-04 Thread via GitHub
josh-fell commented on code in PR #38868: URL: https://github.com/apache/airflow/pull/38868#discussion_r1626562408 ## airflow/providers/dbt/cloud/hooks/dbt.py: ## @@ -439,6 +443,24 @@ def trigger_job_run( } payload.update(additional_run_config) +if re

Re: [PR] Add template_field to DataplexGetDataQualityScanResultOperator [airflow]

2024-06-04 Thread via GitHub
josh-fell commented on PR #40041: URL: https://github.com/apache/airflow/pull/40041#issuecomment-2148351992 Congrats @amirmor1! 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [I] DbtCloudRunJobOperator `reuse_existing_run` flag does not work properly [airflow]

2024-06-04 Thread via GitHub
josh-fell closed issue #40047: DbtCloudRunJobOperator `reuse_existing_run` flag does not work properly URL: https://github.com/apache/airflow/issues/40047 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

(airflow) branch main updated: Fix `DbtCloudRunJobOperator` to Use Correct Status Parameters for `reuse_existing_run` (#40048)

2024-06-04 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5d227860ad Fix `DbtCloudRunJobOperator` to Use Co

Re: [PR] Fix `DbtCloudRunJobOperator` to Use Correct Status Parameters for `reuse_existing_run` [airflow]

2024-06-04 Thread via GitHub
josh-fell merged PR #40048: URL: https://github.com/apache/airflow/pull/40048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated: Update dataplex.py (#40041)

2024-06-04 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f6148e6e33 Update dataplex.py (#40041) f6148e6e33

Re: [PR] Add template_field to DataplexGetDataQualityScanResultOperator [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on PR #40041: URL: https://github.com/apache/airflow/pull/40041#issuecomment-2148348710 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [PR] Add template_field to DataplexGetDataQualityScanResultOperator [airflow]

2024-06-04 Thread via GitHub
josh-fell merged PR #40041: URL: https://github.com/apache/airflow/pull/40041 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

Re: [PR] Catch TypeError instead of AttributeError for change_state wrapper [airflow]

2024-06-04 Thread via GitHub
o-nikolas commented on PR #40035: URL: https://github.com/apache/airflow/pull/40035#issuecomment-2148345956 > @o-nikolas I'm very unfamiliar with the airflow test case suite (I'm new to airflow in general), so I doubt I'll get much further in terms of writing a test without a significant ti

Re: [PR] Catch TypeError instead of AttributeError for change_state wrapper [airflow]

2024-06-04 Thread via GitHub
o-nikolas commented on code in PR #40035: URL: https://github.com/apache/airflow/pull/40035#discussion_r1626552769 ## tests/integration/executors/test_celery_executor.py: ## @@ -107,6 +110,26 @@ def teardown_method(self) -> None: db.clear_db_runs() db.clear_db_

Re: [I] Improve development experience for `breeze k8s` suite of commands [airflow]

2024-06-04 Thread via GitHub
shahar1 commented on issue #40005: URL: https://github.com/apache/airflow/issues/40005#issuecomment-2148187420 Assigning myself, it seems like an area that I'd like to experience :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [I] Support `limit` and `offset` parameters for List task instances (batch) endpoint [airflow]

2024-06-04 Thread via GitHub
shahar1 commented on issue #40038: URL: https://github.com/apache/airflow/issues/40038#issuecomment-2148161634 There are `page_offset` and `page_limit` params, don't they satisfy your requirements? -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [PR] Fix aws assume role session creation when deferrable [airflow]

2024-06-04 Thread via GitHub
gopidesupavan commented on PR #40051: URL: https://github.com/apache/airflow/pull/40051#issuecomment-2148158871 cc: @Taragolis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[PR] Fix aws assume role session creation when deferrable [airflow]

2024-06-04 Thread via GitHub
gopidesupavan opened a new pull request, #40051: URL: https://github.com/apache/airflow/pull/40051 Updated `_create_session_with_assume_role` to return aiobotocore.session.AioSession if session requested with deferrable=True Tested with example: aws_assume_role_connection =

Re: [PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-04 Thread via GitHub
utkarsharma2 commented on PR #40049: URL: https://github.com/apache/airflow/pull/40049#issuecomment-2148101466 Closing in favor of https://github.com/apache/airflow/pull/40050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-04 Thread via GitHub
utkarsharma2 opened a new pull request, #40050: URL: https://github.com/apache/airflow/pull/40050 Time for 2.9.2rc2! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

(airflow) branch main updated: Resolve pagerduty deprecations in tests (#39945)

2024-06-04 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 21dae6ee39 Resolve pagerduty deprecations in test

Re: [PR] Resolve pagerduty deprecations in tests [airflow]

2024-06-04 Thread via GitHub
vincbeck merged PR #39945: URL: https://github.com/apache/airflow/pull/39945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-04 Thread via GitHub
utkarsharma2 closed pull request #40049: Sync v2-9-stable with v2-9-test to release 2.9.2 URL: https://github.com/apache/airflow/pull/40049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-04 Thread via GitHub
utkarsharma2 opened a new pull request, #40049: URL: https://github.com/apache/airflow/pull/40049 Time for 2.9.2rc2! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

(airflow) branch main updated: Adding Glue Data Quality Rule Recommendation Run (#40014)

2024-06-04 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ea682382bc Adding Glue Data Quality Rule Recommen

Re: [PR] Adding Glue Data Quality Rule Recommendation Run [airflow]

2024-06-04 Thread via GitHub
vincbeck merged PR #40014: URL: https://github.com/apache/airflow/pull/40014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) 01/02: Update version to 2.9.2

2024-06-04 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 411bc25df74293fc902fcc5e3dda3252556e72f9 Author: utkarsh sharma AuthorDate: Tue Jun 4 23:10:08 2024 +0530

(airflow) branch v2-9-test updated (833d7bf2f2 -> e8ecb529b2)

2024-06-04 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard 833d7bf2f2 Update RELEASE_NOTES.rst discard 01249e80b0 Update version to new 411bc25df7 Update version

(airflow) 02/02: Update RELEASE_NOTES.rst

2024-06-04 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e8ecb529b2a7c6556d51e15bef0d802a97ffb21c Author: utkarsh sharma AuthorDate: Tue Jun 4 23:13:44 2024 +0530

Re: [PR] AIP-61 - Add executor field to the task instance API [airflow]

2024-06-04 Thread via GitHub
vincbeck commented on code in PR #40034: URL: https://github.com/apache/airflow/pull/40034#discussion_r1626395283 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -3751,6 +3753,13 @@ components: pid: type: integer nullable: true +executor: +

Re: [PR] AIP-61 - Add executor field to the task instance API [airflow]

2024-06-04 Thread via GitHub
vincbeck commented on code in PR #40034: URL: https://github.com/apache/airflow/pull/40034#discussion_r1626395283 ## airflow/api_connexion/openapi/v1.yaml: ## @@ -3751,6 +3753,13 @@ components: pid: type: integer nullable: true +executor: +

(airflow) branch main updated: Update index.rst (#40040)

2024-06-04 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 32cf8cf37d Update index.rst (#40040) 32cf8cf37d i

Re: [PR] Fix grammar in index.rst [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on PR #40040: URL: https://github.com/apache/airflow/pull/40040#issuecomment-2148070523 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [PR] Fix grammar in index.rst [airflow]

2024-06-04 Thread via GitHub
vincbeck merged PR #40040: URL: https://github.com/apache/airflow/pull/40040 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

[PR] Fix `DbtCloudRunJobOperator` to Use Correct Status Parameters for `reuse_existing_run` [airflow]

2024-06-04 Thread via GitHub
boraberke opened a new pull request, #40048: URL: https://github.com/apache/airflow/pull/40048 Closes: https://github.com/apache/airflow/issues/40047 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache

Re: [I] EcsRunTaskOperator does not send logs if task times out [airflow]

2024-06-04 Thread via GitHub
vincbeck commented on issue #39026: URL: https://github.com/apache/airflow/issues/39026#issuecomment-2148062059 I am using Breeze so I guess I have the default configuration. But it should not even matter because I am looking at logs inside the log group I specified through the `awslogs_gro

(airflow) branch v2-9-test updated: Update RELEASE_NOTES.rst

2024-06-04 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-9-test by this push: new 833d7bf2f2 Update RELEASE_NOTES.rst

Re: [I] DbtCloudRunJobOperator `reuse_existing_run` flag does not work properly [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on issue #40047: URL: https://github.com/apache/airflow/issues/40047#issuecomment-2148057301 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] DbtCloudRunJobOperator `reuse_existing_run` flag does not work properly [airflow]

2024-06-04 Thread via GitHub
boraberke opened a new issue, #40047: URL: https://github.com/apache/airflow/issues/40047 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? When `reuse_existing_run` is set to `True` in `D

(airflow) branch v2-9-test updated: Update version to

2024-06-04 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-9-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-9-test by this push: new 01249e80b0 Update version to 01249e8

(airflow) branch main updated (914bccc387 -> 1ec3b39f28)

2024-06-04 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 914bccc387 Improve trigger UI for string array format validation (#39993) add 1ec3b39f28 Resolve www views depr

Re: [PR] Resolve www views deprecations in tests [airflow]

2024-06-04 Thread via GitHub
vincbeck merged PR #40009: URL: https://github.com/apache/airflow/pull/40009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch openlineage-process-execution created (now 449dd3c671)

2024-06-04 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git at 449dd3c671 openlineage: execute extraction and message sending in separate process This

(airflow) 01/01: openlineage: execute extraction and message sending in separate process

2024-06-04 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git commit 449dd3c6719781527c2e0a551a512bad7aa5a05d Author: Maciej Obuchowski AuthorDate: Fri May 31 1

Re: [PR] Format DAG run count [airflow]

2024-06-04 Thread via GitHub
bbovenzi commented on PR #39684: URL: https://github.com/apache/airflow/pull/39684#issuecomment-2148017759 After @jscheffl's suggestions then I think this is good. Ultimately, I don't know if total run state count is all that useful on the homepage. But that's a question for when we r

(airflow) branch main updated: Improve trigger UI for string array format validation (#39993)

2024-06-04 Thread jscheffl
This is an automated email from the ASF dual-hosted git repository. jscheffl pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 914bccc387 Improve trigger UI for string array fo

Re: [PR] Improve trigger UI for string array format validation [airflow]

2024-06-04 Thread via GitHub
boring-cyborg[bot] commented on PR #39993: URL: https://github.com/apache/airflow/pull/39993#issuecomment-2148008923 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [I] Param schema `array` type does does not work with `items` element [airflow]

2024-06-04 Thread via GitHub
jscheffl closed issue #39972: Param schema `array` type does does not work with `items` element URL: https://github.com/apache/airflow/issues/39972 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Improve trigger UI for string array format validation [airflow]

2024-06-04 Thread via GitHub
jscheffl merged PR #39993: URL: https://github.com/apache/airflow/pull/39993 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [PR] Set PR #39638 for Airflow 2.10 [airflow]

2024-06-04 Thread via GitHub
pankajkoti commented on code in PR #40044: URL: https://github.com/apache/airflow/pull/40044#discussion_r1626338026 ## airflow/utils/db.py: ## @@ -117,7 +117,7 @@ class MappedClassProtocol(Protocol): "2.8.0": "10b52ebd31f7", "2.8.1": "88344c1d9134", "2.9.0": "1949

Re: [PR] local task job: add timeout, to not kill on_task_instance_success listener by heartbeat_callback [airflow]

2024-06-04 Thread via GitHub
mobuchowski commented on code in PR #39890: URL: https://github.com/apache/airflow/pull/39890#discussion_r1626332859 ## airflow/jobs/local_task_job_runner.py: ## @@ -303,6 +306,14 @@ def heartbeat_callback(self, session: Session = NEW_SESSION) -> None: if dagru

(airflow) branch listener-task-timeout updated (430c4fa120 -> e2acd51121)

2024-06-04 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch listener-task-timeout in repository https://gitbox.apache.org/repos/asf/airflow.git discard 430c4fa120 local task job: add timeout, to not kill on_task_instance_success listener prematurel

Re: [PR] Remove RAW HTML support from Trigger Form UI [airflow]

2024-06-04 Thread via GitHub
jscheffl closed pull request #40029: Remove RAW HTML support from Trigger Form UI URL: https://github.com/apache/airflow/pull/40029 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] Remove RAW HTML support from Trigger Form UI [airflow]

2024-06-04 Thread via GitHub
jscheffl commented on PR #40029: URL: https://github.com/apache/airflow/pull/40029#issuecomment-2147986169 Okay, then I'll try to keep this PR in memory until we have an AF3 branch to clean-up -- This is an automated message from the Apache Git Service. To respond to the message, please l

(airflow) branch listener-task-timeout updated (32e46dde86 -> 430c4fa120)

2024-06-04 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch listener-task-timeout in repository https://gitbox.apache.org/repos/asf/airflow.git discard 32e46dde86 local task job: add timeout, to not kill on_task_instance_success listener prematurel

Re: [PR] Set PR #39638 for Airflow 2.10 [airflow]

2024-06-04 Thread via GitHub
hussein-awala commented on code in PR #40044: URL: https://github.com/apache/airflow/pull/40044#discussion_r1626304981 ## airflow/utils/db.py: ## @@ -117,7 +117,7 @@ class MappedClassProtocol(Protocol): "2.8.0": "10b52ebd31f7", "2.8.1": "88344c1d9134", "2.9.0": "1

Re: [PR] AIP-61 - Scheduler job: main loop and event processing for multi executors [airflow]

2024-06-04 Thread via GitHub
o-nikolas commented on PR #40017: URL: https://github.com/apache/airflow/pull/40017#issuecomment-2147935088 > Do we still need `slots_available` after this? We should remove or deprecate it if not. Nope! We still use this field in places, even after these changes. So no need to depre

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
yehoshuadimarsky commented on code in PR #39983: URL: https://github.com/apache/airflow/pull/39983#discussion_r1626278154 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -323,6 +330,17 @@ def submit_job(self, context: Context): try: response = s

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
yehoshuadimarsky commented on code in PR #39983: URL: https://github.com/apache/airflow/pull/39983#discussion_r1626272094 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -323,6 +330,17 @@ def submit_job(self, context: Context): try: response = s

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
yehoshuadimarsky commented on code in PR #39983: URL: https://github.com/apache/airflow/pull/39983#discussion_r1626270666 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -323,6 +330,17 @@ def submit_job(self, context: Context): try: response = s

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
eladkal commented on code in PR #39983: URL: https://github.com/apache/airflow/pull/39983#discussion_r1626268822 ## airflow/providers/amazon/aws/operators/batch.py: ## @@ -323,6 +330,17 @@ def submit_job(self, context: Context): try: response = self.hook.

Re: [PR] Doc-only: mention minimum boto3 1.34.52 for AWS provider when using Batch `ecs_properties_override` [airflow]

2024-06-04 Thread via GitHub
yehoshuadimarsky commented on PR #39983: URL: https://github.com/apache/airflow/pull/39983#issuecomment-2147888672 Following an offline conversation with @o-nikolas and @eladkal, decided to follow an approach similar to [the Operator in AWS Bedrock](https://github.com/aws-mwaa/upstream-to-a

  1   2   3   >