[GitHub] [airflow] MrGeorgeOwl commented on a diff in pull request #27776: Add deferrable mode to dataflow operators

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on code in PR #27776: URL: https://github.com/apache/airflow/pull/27776#discussion_r1083733347 ## airflow/providers/google/cloud/hooks/dataflow.py: ## @@ -1037,7 +1050,7 @@ def start_sql_job( def get_job( self, job_id: str, -p

[GitHub] [airflow] MrGeorgeOwl commented on a diff in pull request #27776: Add deferrable mode to dataflow operators

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on code in PR #27776: URL: https://github.com/apache/airflow/pull/27776#discussion_r1083736807 ## airflow/providers/google/cloud/links/dataflow.py: ## @@ -48,5 +48,5 @@ def persist( operator_instance.xcom_push( context, ke

[GitHub] [airflow] snjypl commented on pull request #28394: Fix manual task trigger failing for k8s.

2023-01-23 Thread via GitHub
snjypl commented on PR #28394: URL: https://github.com/apache/airflow/pull/28394#issuecomment-1399944689 > I thikn we need a ot more context in commit - what hapens here. i have added a more descriptive commit message. -- This is an automated message from the Apache Git Service. To

[GitHub] [airflow] tanelk commented on a diff in pull request #29094: Add `max_active_tis_per_dagrun` for Dynamic Task Mapping

2023-01-23 Thread via GitHub
tanelk commented on code in PR #29094: URL: https://github.com/apache/airflow/pull/29094#discussion_r1083763018 ## airflow/jobs/scheduler_job.py: ## @@ -480,13 +490,40 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) -

[GitHub] [airflow] tanelk commented on a diff in pull request #29094: Add `max_active_tis_per_dagrun` for Dynamic Task Mapping

2023-01-23 Thread via GitHub
tanelk commented on code in PR #29094: URL: https://github.com/apache/airflow/pull/29094#discussion_r1083766525 ## airflow/jobs/scheduler_job.py: ## @@ -336,7 +344,9 @@ def _executable_task_instances_to_queued(self, max_tis: int, session: Session) - query = que

[GitHub] [airflow] mattinbits commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
mattinbits commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-147539 As someone who has been running Airflow on MSSQL in production for several years, I tend to agree that explicitly removing support would be better. We're planning to move away f

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083793113 ## airflow/config_templates/config.yml: ## @@ -1529,6 +1529,19 @@ webserver: type: boolean example: ~ default: "False" +trigger_dag_url: Review

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083798621 ## airflow/example_dags/example_params_ui_tutorial.py: ## @@ -0,0 +1,234 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor licen

[GitHub] [airflow] ashb commented on a diff in pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
ashb commented on code in PR #29080: URL: https://github.com/apache/airflow/pull/29080#discussion_r1083806540 ## .pre-commit-config.yaml: ## @@ -146,6 +146,13 @@ repos: - --fuzzy-match-generates-todo files: > \.cfg$|\.conf$|\.ini$|\.ldif$|\.proper

[GitHub] [airflow] ephraimbuddy commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
ephraimbuddy commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1083817696 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -119,8 +120,24 @@ git log --oneline --decorate apache/v2-2-stable..apache/main -- docs/apache-airf Those changes that a

[GitHub] [airflow] ashb commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
ashb commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1083797766 ## airflow/example_dags/example_params_ui_tutorial.py: ## @@ -0,0 +1,234 @@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor licen

[GitHub] [airflow] Taragolis commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
Taragolis commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400130898 Non relevant error in the CI to this PR. Looks like internal_api test flaky ```console if not ignore_running: raise AssertionError( >

[GitHub] [airflow] BasPH commented on a diff in pull request #29078: enhance production guide with a few Argo specific guidelines [#20999][#28637]

2023-01-23 Thread via GitHub
BasPH commented on code in PR #29078: URL: https://github.com/apache/airflow/pull/29078#discussion_r1083850885 ## docs/helm-chart/index.rst: ## @@ -140,3 +140,18 @@ will not start as the migrations will not be run: This is so these CI/CD services can perform updates without iss

[GitHub] [airflow] ashb merged pull request #29092: Fix warning in migrations about old config.

2023-01-23 Thread via GitHub
ashb merged PR #29092: URL: https://github.com/apache/airflow/pull/29092 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apa

[GitHub] [airflow] shahar1 commented on pull request #27156: Add documentation for BigQuery transfer operators

2023-01-23 Thread via GitHub
shahar1 commented on PR #27156: URL: https://github.com/apache/airflow/pull/27156#issuecomment-1400154592 @eladkal Please assign me -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[airflow] branch main updated (736f2e898a -> 9c3cd3803f)

2023-01-23 Thread ash
This is an automated email from the ASF dual-hosted git repository. ash pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 736f2e898a Fix rendering parameters in PapermillOperator (#28979) add 9c3cd3803f Fix warning in migrations about old

[GitHub] [airflow] potiuk merged pull request #28795: Migrate Models Variable to Internal API

2023-01-23 Thread via GitHub
potiuk merged PR #28795: URL: https://github.com/apache/airflow/pull/28795 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (9c3cd3803f -> bea49094be)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 9c3cd3803f Fix warning in migrations about old config. (#29092) add bea49094be Migrate Models Variable to Internal

[GitHub] [airflow] potiuk closed issue #28271: AIP-44 Migrate Variable to Internal API

2023-01-23 Thread via GitHub
potiuk closed issue #28271: AIP-44 Migrate Variable to Internal API URL: https://github.com/apache/airflow/issues/28271 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

[GitHub] [airflow] auvipy commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
auvipy commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400183570 I think we can handle that in another PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [airflow] potiuk commented on pull request #29099: Trigger Class migration to internal API

2023-01-23 Thread via GitHub
potiuk commented on PR #29099: URL: https://github.com/apache/airflow/pull/29099#issuecomment-1400195705 And again conflict to resolve (BTW. I think maybe we could split the RPC endpoint to be more modular and less conflict-prone, however this is just a temporary problem of having several p

[GitHub] [airflow] potiuk commented on issue #19627: Providing a metadata secret conflicts with the use of pgbouncer

2023-01-23 Thread via GitHub
potiuk commented on issue #19627: URL: https://github.com/apache/airflow/issues/19627#issuecomment-1400209990 Please do. Assigned you :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [airflow] MattiaGallegati commented on issue #16163: Confusing log for long running tasks: "dependency 'Task Instance Not Running' FAILED: Task is in the running state"

2023-01-23 Thread via GitHub
MattiaGallegati commented on issue #16163: URL: https://github.com/apache/airflow/issues/16163#issuecomment-1400214542 In order to help I noticed a similar behaviour in 2.5.0 (with celery, redis, postgres, default configs). I also found related issues to ipothetically close on completion

[airflow] branch main updated (8805f37a7f -> 129f0820cd)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 8805f37a7f Update Airflow version to 2.5.1 (#29074) add 129f0820cd Make static checks generated file more stable

[GitHub] [airflow] potiuk commented on a diff in pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29080: URL: https://github.com/apache/airflow/pull/29080#discussion_r1083960155 ## .pre-commit-config.yaml: ## @@ -146,6 +146,13 @@ repos: - --fuzzy-match-generates-todo files: > \.cfg$|\.conf$|\.ini$|\.ldif$|\.prop

[GitHub] [airflow] potiuk merged pull request #29080: Make static checks generated file more stable across the board

2023-01-23 Thread via GitHub
potiuk merged PR #29080: URL: https://github.com/apache/airflow/pull/29080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (bea49094be -> 8805f37a7f)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from bea49094be Migrate Models Variable to Internal API (#28795) add 8805f37a7f Update Airflow version to 2.5.1 (#29074

[GitHub] [airflow] MrGeorgeOwl commented on pull request #25466: Auto ML assets

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on PR #25466: URL: https://github.com/apache/airflow/pull/25466#issuecomment-1400125528 @potiuk I think that PR can be merged. I can't do that because I am not the author of PR and I don't have write access -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] kaxil merged pull request #29014: Add deferrable mode to `DbtCloudRunJobOperator`

2023-01-23 Thread via GitHub
kaxil merged PR #29014: URL: https://github.com/apache/airflow/pull/29014 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

[GitHub] [airflow] potiuk merged pull request #29074: Update Airflow version to 2.5.1

2023-01-23 Thread via GitHub
potiuk merged PR #29074: URL: https://github.com/apache/airflow/pull/29074 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated: Add deferrable mode to `DbtCloudRunJobOperator` (#29014)

2023-01-23 Thread kaxilnaik
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 55049c50d5 Add deferrable mode to `DbtCloudRunJo

[GitHub] [airflow] Taragolis commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
Taragolis commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400225586 > I think we can handle that in another PR? It definitely for another PR and related only to AIP-44, this flaky error also appear in `pytest` 6 yesterday. -- This is an autom

[GitHub] [airflow] Taragolis commented on pull request #29087: Unquarantine receive SIGTERM on Task Runner test (second attempt)

2023-01-23 Thread via GitHub
Taragolis commented on PR #29087: URL: https://github.com/apache/airflow/pull/29087#issuecomment-1400282901 Rebase again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29102: URL: https://github.com/apache/airflow/issues/29102#issuecomment-1400275979 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] ephraimbuddy commented on pull request #27829: Improving the release process

2023-01-23 Thread via GitHub
ephraimbuddy commented on PR #27829: URL: https://github.com/apache/airflow/pull/27829#issuecomment-1400284160 Previously, some of the commands used to check out branches were being executed in the CI. However, because this change was not in the checked-out branch, the codes could not be fo

[GitHub] [airflow] mattinbits commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
mattinbits commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400287367 > > @potiuk As an initial fix for our internal system, I replaced `func.now()` with `func.GETDATE()` in an internal fork which is enough to fix it for SQL Server. This is not en

[GitHub] [airflow] anneadb opened a new issue, #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread via GitHub
anneadb opened a new issue, #29102: URL: https://github.com/apache/airflow/issues/29102 ### Apache Airflow version 2.5.1 ### What happened I am using dynamic task mapping to process a list of files in the same way. The tasks are generated but I cannot see them listed i

[GitHub] [airflow] schwartzpub commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
schwartzpub commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400295104 > As someone who has been running Airflow on MSSQL in production for several years, I tend to agree that explicitly removing support would be better. We're plan

[airflow] branch main updated: Prepare ad hoc provider release for Docker, Cassandra, Papermill (#28999)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new dd6cef7889 Prepare ad hoc provider release for Doc

[GitHub] [airflow] Taragolis commented on issue #21171: Airflow schedules tasks in wrong timezone with an MSSQL Metadata DB on a non-UTC server

2023-01-23 Thread via GitHub
Taragolis commented on issue #21171: URL: https://github.com/apache/airflow/issues/21171#issuecomment-1400302771 Yep seems like inconsistent between [README.md](https://github.com/apache/airflow#requirements) and [Documentation](https://airflow.apache.org/docs/apache-airflow/stable/howto/se

svn commit: r59539 - /dev/airflow/providers/

2023-01-23 Thread eladkal
Author: eladkal Date: Mon Jan 23 13:00:01 2023 New Revision: 59539 Log: Add artifacts for Airflow Providers 2023-01-23 Added: dev/airflow/providers/apache-airflow-providers-apache-cassandra-3.1.1.tar.gz (with props) dev/airflow/providers/apache-airflow-providers-apache-cassandra-3.1.

[airflow] annotated tag providers-papermill/3.1.1rc1 updated (dd6cef7889 -> e5a2bc0b13)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-papermill/3.1.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-papermill/3.1.1rc1 was modified! *** from dd6cef7889 (commit)

[airflow] annotated tag providers-docker/3.5.0rc1 updated (dd6cef7889 -> 8f9d3b9984)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-docker/3.5.0rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-docker/3.5.0rc1 was modified! *** from dd6cef7889 (commit) to

[airflow] annotated tag providers-apache-cassandra/3.1.1rc1 updated (dd6cef7889 -> ab84fb8d4c)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-apache-cassandra/3.1.1rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-apache-cassandra/3.1.1rc1 was modified! *** from dd6cef78

[GitHub] [airflow] eladkal merged pull request #28999: Prepare ad hoc provider release for Docker, Cassandra, Papermill

2023-01-23 Thread via GitHub
eladkal merged PR #28999: URL: https://github.com/apache/airflow/pull/28999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[airflow-site] branch add-documentation-2023-01-23 created (now 7a8706e300)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-01-23 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 7a8706e300 Add documentation for packages - 2023-01-23 This branch includes the followin

[GitHub] [airflow-site] eladkal closed pull request #727: Add documentation for packages - 2023-01-23

2023-01-23 Thread via GitHub
eladkal closed pull request #727: Add documentation for packages - 2023-01-23 URL: https://github.com/apache/airflow-site/pull/727 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[airflow-site] branch add-documentation-2023-01-23 created (now f6b01e2405)

2023-01-23 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2023-01-23 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at f6b01e2405 Add documentation for packages - 2023-01-23 This branch includes the followin

[GitHub] [airflow] auvipy commented on pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2023-01-23 Thread via GitHub
auvipy commented on PR #8545: URL: https://github.com/apache/airflow/pull/8545#issuecomment-1400340680 to take it over where should some one focus? fixing conflicts first? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

[GitHub] [airflow] eladkal opened a new issue, #29103: Status of testing Providers that were prepared on January 23, 2023

2023-01-23 Thread via GitHub
eladkal opened a new issue, #29103: URL: https://github.com/apache/airflow/issues/29103 ### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? Let us know in the

[GitHub] [airflow] schwartzpub opened a new pull request, #29104: Update set-up-database.rst

2023-01-23 Thread via GitHub
schwartzpub opened a new pull request, #29104: URL: https://github.com/apache/airflow/pull/29104 Add experimental notation to MSSQL to be consistent with previous documentation. --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29104: Update set-up-database.rst

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on PR #29104: URL: https://github.com/apache/airflow/pull/29104#issuecomment-1400425389 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] eladkal commented on issue #26424: `POST /taskInstances/list` with wildcards returns unhelpful error

2023-01-23 Thread via GitHub
eladkal commented on issue #26424: URL: https://github.com/apache/airflow/issues/26424#issuecomment-1400453634 @maheshsv are you still working on this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [airflow] talnagar opened a new issue, #29105: graph disappears when using branch_task and a dynamic classic operator

2023-01-23 Thread via GitHub
talnagar opened a new issue, #29105: URL: https://github.com/apache/airflow/issues/29105 ### Apache Airflow version 2.5.1 ### What happened when using a dynamically generated task after a branch_task the graph doesn't render. tried with BashOperator and a KubernetesPodOp

[GitHub] [airflow] Taragolis commented on pull request #29035: Renaming nose compatible methods in flavour of regular pytest naming

2023-01-23 Thread via GitHub
Taragolis commented on PR #29035: URL: https://github.com/apache/airflow/pull/29035#issuecomment-1400499360 > Ah - isn't that the "airflow.jobs.backfill_job.BackfillJob" generated log ? Yeah, it is `distributed.client:client.py` logger create this message ```console ERROR

[GitHub] [airflow] Taragolis commented on issue #29103: Status of testing Providers that were prepared on January 23, 2023

2023-01-23 Thread via GitHub
Taragolis commented on issue #29103: URL: https://github.com/apache/airflow/issues/29103#issuecomment-1400502773 @TPapajCin @marvinfretly @nicnguyen3103 could you also have a look PapermillOperator? ```pip install apache-airflow-providers-papermill==3.1.1rc1``` -- This is an automated

[GitHub] [airflow] bbovenzi commented on issue #29100: Unnecessary scrollbars in grid view

2023-01-23 Thread via GitHub
bbovenzi commented on issue #29100: URL: https://github.com/apache/airflow/issues/29100#issuecomment-1400508370 I've been back and forth on the best scrolling solution for the grid view because the right or left side could be significantly longer than the other. This was most notable with l

[GitHub] [airflow] raphaelauv opened a new pull request, #29106: [FIX] README K8S support 2.5.1

2023-01-23 Thread via GitHub
raphaelauv opened a new pull request, #29106: URL: https://github.com/apache/airflow/pull/29106 https://github.com/apache/airflow/pull/29074 did not updated the K8S support in the README -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] raphaelauv commented on pull request #29106: [FIX] README K8S support 2.5.1

2023-01-23 Thread via GitHub
raphaelauv commented on PR #29106: URL: https://github.com/apache/airflow/pull/29106#issuecomment-1400514307 @pierrejeambrun could you review , thank you :+1: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [airflow] potiuk commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1084184091 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -477,8 +496,12 @@ To do this we need to twine upload -r pypitest dist/* ``` -- Verify that the test package looks g

[GitHub] [airflow] potiuk commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1084184091 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -477,8 +496,12 @@ To do this we need to twine upload -r pypitest dist/* ``` -- Verify that the test package looks g

[GitHub] [airflow] potiuk commented on a diff in pull request #29098: Explicit a few steps in the release process

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29098: URL: https://github.com/apache/airflow/pull/29098#discussion_r1084184091 ## dev/README_RELEASE_AIRFLOW.md: ## @@ -477,8 +496,12 @@ To do this we need to twine upload -r pypitest dist/* ``` -- Verify that the test package looks g

[GitHub] [airflow] potiuk merged pull request #25466: Auto ML assets

2023-01-23 Thread via GitHub
potiuk merged PR #25466: URL: https://github.com/apache/airflow/pull/25466 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated: Auto ML assets (#25466)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90e6277da6 Auto ML assets (#25466) 90e6277da6 is de

[GitHub] [airflow] sudohainguyen commented on issue #28399: Dataproc Generator should allow creating spot instances

2023-01-23 Thread via GitHub
sudohainguyen commented on issue #28399: URL: https://github.com/apache/airflow/issues/28399#issuecomment-1400553157 due to the latest change from google (https://github.com/googleapis/python-dataproc/pull/512) I'm resuming the work from now on -- This is an automated message from the

[GitHub] [airflow] nirutgupta opened a new issue, #29108: Unable to login in iframe

2023-01-23 Thread via GitHub
nirutgupta opened a new issue, #29108: URL: https://github.com/apache/airflow/issues/29108 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened Airflow Version : 2.3.2 Helmchart Version: 1.3.0 When trying to login with admi

[GitHub] [airflow] saulbein commented on issue #27657: Zombie tasks detected after service restart sometimes do not retry

2023-01-23 Thread via GitHub
saulbein commented on issue #27657: URL: https://github.com/apache/airflow/issues/27657#issuecomment-1400584723 Updated to 2.5.0 (unfortunately right before 2.5.1). updated the issue description with the current providers that we use and the log itself. Now we don't really get tasks restart

[GitHub] [airflow] jedcunningham commented on a diff in pull request #29078: enhance production guide with a few Argo specific guidelines [#20999][#28637]

2023-01-23 Thread via GitHub
jedcunningham commented on code in PR #29078: URL: https://github.com/apache/airflow/pull/29078#discussion_r1084232512 ## docs/helm-chart/index.rst: ## @@ -140,3 +140,18 @@ will not start as the migrations will not be run: This is so these CI/CD services can perform updates wit

[GitHub] [airflow] bbovenzi commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
bbovenzi commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1084245521 ## airflow/www/templates/airflow/trigger.html: ## @@ -27,11 +27,93 @@ {% endblock %} +{% macro form_element(form_key, form_details) %} + + + + {%-

[GitHub] [airflow] boring-cyborg[bot] commented on issue #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on issue #29109: URL: https://github.com/apache/airflow/issues/29109#issuecomment-1400596078 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] kristopherkane opened a new issue, #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread via GitHub
kristopherkane opened a new issue, #29109: URL: https://github.com/apache/airflow/issues/29109 ### Apache Airflow version main (development) ### What happened The provider operator and hooks for Google Cloud Dataproc has two bugs: 1. The running [operator](https:

[GitHub] [airflow] MrGeorgeOwl commented on pull request #28406: Add defer mode to GKECreateClusterOperator and GKEDeleteClusterOperator

2023-01-23 Thread via GitHub
MrGeorgeOwl commented on PR #28406: URL: https://github.com/apache/airflow/pull/28406#issuecomment-1400598190 @potiuk, I think PR is good and can be merged -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[GitHub] [airflow] bbovenzi commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
bbovenzi commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1084252178 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('json'); +let j

[GitHub] [airflow] bbovenzi commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
bbovenzi commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1084254664 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('json'); +let j

[GitHub] [airflow] kristopherkane commented on issue #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread via GitHub
kristopherkane commented on issue #29109: URL: https://github.com/apache/airflow/issues/29109#issuecomment-1400609969 That label should probably be 'providers' -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [airflow] bbovenzi commented on a diff in pull request #27063: AIP-50 Trigger UI based on FAB

2023-01-23 Thread via GitHub
bbovenzi commented on code in PR #27063: URL: https://github.com/apache/airflow/pull/27063#discussion_r1084258122 ## airflow/www/static/js/trigger.js: ## @@ -19,33 +19,190 @@ /* global document, CodeMirror, window */ -const textArea = document.getElementById('json'); +let j

[GitHub] [airflow] potiuk commented on pull request #27156: Add documentation for BigQuery transfer operators

2023-01-23 Thread via GitHub
potiuk commented on PR #27156: URL: https://github.com/apache/airflow/pull/27156#issuecomment-1400616833 > @eladkal Please assign me You can just take the PR and start working on yours (and make reference to this PR). There is no need to assign it. -- This is an automated message f

[GitHub] [airflow] alicj commented on a diff in pull request #21877: AIP-45 Remove dag parsing in airflow run local

2023-01-23 Thread via GitHub
alicj commented on code in PR #21877: URL: https://github.com/apache/airflow/pull/21877#discussion_r1084263956 ## airflow/task/task_runner/base_task_runner.py: ## @@ -95,24 +89,16 @@ def __init__(self, local_task_job): cfg_path = tmp_configuration_copy(chmod=0o600,

[GitHub] [airflow] potiuk merged pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
potiuk merged PR #29086: URL: https://github.com/apache/airflow/pull/29086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (90e6277da6 -> c0f6bfa35b)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 90e6277da6 Auto ML assets (#25466) add c0f6bfa35b Remove upper bound limitation for `pytest` (#29086) No new revi

[GitHub] [airflow] potiuk commented on issue #29102: Airflow UI not showing mapped tasks

2023-01-23 Thread via GitHub
potiuk commented on issue #29102: URL: https://github.com/apache/airflow/issues/29102#issuecomment-1400621201 CC: @bbovenzi @pierrejeambrun @ephraimbuddy - if that one is confirmed, we might have a need for 2.5.2 rather quickly -- This is an automated message from the Apache Git Service.

[GitHub] [airflow] potiuk commented on pull request #29087: Unquarantine receive SIGTERM on Task Runner test (second attempt)

2023-01-23 Thread via GitHub
potiuk commented on PR #29087: URL: https://github.com/apache/airflow/pull/29087#issuecomment-1400623052 All was good. Rebased again with "use public runners". -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[GitHub] [airflow] potiuk commented on pull request #27829: Improving the release process

2023-01-23 Thread via GitHub
potiuk commented on PR #27829: URL: https://github.com/apache/airflow/pull/27829#issuecomment-1400624961 Nice! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [airflow] potiuk commented on pull request #27829: Improving the release process

2023-01-23 Thread via GitHub
potiuk commented on PR #27829: URL: https://github.com/apache/airflow/pull/27829#issuecomment-1400625486 Feel free to merge if you think it's GOOD and useful :). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [airflow] auvipy commented on pull request #29086: Remove upper bound limitation for `pytest`

2023-01-23 Thread via GitHub
auvipy commented on PR #29086: URL: https://github.com/apache/airflow/pull/29086#issuecomment-1400626127 thank you both -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

[GitHub] [airflow] sudohainguyen commented on issue #28399: Dataproc Generator should allow creating spot instances

2023-01-23 Thread via GitHub
sudohainguyen commented on issue #28399: URL: https://github.com/apache/airflow/issues/28399#issuecomment-1400637319 to fulfill the need to create secondary workers as SPOT type, `google-cloud-dataproc` version must be `5.3.0` -- This is an automated message from the Apache Git Service. T

[GitHub] [airflow] josh-fell commented on pull request #29048: Allow downloading of dbt Cloud artifacts to non-existent paths

2023-01-23 Thread via GitHub
josh-fell commented on PR #29048: URL: https://github.com/apache/airflow/pull/29048#issuecomment-1400637565 Rebased and resolved conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [airflow] jedcunningham commented on a diff in pull request #28808: Allow setting the name for the base container within K8s Pod Operator

2023-01-23 Thread via GitHub
jedcunningham commented on code in PR #28808: URL: https://github.com/apache/airflow/pull/28808#discussion_r1084275635 ## kubernetes_tests/test_kubernetes_pod_operator.py: ## @@ -1153,3 +1153,134 @@ def test_using_resources(self): do_xcom_push=False,

[GitHub] [airflow] sean-rose commented on a diff in pull request #29065: When clearing task instances try to get associated DAGs from database

2023-01-23 Thread via GitHub
sean-rose commented on code in PR #29065: URL: https://github.com/apache/airflow/pull/29065#discussion_r1084283710 ## tests/models/test_cleartasks.py: ## @@ -202,9 +203,9 @@ def test_clear_task_instances_without_task(self, dag_maker): # but it works for our case bec

[GitHub] [airflow] kristopherkane opened a new pull request, #29111: Dataproc batches

2023-01-23 Thread via GitHub
kristopherkane opened a new pull request, #29111: URL: https://github.com/apache/airflow/pull/29111 #28399 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #29111: Dataproc batches

2023-01-23 Thread boring-cyborg
boring-cyborg[bot] commented on PR #29111: URL: https://github.com/apache/airflow/pull/29111#issuecomment-1400644355 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[GitHub] [airflow] kristopherkane commented on issue #29109: [Google Cloud] DataprocCreateBatchOperator returns incorrect results and does not reattach

2023-01-23 Thread via GitHub
kristopherkane commented on issue #29109: URL: https://github.com/apache/airflow/issues/29109#issuecomment-1400653822 How I tested this with the Breeze environment and a real GCP project: - Batches DAG run from start to finish successfully - Batches DAG run that is cancelled after

[GitHub] [airflow] potiuk commented on pull request #8545: [AIRFLOW-249] Refactor the SLA mechanism (Continuation from #3584 )

2023-01-23 Thread via GitHub
potiuk commented on PR #8545: URL: https://github.com/apache/airflow/pull/8545#issuecomment-1400660574 > to take it over where should some one focus? fixing conflicts first I guess with how far behind this change is and how many conflicts it has, starting from the scratch following th

[GitHub] [airflow] potiuk merged pull request #29077: add retries to stop_pipeline on conflict

2023-01-23 Thread via GitHub
potiuk merged PR #29077: URL: https://github.com/apache/airflow/pull/29077 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[GitHub] [airflow] ephraimbuddy commented on pull request #27829: Improving the release process

2023-01-23 Thread via GitHub
ephraimbuddy commented on PR #27829: URL: https://github.com/apache/airflow/pull/27829#issuecomment-1400675244 > Feel free to merge if you think it's GOOD and useful :). Been thinking about the useful side of it :) let @jedcunningham decide -- This is an automated message from the

[airflow] branch main updated (c0f6bfa35b -> 6190e34388)

2023-01-23 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from c0f6bfa35b Remove upper bound limitation for `pytest` (#29086) add 6190e34388 add retries to stop_pipeline on conf

[GitHub] [airflow] potiuk commented on a diff in pull request #29077: add retries to stop_pipeline on conflict

2023-01-23 Thread via GitHub
potiuk commented on code in PR #29077: URL: https://github.com/apache/airflow/pull/29077#discussion_r1084317558 ## airflow/providers/amazon/aws/hooks/sagemaker.py: ## @@ -1154,19 +1154,35 @@ def stop_pipeline( :return: Status of the pipeline execution after the operatio

[GitHub] [airflow] josh-fell closed issue #27107: Dbt cloud download artifact to a path not present fails

2023-01-23 Thread via GitHub
josh-fell closed issue #27107: Dbt cloud download artifact to a path not present fails URL: https://github.com/apache/airflow/issues/27107 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [airflow] josh-fell merged pull request #29048: Allow downloading of dbt Cloud artifacts to non-existent paths

2023-01-23 Thread via GitHub
josh-fell merged PR #29048: URL: https://github.com/apache/airflow/pull/29048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[airflow] branch main updated (6190e34388 -> f805b4154a)

2023-01-23 Thread joshfell
This is an automated email from the ASF dual-hosted git repository. joshfell pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 6190e34388 add retries to stop_pipeline on conflict (#29077) add f805b4154a Allow downloading of dbt Cloud artif

  1   2   3   >