Re: [PR] Airflow 2.10.0 has been released [airflow]

2024-08-19 Thread via GitHub
ephraimbuddy commented on code in PR #41528: URL: https://github.com/apache/airflow/pull/41528#discussion_r1721304675 ## README.md: ## @@ -124,7 +124,7 @@ as this is the only environment that is supported. The only distro that is used is used in the [Community managed DockerHu

(airflow-site) branch add-documentation-2024-08-19 created (now 25db37b8e8)

2024-08-19 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2024-08-19 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 25db37b8e8 Add documentation for packages - 2024-08-19 This branch includes the followin

[PR] Add documentation for packages - 2024-08-19 [airflow-site]

2024-08-19 Thread via GitHub
eladkal opened a new pull request, #1059: URL: https://github.com/apache/airflow-site/pull/1059 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] feat(providers/openai): support batch api in hook/operator/trigger [airflow]

2024-08-19 Thread via GitHub
ginger0207 commented on code in PR #41554: URL: https://github.com/apache/airflow/pull/41554#discussion_r1721328153 ## airflow/providers/openai/hooks/openai.py: ## @@ -393,3 +413,74 @@ def delete_vector_store_file(self, vector_store_id: str, file_id: str) -> Vector """

Re: [PR] add OpenLineage support to S3ToRedshiftOperator [airflow]

2024-08-19 Thread via GitHub
Artuz37 closed pull request #41422: add OpenLineage support to S3ToRedshiftOperator URL: https://github.com/apache/airflow/pull/41422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

[PR] Allow usage of Jinja templating inside task param [airflow]

2024-08-19 Thread via GitHub
eter4eter opened a new pull request, #41574: URL: https://github.com/apache/airflow/pull/41574 Added rendering of parameters in the task context --- closes: #31801 -- This is an automated message from the Apache Git Service. To respond to the mess

Re: [PR] Allow usage of Jinja templating inside task param [airflow]

2024-08-19 Thread via GitHub
boring-cyborg[bot] commented on PR #41574: URL: https://github.com/apache/airflow/pull/41574#issuecomment-2295898117 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors'

[PR] Openlineage s3 to redshift operator integration [airflow]

2024-08-19 Thread via GitHub
Artuz37 opened a new pull request, #41575: URL: https://github.com/apache/airflow/pull/41575 **Recreated approved PR https://github.com/apache/airflow/pull/41422, because I made a mess rebasing** Added get_openlineage_facets_on_complete method to S3ToRedshiftOp

[PR] Add DataflowStartYamlJobOperator [airflow]

2024-08-19 Thread via GitHub
moiseenkov opened a new pull request, #41576: URL: https://github.com/apache/airflow/pull/41576 Add DataflowStartYamlJobOperator as a replacement option for DataflowStartSqlJobOperator. -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

[I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
eladkal opened a new issue, #41577: URL: https://github.com/apache/airflow/issues/41577 ### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers? The guidelines on how t

(airflow-site) branch add-documentation-2024-08-19 updated (25db37b8e8 -> 94f038df93)

2024-08-19 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2024-08-19 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 25db37b8e8 Add documentation for packages - 2024-08-19 add 94f038df93 fixes No new

[I] Cannot execute Dynamic Task Mapping when `default_arg` is present. [airflow]

2024-08-19 Thread via GitHub
phi-friday opened a new issue, #41578: URL: https://github.com/apache/airflow/issues/41578 ### Apache Airflow version 2.10.0rc1 ### If "Other Airflow 2 version" selected, which one? 2.10.0(not rc) ### What happened? Cannot execute Dynamic Task Mapping when `

Re: [I] Scheduler unable to process large number of orphan Datasets [airflow]

2024-08-19 Thread via GitHub
NBardelot commented on issue #41185: URL: https://github.com/apache/airflow/issues/41185#issuecomment-2295994492 See https://github.com/apache/airflow/pull/40806. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Email on failure stuck indefinitely (not timing out) [airflow]

2024-08-19 Thread via GitHub
pedro-cf commented on issue #41490: URL: https://github.com/apache/airflow/issues/41490#issuecomment-2295995800 > @pedro-cf Thank you for submitting the issue. Have you verified the smtp_timeout value in your airflow.cfg or environment variables? Also, please check if other settings like sm

(airflow) branch constraints-main updated: Updating constraints. Github run id:10449070343

2024-08-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 2ea1eb360d Updating con

Re: [I] Cannot execute Dynamic Task Mapping when `default_arg` is present. [airflow]

2024-08-19 Thread via GitHub
eladkal commented on issue #41578: URL: https://github.com/apache/airflow/issues/41578#issuecomment-2296009190 Isn't that duplicate of https://github.com/apache/airflow/issues/33600 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] Cannot execute Dynamic Task Mapping when `default_arg` is present. [airflow]

2024-08-19 Thread via GitHub
phi-friday closed issue #41578: Cannot execute Dynamic Task Mapping when `default_arg` is present. URL: https://github.com/apache/airflow/issues/41578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[I] Logout link in no roles and permissions error page is broken [airflow]

2024-08-19 Thread via GitHub
tirkarthi opened a new issue, #41580: URL: https://github.com/apache/airflow/issues/41580 ### Apache Airflow version main (development) ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? logout endpoint was made a POST end

Re: [PR] Remove deprecated SubDags [airflow]

2024-08-19 Thread via GitHub
potiuk commented on code in PR #41390: URL: https://github.com/apache/airflow/pull/41390#discussion_r1721450243 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -495,8 +495,9 @@ def _get_ti_pod_labels(context: Context | None = None, include_try_number: bool

Re: [I] callback without __name__ are not allowed when taskinstance executing [airflow]

2024-08-19 Thread via GitHub
tirkarthi commented on issue #41563: URL: https://github.com/apache/airflow/issues/41563#issuecomment-2296053421 It looks like `__name__` is not present on instance of a class and in this case a notifier instance is used in the callback. The change was added in #38892. Docs : `https

Re: [PR] Remove deprecated SubDags [airflow]

2024-08-19 Thread via GitHub
potiuk commented on code in PR #41390: URL: https://github.com/apache/airflow/pull/41390#discussion_r1721452951 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -495,8 +495,9 @@ def _get_ti_pod_labels(context: Context | None = None, include_try_number: bool

Re: [PR] Upgrade build and chart dependencies [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41570: URL: https://github.com/apache/airflow/pull/41570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (75fb7acbac -> c88192c466)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 75fb7acbac Prepare docs for Aug 2nd wave of providers (#41559) add c88192c466 Upgrade build and chart dependencies

Re: [I] Track SparkSubmitHook Yarn Cluster application with Yarn CLI [airflow]

2024-08-19 Thread via GitHub
tirkarthi commented on issue #24171: URL: https://github.com/apache/airflow/issues/24171#issuecomment-2296062775 I just want to add that we have been using yarn rest API to fetch application status in our custom deferrable operators related to spark on yarn and it has been working fine. We

Re: [PR] Airflow 2.10.0 has been released [airflow]

2024-08-19 Thread via GitHub
potiuk commented on code in PR #41528: URL: https://github.com/apache/airflow/pull/41528#discussion_r1721458569 ## README.md: ## @@ -124,7 +124,7 @@ as this is the only environment that is supported. The only distro that is used is used in the [Community managed DockerHub ima

Re: [PR] New provider for Magento open source [airflow]

2024-08-19 Thread via GitHub
raphaelauv commented on PR #41556: URL: https://github.com/apache/airflow/pull/41556#issuecomment-2296094645 @sivajik34 what is magento ? is this project https://github.com/magento/magento2 ? -- This is an automated message from the Apache Git Service. To respond to the message, ple

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
moiseenkov commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296096501 Hi, #41527, #41262 work as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] New provider for Magento open source [airflow]

2024-08-19 Thread via GitHub
kodurusivakumar34 commented on PR #41556: URL: https://github.com/apache/airflow/pull/41556#issuecomment-2296101355 @raphaelauv Yes. It is an ecommerce framework. Adobe commerce is an enterprise product. Magento is Open source product. Magento open source+ extra features= Adobe c

Re: [PR] Small refactoring of Dataplex system tests [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41573: URL: https://github.com/apache/airflow/pull/41573 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Refactor dataplex system tests (#41573)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new db5b3b7df3 Refactor dataplex system tests (#41573)

Re: [PR] decorators deprecated apply_defaults removal [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41579: URL: https://github.com/apache/airflow/pull/41579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (db5b3b7df3 -> 7153965a6e)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from db5b3b7df3 Refactor dataplex system tests (#41573) add 7153965a6e decorators deprecated apply_defaults removal (#4

Re: [I] Logout link in no roles and permissions error page is broken [airflow]

2024-08-19 Thread via GitHub
potiuk commented on issue #41580: URL: https://github.com/apache/airflow/issues/41580#issuecomment-2296118774 cc: @shahar1 -> small follow-up to #40145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[PR] Kubernetes 1.31 support [airflow]

2024-08-19 Thread via GitHub
raphaelauv opened a new pull request, #41581: URL: https://github.com/apache/airflow/pull/41581 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
sc250072 commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296139664 Hi, since there haven’t been any recent updates for the Teradata Provider beyond version 2.5.0, could you explain why a new release version is needed? https://nam02.safelin

[PR] Skip AWS auth test when python3-saml not installed [airflow]

2024-08-19 Thread via GitHub
potiuk opened a new pull request, #41582: URL: https://github.com/apache/airflow/pull/41582 Python3-saml is an optional dependency of Amazon provider and in case of Airflow 2.9 tests python3-saml is not installed yet, so we should skip the tests in case it is not.

Re: [PR] Add triggered_by field to DAG Run model to distinguish the source of a trigger [airflow]

2024-08-19 Thread via GitHub
VladaZakharova commented on PR #39165: URL: https://github.com/apache/airflow/pull/39165#issuecomment-2296157973 hi @potiuk ! Can you please check these changes again? We have some questions about migration for new Airflow version. Can you please guide us here? Thanks! -- This is an auto

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
phi-friday commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296167648 1. #41356 works fine. 2. #41358 I didn't use `spark` so I can't check, but given that `_sql` is simply an alias for `sql`, it should be fine. 3. #41461 I couldn't find a go

Re: [PR] fix: unwrap Param objects when used as DagParam defaults [airflow]

2024-08-19 Thread via GitHub
nickmyatt commented on PR #41513: URL: https://github.com/apache/airflow/pull/41513#issuecomment-2296180739 Hi @jscheffl, sorry I dashed this fix off in a bit of a rush... Consider this DAG: ```python @task def log_array_param(array: Iterable[str]): for elem in array:

Re: [PR] New provider for Magento open source [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41556: URL: https://github.com/apache/airflow/pull/41556#issuecomment-2296204906 @kodurusivakumar34 -> Those options are not really feasible. Apache Airflow is a project belonging to the Apache Software Foundation and whatever we keep and release - formally - as an "

Re: [PR] New provider for Magento open source [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41556: URL: https://github.com/apache/airflow/pull/41556#issuecomment-2296212411 BTW. This is where https://airflow.apache.org/ecosystem/ page exist. If you look at the top: > These resources and services are not maintained, nor endorsed by the Apache Airflow®

[PR] Update 2 10 0 client changelog [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 opened a new pull request, #41583: URL: https://github.com/apache/airflow/pull/41583 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] New provider for Magento open source [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41556: URL: https://github.com/apache/airflow/pull/41556#issuecomment-2296220641 BTW. I see you already have https://github.com/sivajik34/magento-airflow I see you already host your provider. So the easiest way to make it discoverable is to add link to it to the "eco

Re: [PR] Add changelog for airflow python client 2.10.0 [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 merged PR #41583: URL: https://github.com/apache/airflow/pull/41583 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch main updated: Add changelog for airflow python client 2.10.0 (#41583)

2024-08-19 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 317a28ed43 Add changelog for airflow python cl

Re: [PR] Switch cloudant provider from cloudant library to ibmcloudant library [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41555: URL: https://github.com/apache/airflow/pull/41555#issuecomment-2296264555 You should also add a note at the top of changelog (see comment at the top of changelog) and bump the version to the new major release in the provider.yaml. -- This is an automated me

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
potiuk commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296272842 > Hi, since there haven’t been any recent updates for the Teradata Provider beyond version 2.5.0, could you explain why a new release version is needed? According to our rules

[PR] Add changelog for airflow python client 2.10.0 (#41583) [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 opened a new pull request, #41584: URL: https://github.com/apache/airflow/pull/41584 * Add changelog for airflow python client 2.10.0 * Update client version (cherry picked from commit 317a28ed435960e7184e357a2f128806c34612fa) -- This is an automated message

Re: [PR] Add changelog for airflow python client 2.10.0 (#41583) [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 merged PR #41584: URL: https://github.com/apache/airflow/pull/41584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch v2-10-test updated: Add changelog for airflow python client 2.10.0 (#41583) (#41584)

2024-08-19 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/v2-10-test by this push: new 3ea764f802 Add changelog for airfl

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
potiuk commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296307037 Checked that all my changes are in. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] Switch cloudant provider from cloudant library to ibmcloudant library [airflow]

2024-08-19 Thread via GitHub
eladkal commented on code in PR #41555: URL: https://github.com/apache/airflow/pull/41555#discussion_r1721621154 ## airflow/providers/cloudant/provider.yaml: ## Review Comment: Please `4.0.0` to versions. Since we know for sure this PR is breaking ``` versions:

Re: [I] Dynamic tasks fail when default_args contains custom fields [airflow]

2024-08-19 Thread via GitHub
phi-friday commented on issue #33600: URL: https://github.com/apache/airflow/issues/33600#issuecomment-2296313081 This fixes it, but I don't know why. ```properties AIRFLOW__OPERATORS__ALLOW_ILLEGAL_ARGUMENTS=true ``` I think that if this is the cause, the error should occur in al

Re: [PR] Add triggered_by field to DAG Run model to distinguish the source of a trigger [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #39165: URL: https://github.com/apache/airflow/pull/39165#issuecomment-2296312346 I think that one requires another discussion on devlist - I believe currently we do not plan any changes in 2.11 other than making it a "bridge" release for Airflow 3 changes - so that o

Re: [PR] Add triggered_by field to DAG Run model to distinguish the source of a trigger [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #39165: URL: https://github.com/apache/airflow/pull/39165#issuecomment-2296332387 Generally speaking - I think currently the idea is that PRs like that should be targetted to Airflow 3 and (if possible and the author would like to do so) - they can be backported, but

[PR] Sync v2-10-stable with v2-10-test to release python client v2.10.0 [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 opened a new pull request, #41585: URL: https://github.com/apache/airflow/pull/41585 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[PR] fix: openlineage replace dagTree with downstream_task_ids [airflow]

2024-08-19 Thread via GitHub
kacpermuda opened a new pull request, #41587: URL: https://github.com/apache/airflow/pull/41587 Even after fix in #41494 has been implemented, we were still able to cause the scheduler OOM error when creating a dag_tree with the example dag below: dag crashing the dagTree

[I] Support for workload identity authentication from the Databricks provider [airflow]

2024-08-19 Thread via GitHub
basvandriel opened a new issue, #41586: URL: https://github.com/apache/airflow/issues/41586 ### Description Currently, only managed identity is supported for connecting from Airflow to Databricks using the `use_azure_managed_identity` parameter. However, I have a use case where an Ai

[PR] Upgrade build and chart dependencies (#41570) [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 opened a new pull request, #41588: URL: https://github.com/apache/airflow/pull/41588 (cherry picked from commit c88192c466cb91842310f82a61eaa48b39439bef) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Add Airflow 3 development readme [airflow]

2024-08-19 Thread via GitHub
potiuk commented on code in PR #41457: URL: https://github.com/apache/airflow/pull/41457#discussion_r1721677591 ## dev/README_AIRFLOW3_DEV.md: ## @@ -0,0 +1,114 @@ + + + +**Table of contents** + +- [Main branch is Airflow 3](#main-branch-is-airflow-3) +- [Contributors](#contribu

Re: [PR] Remove Database Isolation feature flag and run DB isolation tests [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41067: URL: https://github.com/apache/airflow/pull/41067#issuecomment-2296408251 cc: @utkarsharma2 - I am merging this one as with some of the test changes (only tests) I believe it brings stability to the running tests and you need it for Python client relase. --

Re: [PR] Remove Database Isolation feature flag and run DB isolation tests [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41067: URL: https://github.com/apache/airflow/pull/41067#issuecomment-2296409294 > cc: @utkarsharma2 - I am merging this one as with some of the test changes (only tests) I believe it brings stability to the running tests and you need it for Python client relase.

Re: [PR] Make all test pass in Database Isolation mode [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41567: URL: https://github.com/apache/airflow/pull/41567#issuecomment-2296409926 cc: @utkarsharma2 - I am merging this one as with some of the test changes (only tests) I believe it brings stability to the running tests and you need it for Python client relase.

Re: [PR] Make all test pass in Database Isolation mode [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41567: URL: https://github.com/apache/airflow/pull/41567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch v2-10-test updated (3ea764f802 -> 64415639b8)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 3ea764f802 Add changelog for airflow python client 2.10.0 (#41583) (#41584) add 64415639b8 Make all test pa

Re: [PR] Skip AWS auth test when python3-saml not installed [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41582: URL: https://github.com/apache/airflow/pull/41582 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Remove deprecated SubDags [airflow]

2024-08-19 Thread via GitHub
kaxil commented on code in PR #41390: URL: https://github.com/apache/airflow/pull/41390#discussion_r1721684927 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -495,8 +495,9 @@ def _get_ti_pod_labels(context: Context | None = None, include_try_number: bool

(airflow) branch main updated: Skip AWS auth test when python3-saml not installed (#41582)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9a84907462 Skip AWS auth test when python3-saml not

Re: [PR] Add Airflow 3 development readme [airflow]

2024-08-19 Thread via GitHub
kaxil commented on PR #41457: URL: https://github.com/apache/airflow/pull/41457#issuecomment-2296420477 Pre-commit (`doctoc`) is failing ``` +- [Milestones for PR](#milestones-for-pr) + - [Set 2.10.x milestone](#set-210x-milestone) + - [Set 2.11 milestone](#set-211-milestone

Re: [PR] Enable EksPodOperator deferrable [airflow]

2024-08-19 Thread via GitHub
jx2lee commented on code in PR #41380: URL: https://github.com/apache/airflow/pull/41380#discussion_r1720987537 ## airflow/providers/amazon/aws/operators/eks.py: ## @@ -1100,4 +1108,22 @@ def execute(self, context: Context): with eks_hook.generate_config_file(

(airflow) branch main updated: Kubernetes 1.31 support (#41581)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 8def71479a Kubernetes 1.31 support (#41581) 8def714

Re: [PR] Kubernetes 1.31 support [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41581: URL: https://github.com/apache/airflow/pull/41581 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Kubernetes 1.31 support [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41581: URL: https://github.com/apache/airflow/pull/41581#issuecomment-2296433637 Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscr

Re: [I] Dynamic tasks fail when default_args contains custom fields [airflow]

2024-08-19 Thread via GitHub
kaxil commented on issue #33600: URL: https://github.com/apache/airflow/issues/33600#issuecomment-2296517138 @uranusjr / @Lee-W -- you guys might know -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

(airflow) branch v2-10-test updated (64415639b8 -> e76dba61b9)

2024-08-19 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 64415639b8 Make all test pass in Database Isolation mode (#41567) add e76dba61b9 Upgrade build and char

Re: [PR] Upgrade build and chart dependencies (#41570) [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 merged PR #41588: URL: https://github.com/apache/airflow/pull/41588 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

Re: [PR] Fix try selector refresh (#41483) [airflow]

2024-08-19 Thread via GitHub
bbovenzi merged PR #41503: URL: https://github.com/apache/airflow/pull/41503 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch v2-10-test updated (e76dba61b9 -> 3de7597f15)

2024-08-19 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git from e76dba61b9 Upgrade build and chart dependencies (#41570) (#41588) add 3de7597f15 Fix try selector refresh

Re: [PR] Remove debian bullseye support (#41568) [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41569: URL: https://github.com/apache/airflow/pull/41569#issuecomment-2296545316 Would love also get that one back-ported (for docs in v2.10.1 mostly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
jx2lee commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296550520 @eladkal #40008 works fine! (unittest & example run) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] Lower log level when no pod template file is supplied [airflow]

2024-08-19 Thread via GitHub
BasPH opened a new pull request, #41589: URL: https://github.com/apache/airflow/pull/41589 I suggest lowering the log message when no pod template file is provided from warning to info level. This is accepted behaviour, many users specify pod settings on task-level. However, logging a warni

Re: [PR] Lower log level when no pod template file is supplied [airflow]

2024-08-19 Thread via GitHub
BasPH closed pull request #41589: Lower log level when no pod template file is supplied URL: https://github.com/apache/airflow/pull/41589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[PR] kubernetes remove 1.27 support [airflow]

2024-08-19 Thread via GitHub
raphaelauv opened a new pull request, #41590: URL: https://github.com/apache/airflow/pull/41590 EKS 1.27 end 24 Jul 2024 AKS 1.27 end 31 Jul 2024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] Make CronTriggerTimetable startup behavior intuitive [airflow]

2024-08-19 Thread via GitHub
collinmcnulty commented on PR #41558: URL: https://github.com/apache/airflow/pull/41558#issuecomment-2296563885 I found a logical bug. Setting to False creates a race condition to actually schedule the first run. We'll need some minimum buffer time where the next run time does not update ev

Re: [I] Airflow SFTPToGCSOperator sftp file exist check [airflow]

2024-08-19 Thread via GitHub
kandharvishnu commented on issue #41472: URL: https://github.com/apache/airflow/issues/41472#issuecomment-2296575917 > Is there an issue with using an `SFTPSensor` for checking file existence, prior to running `SFTPToGCSOperator`? The SFTP sensor will wait until the file is detected.

Re: [I] Import error of new dags cannot be shown on web UI for common users [airflow]

2024-08-19 Thread via GitHub
andreyolv commented on issue #29897: URL: https://github.com/apache/airflow/issues/29897#issuecomment-2296580902 I also have this issue in version v2.9.1. In summary: If the permissions 'can read on ImportError' and 'can read on DAG:test123' are configured directly on the role, the user c

Re: [PR] Remove debian bullseye support (#41568) [airflow]

2024-08-19 Thread via GitHub
potiuk merged PR #41569: URL: https://github.com/apache/airflow/pull/41569 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch v2-10-test updated (3de7597f15 -> 49fc1792c3)

2024-08-19 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 3de7597f15 Fix try selector refresh (#41483) (#41503) add 49fc1792c3 Remove debian bullseye support (#41568)

Re: [PR] Remove Database Isolation feature flag and run DB isolation tests [airflow]

2024-08-19 Thread via GitHub
potiuk commented on PR #41067: URL: https://github.com/apache/airflow/pull/41067#issuecomment-2296637431 @jscheffl -> shall we close that one then after #41567 merged? Are you good with that we are not planning to merge it and essentially we will remove AIP-44 from main - is that fine for

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
Owen-CH-Leung commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296644731 @eladkal the `ElasticSearchSQLHook` is now working as expected. ![image](https://github.com/user-attachments/assets/6b94fd51-869f-43fd-9fbb-c5dfd2bc4eff) -- Thi

Re: [PR] Remove Database Isolation feature flag and run DB isolation tests [airflow]

2024-08-19 Thread via GitHub
utkarsharma2 commented on PR #41067: URL: https://github.com/apache/airflow/pull/41067#issuecomment-2296671964 > cc: @utkarsharma2 - I am merging this one as with some of the test changes (only tests) I believe it brings stability to the running tests and you need it for Python client relas

Re: [PR] Openlineage s3 to redshift operator integration [airflow]

2024-08-19 Thread via GitHub
boring-cyborg[bot] commented on PR #41575: URL: https://github.com/apache/airflow/pull/41575#issuecomment-2296680686 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [PR] Openlineage s3 to redshift operator integration [airflow]

2024-08-19 Thread via GitHub
vincbeck merged PR #41575: URL: https://github.com/apache/airflow/pull/41575 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch main updated: Openlineage s3 to redshift operator integration (#41575)

2024-08-19 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a2b8696bdb Openlineage s3 to redshift operator in

Re: [PR] fixing emr-operator-deferral-logic [airflow]

2024-08-19 Thread via GitHub
vincbeck commented on code in PR #41561: URL: https://github.com/apache/airflow/pull/41561#discussion_r1721864982 ## airflow/providers/amazon/aws/operators/emr.py: ## @@ -824,7 +824,7 @@ def execute(self, context: Context) -> str | None: job_flow_id=self._job_fl

Re: [PR] fixing emr-operator-deferral-logic [airflow]

2024-08-19 Thread via GitHub
vincbeck commented on PR #41561: URL: https://github.com/apache/airflow/pull/41561#issuecomment-2296689428 Can you please add unit tests? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [I] Status of testing Providers that were prepared on August 19, 2024 [airflow]

2024-08-19 Thread via GitHub
vikramaditya91 commented on issue #41577: URL: https://github.com/apache/airflow/issues/41577#issuecomment-2296695690 > https://github.com/apache/airflow/pull/41256: @vikramaditya91 Works fine -- This is an automated message from the Apache Git Service. To respond to the messag

(airflow) branch constraints-2-10 updated: Updating constraints. Github run id:10454396953

2024-08-19 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-10 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-10 by this push: new aac8180c51 Updating con

(airflow) branch v2-10-test updated (49fc1792c3 -> 21b3f7c67e)

2024-08-19 Thread bbovenzi
This is an automated email from the ASF dual-hosted git repository. bbovenzi pushed a change to branch v2-10-test in repository https://gitbox.apache.org/repos/asf/airflow.git from 49fc1792c3 Remove debian bullseye support (#41568) (#41569) add 21b3f7c67e Field Deletion Warning when edi

Re: [PR] Field Deletion Warning when editing Connections (#41144) [airflow]

2024-08-19 Thread via GitHub
bbovenzi merged PR #41504: URL: https://github.com/apache/airflow/pull/41504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

  1   2   >