[PR] Slack: Remove parameter `token` in SlackAPIPostOperator [airflow]

2023-12-08 Thread via GitHub
brienzb opened a new pull request, #36121: URL: https://github.com/apache/airflow/pull/36121 Since Slack provider 8.0 version and later, parameter `token` has been deleted. Related commit: https://github.com/apache/airflow/commit/ed6a4fd1162407a2007d949765eab5749af1c3ac

Re: [PR] Slack: Remove parameter `token` in SlackAPIPostOperator [airflow]

2023-12-08 Thread via GitHub
boring-cyborg[bot] commented on PR #36121: URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846767525 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

[PR] Implement deferrable mode for BeamRunJavaPipelineOperator [airflow]

2023-12-08 Thread via GitHub
moiseenkov opened a new pull request, #36122: URL: https://github.com/apache/airflow/pull/36122 Implement deferrable mode for BeamRunJavaPipelineOperator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish [airflow]

2023-12-08 Thread via GitHub
eladkal closed issue #35149: make a trigger_rule for one upstream failed but wait the whole upstream tasks to finish URL: https://github.com/apache/airflow/issues/35149 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] Slack: Remove parameter `token` in SlackAPIPostOperator's docstring [airflow]

2023-12-08 Thread via GitHub
boring-cyborg[bot] commented on PR #36121: URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846857337 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [PR] Slack: Remove parameter `token` in SlackAPIPostOperator's docstring [airflow]

2023-12-08 Thread via GitHub
hussein-awala merged PR #36121: URL: https://github.com/apache/airflow/pull/36121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

(airflow) branch main updated: Slack: Remove parameter `token` in SlackAPIPostOperator's docstring (#36121)

2023-12-08 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4824ca7c5a Slack: Remove parameter `token` in

Re: [PR] Slack: Remove parameter `token` in SlackAPIPostOperator's docstring [airflow]

2023-12-08 Thread via GitHub
hussein-awala commented on PR #36121: URL: https://github.com/apache/airflow/pull/36121#issuecomment-1846857885 Congrats on your first commit 🎉 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [PR] Add SparkKubernetesOperator crd implementation [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1846898571 ping @hamedhsn , would love to have this in after all the work you did. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

[PR] Fix case where `--use-constraints-version VERSION` has been broken [airflow]

2023-12-08 Thread via GitHub
potiuk opened a new pull request, #36123: URL: https://github.com/apache/airflow/pull/36123 We are changing the whole mechanism in #36094 but since it might take a bit to review, this is a quick fix to fix --use-airflow-version pointing to specific airflow version.

Re: [PR] Fix case where `--use-constraints-version VERSION` has been broken [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36123: URL: https://github.com/apache/airflow/pull/36123#issuecomment-1846902824 cc: @kacpermuda -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420221714 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) -> None: client = self.co

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420221714 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) -> None: client = self.co

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
ephraimbuddy commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420230202 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) -> None: client = self.co

Re: [PR] Add encryption methods to serde for primitives [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on code in PR #35867: URL: https://github.com/apache/airflow/pull/35867#discussion_r1420235222 ## airflow/serialization/serde.py: ## @@ -83,6 +91,81 @@ def decode(d: dict[str, Any]) -> tuple[str, int, Any]: return classname, version, data +def enc

Re: [PR] Allow storage options to be passed [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on code in PR #35820: URL: https://github.com/apache/airflow/pull/35820#discussion_r1420237930 ## airflow/io/store/__init__.py: ## @@ -134,6 +146,6 @@ def attach( if store := _STORE_CACHE.get(alias): return store -_STORE_CACHE[a

Re: [PR] Allow storage options to be passed [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on code in PR #35820: URL: https://github.com/apache/airflow/pull/35820#discussion_r1420242140 ## airflow/io/__init__.py: ## @@ -32,21 +32,25 @@ if TYPE_CHECKING: from fsspec import AbstractFileSystem +from airflow.io.typedef import Properties

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420254907 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -133,20 +140,201 @@ def create_class(self, class_json: dict[str, Any]) -> None: client = self.co

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #36085: URL: https://github.com/apache/airflow/pull/36085#discussion_r1420266560 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -17,10 +17,14 @@ from __future__ import annotations +import contextlib +import json import warnings

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #36085: URL: https://github.com/apache/airflow/pull/36085#discussion_r1420266830 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -30,7 +34,7 @@ from airflow.hooks.base import BaseHook if TYPE_CHECKING: -from typing import Any +

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #36085: URL: https://github.com/apache/airflow/pull/36085#discussion_r1420282153 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -144,22 +148,63 @@ def create_schema(self, schema_json: dict[str, Any]) -> None: client = self.c

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420287186 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -119,38 +125,204 @@ def test_connection(self) -> tuple[bool, str]: self.log.error("Error test

Re: [PR] Add helper function for CRUD operations on weaviate's schema and class objects [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 commented on code in PR #35919: URL: https://github.com/apache/airflow/pull/35919#discussion_r1420288687 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -17,15 +17,20 @@ from __future__ import annotations +import json import warnings from functools imp

[PR] Added Yeedu Operator [airflow]

2023-12-08 Thread via GitHub
rohith-sagar opened a new pull request, #36124: URL: https://github.com/apache/airflow/pull/36124 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidel

Re: [PR] Added Yeedu Operator [airflow]

2023-12-08 Thread via GitHub
boring-cyborg[bot] commented on PR #36124: URL: https://github.com/apache/airflow/pull/36124#issuecomment-1846982967 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

Re: [PR] Added Yeedu Operator [airflow]

2023-12-08 Thread via GitHub
rohith-sagar closed pull request #36124: Added Yeedu Operator URL: https://github.com/apache/airflow/pull/36124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[PR] Added Yeedu Operator [airflow]

2023-12-08 Thread via GitHub
rohith-sagar opened a new pull request, #36125: URL: https://github.com/apache/airflow/pull/36125 Adding Yeedu Operator -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] Added Yeedu Operator [airflow]

2023-12-08 Thread via GitHub
rohith-sagar closed pull request #36125: Added Yeedu Operator URL: https://github.com/apache/airflow/pull/36125 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Airflow Triggerer facing frequent restarts [airflow]

2023-12-08 Thread via GitHub
tirkarthi commented on issue #33647: URL: https://github.com/apache/airflow/issues/33647#issuecomment-1846989815 @shubhransh-eb Can you please add the previous version of Airflow where it worked fine? We upgraded from Airflow 2.3.4 to 2.7.2. We are also using mysql 8 and faced the query tak

Re: [PR] Fix gcs listing - ensure blobs are loaded [airflow]

2023-12-08 Thread via GitHub
pankajastro commented on PR #34919: URL: https://github.com/apache/airflow/pull/34919#issuecomment-1846993082 Hey @atrbgithub looks like `GCSObjectsWithPrefixExistenceSensor` is broken after this PR change I just did a quick run and got the below error. **Sensor** ``` gcs_obje

[PR] Adding Yeedu Provider to the airflow. [airflow]

2023-12-08 Thread via GitHub
rohith-sagar opened a new pull request, #36126: URL: https://github.com/apache/airflow/pull/36126 Adding Yeedu Provider to the airflow. --- Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)

Re: [PR] Add retry mechanism and dataframe support for WeaviateIngestOperator [airflow]

2023-12-08 Thread via GitHub
utkarsharma2 merged PR #36085: URL: https://github.com/apache/airflow/pull/36085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch main updated: Add retry mechanism and dataframe support for WeaviateIngestOperator (#36085)

2023-12-08 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a8333b778a Add retry mechanism and dataframe s

Re: [PR] Sync v2-8-stable with v2-8-test to release 2.8.0 [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on PR #36065: URL: https://github.com/apache/airflow/pull/36065#issuecomment-1847030990 I'd really prefer https://github.com/apache/airflow/pull/35820 to be in, as otherwise we would have to deal with backwards compatibility -- This is an automated message from the

(airflow-site) 01/01: Airflow 2.8.0 blog post

2023-12-08 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch airflow_280blog in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 26bcd3bbd2707902c8272fa9f21031a7f2e53b89 Author: Ephraim Anierobi AuthorDate: Fri Dec 8 12:50:51

(airflow-site) branch airflow_280blog created (now 26bcd3bbd2)

2023-12-08 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch airflow_280blog in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 26bcd3bbd2 Airflow 2.8.0 blog post This branch includes the following new commits: new

[PR] Airflow 2.8.0 blog post [airflow-site]

2023-12-08 Thread via GitHub
ephraimbuddy opened a new pull request, #906: URL: https://github.com/apache/airflow-site/pull/906 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

(airflow) branch main updated: Allow storage options to be passed (#35820)

2023-12-08 Thread bolke
This is an automated email from the ASF dual-hosted git repository. bolke pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new aba58adb83 Allow storage options to be passed (#3582

Re: [PR] Allow storage options to be passed [airflow]

2023-12-08 Thread via GitHub
bolkedebruin commented on PR #35820: URL: https://github.com/apache/airflow/pull/35820#issuecomment-1847095296 Merging this - if we want to adjust the typing and split the attach function we can do that in the follow ups. -- This is an automated message from the Apache Git Service. To res

Re: [PR] Allow storage options to be passed [airflow]

2023-12-08 Thread via GitHub
bolkedebruin merged PR #35820: URL: https://github.com/apache/airflow/pull/35820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

Re: [PR] Fix case where `--use-constraints-version VERSION` has been broken [airflow]

2023-12-08 Thread via GitHub
potiuk merged PR #36123: URL: https://github.com/apache/airflow/pull/36123 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (aba58adb83 -> 73abe322ec)

2023-12-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from aba58adb83 Allow storage options to be passed (#35820) add 73abe322ec Fix case where `--use-constraints-version VE

[PR] Fix on top of https://github.com/apache/airflow/pull/35677 [airflow]

2023-12-08 Thread via GitHub
stavdav143 opened a new pull request, #36127: URL: https://github.com/apache/airflow/pull/36127 Dear @eladkal, @potiuk I found a small bug while checking the release of the provider. I opened a PR here. Let me know if I can assist you more in merging. Thanks for your understa

Re: [PR] Fix `enable_logging=True` not working in `DockerSwarmOperator` [airflow]

2023-12-08 Thread via GitHub
stavdav143 commented on PR #35677: URL: https://github.com/apache/airflow/pull/35677#issuecomment-1847326195 Dear @eladkal, @potiuk After your email for testing, I found a small bug. I opened this PR here: https://github.com/apache/airflow/pull/36127 -- This is an automated m

Re: [PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-08 Thread via GitHub
eladkal commented on PR #36113: URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847361108 > Instead of using `SQLExecuteQueryOperator`, use AWS provided operator `RedshiftDataOperator` to run SQL queries in a Redshift cluster. > > **^ Add meaningful description above**

Re: [PR] Add SparkKubernetesOperator crd implementation [airflow]

2023-12-08 Thread via GitHub
hamedhsn commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1847371472 @bolkedebruin Sorry was sick for the last few days, I will finish the documentation soon. will ping you when it is ready -- This is an automated message from the Apache Git Servi

Re: [PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-08 Thread via GitHub
vincbeck commented on PR #36113: URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847405897 > > Instead of using `SQLExecuteQueryOperator`, use AWS provided operator `RedshiftDataOperator` to run SQL queries in a Redshift cluster. > > If both options work maybe we shoul

Re: [PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-08 Thread via GitHub
vincbeck commented on PR #36113: URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847407215 > > Instead of using `SQLExecuteQueryOperator`, use AWS provided operator `RedshiftDataOperator` to run SQL queries in a Redshift cluster. > > If both options work maybe we shoul

[I] In cli "airflow roles export / import" : add the permissions to the json file processed. [airflow]

2023-12-08 Thread via GitHub
gbonazzoli opened a new issue, #36128: URL: https://github.com/apache/airflow/issues/36128 ### Description Actually (Airflow 2.7.3) the cli command `airflow roles export` does only export custom roles but without specifing the related permission, so it is quite useless as a mean to b

Re: [PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-08 Thread via GitHub
eladkal commented on PR #36113: URL: https://github.com/apache/airflow/pull/36113#issuecomment-1847476142 Cool. We already have that mentioned in https://airflow.apache.org/docs/apache-airflow-providers-amazon/stable/operators/redshift/index.html -- This is an automated message from th

Re: [PR] Use `redshift-data` operators instead of SQL operators [airflow]

2023-12-08 Thread via GitHub
eladkal merged PR #36113: URL: https://github.com/apache/airflow/pull/36113 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated: Use redshift-data operators instead of SQL operators (#36113)

2023-12-08 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2c251a0a18 Use redshift-data operators instead of

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36094: URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847526986 Still a few nits but I am getting really close -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] Fix on top of https://github.com/apache/airflow/pull/35677 [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36127: URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847545804 What is the effect of it (i.e. is it catastrophic for users? We have two options - remove docker provider from RC1 and do RC2 with it or release it and make an ad-hoc release afte

Re: [I] Status of testing Providers that were prepared on December 08, 2023 [airflow]

2023-12-08 Thread via GitHub
atrbgithub commented on issue #36117: URL: https://github.com/apache/airflow/issues/36117#issuecomment-1847548472 An issue has been raised with https://github.com/apache/airflow/pull/34919 Unfortunately it looks like it has broken `GCSObjectsWithPrefixExistenceSensor`. -- This is

Re: [PR] Fix gcs listing - ensure blobs are loaded [airflow]

2023-12-08 Thread via GitHub
atrbgithub commented on PR #34919: URL: https://github.com/apache/airflow/pull/34919#issuecomment-1847615888 @pankajastro thanks for raising, I have mentioned this [here](https://github.com/apache/airflow/issues/36117#issuecomment-1847548472) and asked for the change not to be merged in.

[PR] Add `scripts` folder when generally all other sources are removed. [airflow]

2023-12-08 Thread via GitHub
potiuk opened a new pull request, #36129: URL: https://github.com/apache/airflow/pull/36129 This allows to tests the scripts that require --mount-sources remove but you run some scripts inside the container (for example this was the case when modifying installation of airflow and providers

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36094: URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847628929 We will also need to merge this one https://github.com/apache/airflow/pull/36129 - before, so that users will not have to rebuild image in order to use the new `--use-airflow-version` co

Re: [PR] Add `scripts\in_container` folder when all other sources are removed. [airflow]

2023-12-08 Thread via GitHub
potiuk merged PR #36129: URL: https://github.com/apache/airflow/pull/36129 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add `scripts\in_container` folder when all other sources are removed. (#36129)

2023-12-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 67453a69ed Add `scripts\in_container` folder when a

Re: [PR] Fix on top of https://github.com/apache/airflow/pull/35677 [airflow]

2023-12-08 Thread via GitHub
stavdav143 commented on PR #36127: URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847657253 Yeah so what happens is we stream each log line twice as "last_line_logged" was not being updated. On you to decide how to proceed to avoid also additional efforts by

Re: [PR] Fix on top of https://github.com/apache/airflow/pull/35677 [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36127: URL: https://github.com/apache/airflow/pull/36127#issuecomment-1847658802 I think it's important-enough to RC2 - but it's @eladkal 's decision (Elad is release manager) -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] Fix error handling in EksCreateClusterOperator in deferrable mode [airflow]

2023-12-08 Thread via GitHub
syedahsn commented on PR #34966: URL: https://github.com/apache/airflow/pull/34966#issuecomment-1847661038 We can close this PR now that #36079 has been merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: [PR] Fix error handling in EksCreateClusterOperator in deferrable mode [airflow]

2023-12-08 Thread via GitHub
vincbeck closed pull request #34966: Fix error handling in EksCreateClusterOperator in deferrable mode URL: https://github.com/apache/airflow/pull/34966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] Dataset extra fields set in Task outlets are not accessible [airflow]

2023-12-08 Thread via GitHub
error418 commented on issue #35297: URL: https://github.com/apache/airflow/issues/35297#issuecomment-1847681793 How do we move on from here now? I am ready to update the PR with changes to make this happen. Following questions are imho a good starting point: * What purpose has the

[PR] Only perform list if delimiter specified [airflow]

2023-12-08 Thread via GitHub
atrbgithub opened a new pull request, #36130: URL: https://github.com/apache/airflow/pull/36130 This fixes the issue raised [here](https://github.com/apache/airflow/pull/34919#issuecomment-1846993082) against https://github.com/apache/airflow/pull/34919 When testing locally the list

Re: [PR] Fix gcs listing - ensure blobs are loaded [airflow]

2023-12-08 Thread via GitHub
atrbgithub commented on PR #34919: URL: https://github.com/apache/airflow/pull/34919#issuecomment-1847685018 @pankajastro I've raised a PR to fix this https://github.com/apache/airflow/pull/36130 Would you be able to retest? -- This is an automated message from the Apache Git Servi

Re: [PR] Only perform list if delimiter specified [airflow]

2023-12-08 Thread via GitHub
atrbgithub commented on PR #36130: URL: https://github.com/apache/airflow/pull/36130#issuecomment-1847691555 @eladkal @shahar1 Would you be able to take a look at this if you get a chance? Without this, https://github.com/apache/airflow/pull/34919 should not be released (https://gith

Re: [PR] Only perform list if delimiter specified [airflow]

2023-12-08 Thread via GitHub
shahar1 commented on PR #36130: URL: https://github.com/apache/airflow/pull/36130#issuecomment-1847709408 Good catch! If it's not too hard, could you try adding tests for both conditions? (e.g., by patching `builtins.list` function) I wouldn't be too strict about it - but if it's poss

[PR] Unify how docker commands get executed in Breeze [airflow]

2023-12-08 Thread via GitHub
potiuk opened a new pull request, #36131: URL: https://github.com/apache/airflow/pull/36131 So far we executed commands in CI image in breeze in two ways: * entering the shell (which runs docker-compose under the hood) * running `docker run` with the CI image This requires ra

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #36094: URL: https://github.com/apache/airflow/pull/36094#issuecomment-1847758044 Finally ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Move Breeze installation of Airflow in CI image to Python [airflow]

2023-12-08 Thread via GitHub
potiuk merged PR #36094: URL: https://github.com/apache/airflow/pull/36094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] Update Airflow Airbyte Provider to use the new Airbyte API [airflow]

2023-12-08 Thread via GitHub
potiuk commented on issue #35011: URL: https://github.com/apache/airflow/issues/35011#issuecomment-1847915877 > Hello, I'm interested to know if there has been any progress with this issue? Generally if there is no comment/work/pr there is no progress. This is an open-source project

Re: [PR] Create FAB provider and move FAB auth manager in it [airflow]

2023-12-08 Thread via GitHub
potiuk commented on PR #35926: URL: https://github.com/apache/airflow/pull/35926#issuecomment-1847948444 🤞 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [I] Add overrides in the template field for the Google Cloud Run Jobs Execute operator [airflow]

2023-12-08 Thread via GitHub
boring-cyborg[bot] commented on issue #36132: URL: https://github.com/apache/airflow/issues/36132#issuecomment-1847984311 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] Add overrides in the template field for the Google Cloud Run Jobs Execute operator [airflow]

2023-12-08 Thread via GitHub
guillaumeblaquiere opened a new issue, #36132: URL: https://github.com/apache/airflow/issues/36132 ### Description The overrides parameter is not in the list of template field and it's impossible to pass runtime values to Cloud Run (date start/end, custom dag parameters,...) #

[PR] Feature 36132: add overrides in the template fields of Google Cloud Run Jobs Execute Operator [airflow]

2023-12-08 Thread via GitHub
guillaumeblaquiere opened a new pull request, #36133: URL: https://github.com/apache/airflow/pull/36133 Close #36132 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#p

Re: [PR] Feature 36132: add overrides in the template fields of Google Cloud Run Jobs Execute Operator [airflow]

2023-12-08 Thread via GitHub
boring-cyborg[bot] commented on PR #36133: URL: https://github.com/apache/airflow/pull/36133#issuecomment-1847987609 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

Re: [I] "AirflowException: Invalid arguments were passed to GlueJobOperator" when setting update_config=True [airflow]

2023-12-08 Thread via GitHub
github-actions[bot] commented on issue #35637: URL: https://github.com/apache/airflow/issues/35637#issuecomment-1847993629 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [PR] Refactor use Path.touch to create empty files [airflow]

2023-12-08 Thread via GitHub
github-actions[bot] closed pull request #34379: Refactor use Path.touch to create empty files URL: https://github.com/apache/airflow/pull/34379 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] Refactor: Remove trailing whitespace from strings [airflow]

2023-12-08 Thread via GitHub
github-actions[bot] closed pull request #34121: Refactor: Remove trailing whitespace from strings URL: https://github.com/apache/airflow/pull/34121 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[PR] EventsTimetable schedules past events even if catchup=False [airflow]

2023-12-08 Thread via GitHub
avkirilishin opened a new pull request, #36134: URL: https://github.com/apache/airflow/pull/36134 closes: https://github.com/apache/airflow/issues/33948 Fixed the bug and added some more tests. -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] Migrate provider-specific executor docs to providers [airflow]

2023-12-08 Thread via GitHub
RNHTTR commented on PR #34809: URL: https://github.com/apache/airflow/pull/34809#issuecomment-1848203799 @lzdanski This is the spell check sphinx issue I was referring to. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[PR] Refactor ExternalDagLink to not create ad hoc TaskInstances [airflow]

2023-12-08 Thread via GitHub
josh-fell opened a new pull request, #36135: URL: https://github.com/apache/airflow/pull/36135 This operator link creates an ad hoc TaskInstance to build its output URL. Generally we moved away from this approach starting with #21285. This PR updates the operator link to use `TaskInst

[I] Executor Config Lost on Task Retry with Kubernetes Executor in Airflow 2.7.3 [airflow]

2023-12-08 Thread via GitHub
buu-nguyen opened a new issue, #36136: URL: https://github.com/apache/airflow/issues/36136 ### Apache Airflow version 2.7.3 ### What happened I have encountered a bug where the `executor_config` for a task is lost when the task is retried. This issue occurs when using th

Re: [I] Trigger event payload mutually incompatible with deferral kwargs [airflow]

2023-12-08 Thread via GitHub
github-actions[bot] commented on issue #20003: URL: https://github.com/apache/airflow/issues/20003#issuecomment-1848272380 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Trigger event payload mutually incompatible with deferral kwargs [airflow]

2023-12-08 Thread via GitHub
github-actions[bot] closed issue #20003: Trigger event payload mutually incompatible with deferral kwargs URL: https://github.com/apache/airflow/issues/20003 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t