(airflow) annotated tag constraints-2.9.1 updated (b402267cea -> 5b5cae983d)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag constraints-2.9.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-2.9.1 was modified! *** from b402267cea (commit) to 5b5cae9

(airflow) annotated tag constraints-latest updated (e996825d56 -> f9a51d950a)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag constraints-latest in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-latest was modified! *** from e996825d56 (tag) to f9a51d95

Re: [PR] Add triggered_by field to DAG Run model to distinguish the source of a trigger [airflow]

2024-05-06 Thread via GitHub
molcay commented on code in PR #39165: URL: https://github.com/apache/airflow/pull/39165#discussion_r1590616088 ## airflow/api/common/trigger_dag.py: ## @@ -104,6 +107,7 @@ def _trigger_dag( def trigger_dag( dag_id: str, +triggered_by: DagRunTriggeredByType, Review

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590616760 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1041,7 +1044,21 @@ def monitor_databricks_job(self) -> None: run = self._hook.get_run(self

(airflow) annotated tag 2.9.1 updated (2d53c1089f -> 9bd02ed879)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag 2.9.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag 2.9.1 was modified! *** from 2d53c1089f (commit) to 9bd02ed879 (tag) tagging 2d53c

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590616760 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1041,7 +1044,21 @@ def monitor_databricks_job(self) -> None: run = self._hook.get_run(self

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590622588 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1041,7 +1044,21 @@ def monitor_databricks_job(self) -> None: run = self._hook.get_run(self.dat

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590623829 ## airflow/providers/databricks/operators/databricks.py: ## @@ -926,6 +926,7 @@ class DatabricksNotebookOperator(BaseOperator): """ template_fields = ("not

Re: [PR] Updating S3LogLink with an invalid bucket link [airflow]

2024-05-06 Thread via GitHub
Lee-W merged PR #39424: URL: https://github.com/apache/airflow/pull/39424 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.ap

(airflow) branch main updated (4a568d308a -> 9eac30567d)

2024-05-06 Thread weilee
This is an automated email from the ASF dual-hosted git repository. weilee pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4a568d308a Fix typo sensitive masking words in docs (#39415) add 9eac30567d Updating S3LogLink with an invalid buc

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590632093 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@s

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590633603 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1041,7 +1044,21 @@ def monitor_databricks_job(self) -> None: run = self._hook.get_run(self

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590634368 ## airflow/providers/pinecone/operators/pinecone.py: ## @@ -119,7 +119,7 @@ def __init__( pod_type: str | None = None, metadata_config: dict | Non

Re: [PR] Fix custom actions in security manager `has_access` [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy merged PR #39421: URL: https://github.com/apache/airflow/pull/39421 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

Re: [I] Custom FAB actions no longer work [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy closed issue #39144: Custom FAB actions no longer work URL: https://github.com/apache/airflow/issues/39144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

(airflow) branch main updated: Fix custom actions in security manager `has_access` (#39421)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b594a8dcc0 Fix custom actions in security

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590646930 ## airflow/providers/pinecone/operators/pinecone.py: ## @@ -116,10 +116,10 @@ def __init__( replicas: int | None = None, shards: int | None = Non

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590648932 ## tests/system/providers/pinecone/example_pinecone_cohere.py: ## @@ -44,8 +43,8 @@ def create_index(): from airflow.providers.pinecone.hooks.pinecone imp

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590655107 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590655107 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@

[PR] feat: add `__getattr__` in stubs [airflow]

2024-05-06 Thread via GitHub
phi-friday opened a new pull request, #39425: URL: https://github.com/apache/airflow/pull/39425 --- The decorator's definition allows dynamic, but they are not defined in the stub file, making it difficult to get help from the IDE. **^ Add meaningful

Re: [PR] feat: soft_fail TriggerDagRunOperator [airflow]

2024-05-06 Thread via GitHub
Taragolis merged PR #39173: URL: https://github.com/apache/airflow/pull/39173 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated (b594a8dcc0 -> eb48911817)

2024-05-06 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from b594a8dcc0 Fix custom actions in security manager `has_access` (#39421) add eb48911817 feat: soft_fail TriggerD

Re: [PR] Add `cloudpickle` as serialiser option for `@task.docker` [airflow]

2024-05-06 Thread via GitHub
bolkedebruin commented on code in PR #39420: URL: https://github.com/apache/airflow/pull/39420#discussion_r1590669801 ## airflow/providers/docker/decorators/docker.py: ## @@ -42,6 +48,41 @@ def _generate_decode_command(env_var, file, python_command): ) +def _load_pickle

Re: [PR] Add `cloudpickle` as serialiser option for `@task.docker` [airflow]

2024-05-06 Thread via GitHub
bolkedebruin commented on code in PR #39420: URL: https://github.com/apache/airflow/pull/39420#discussion_r1590670125 ## airflow/providers/docker/decorators/docker.py: ## @@ -128,9 +190,15 @@ def execute(self, context: Context): @property def pickling_library(self):

Re: [PR] Add `cloudpickle` as serialiser option for `@task.docker` [airflow]

2024-05-06 Thread via GitHub
Taragolis commented on code in PR #39420: URL: https://github.com/apache/airflow/pull/39420#discussion_r1590673738 ## airflow/providers/docker/decorators/docker.py: ## @@ -128,9 +190,15 @@ def execute(self, context: Context): @property def pickling_library(self): Re

Re: [PR] Only heartbeat if necessary in backfill loop [airflow]

2024-05-06 Thread via GitHub
bolkedebruin commented on PR #39399: URL: https://github.com/apache/airflow/pull/39399#issuecomment-2095412078 Can we have a little bit more explanation here that documents what you are changing? In addition the time.sleep(1) is very confusing why that is needed and if it can't be done diff

Re: [PR] add recursive lookup for list of dirs [airflow]

2024-05-06 Thread via GitHub
bolkedebruin commented on PR #39410: URL: https://github.com/apache/airflow/pull/39410#issuecomment-2095418255 @hg1112 not opposing your fix at all, but did you consider using ObjectStoragePath instead of this operator? -- This is an automated message from the Apache Git Service. To resp

Re: [PR] Add unit tests for EksCreateClusterTrigger [airflow]

2024-05-06 Thread via GitHub
eladkal commented on PR #39349: URL: https://github.com/apache/airflow/pull/39349#issuecomment-2095426415 @mateuslatrova can you handle the above comment? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Allow Task Group Ids to be passed as branches in BranchMixIn [airflow]

2024-05-06 Thread via GitHub
eladkal commented on PR #38883: URL: https://github.com/apache/airflow/pull/38883#issuecomment-2095431571 > As an additional question or note: > > I am not sure if I should modify the docstring of the following operators: > > * BaseBranchOperator > * BranchPythonOperator >

(airflow-site) branch 2.9.1-docs created (now a2f7de4e38)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch 2.9.1-docs in repository https://gitbox.apache.org/repos/asf/airflow-site.git at a2f7de4e38 Add documentation for Apache Airflow 2.9.1 This branch includes the following new commi

[PR] Add documentation for Apache Airflow 2.9.1 [airflow-site]

2024-05-06 Thread via GitHub
ephraimbuddy opened a new pull request, #1010: URL: https://github.com/apache/airflow-site/pull/1010 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

svn commit: r68977 - /dev/airflow/providers/ /release/airflow/providers/

2024-05-06 Thread eladkal
Author: eladkal Date: Mon May 6 08:26:26 2024 New Revision: 68977 Log: Release Airflow Providers on 2024-05-06 Added: release/airflow/providers/apache_airflow_providers_airbyte-3.8.0-py3-none-any.whl - copied unchanged from r68976, dev/airflow/providers/apache_airflow_providers_airby

Re: [PR] Add documentation for packages - 2024-05-01 [airflow-site]

2024-05-06 Thread via GitHub
eladkal merged PR #1009: URL: https://github.com/apache/airflow-site/pull/1009 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airfl

(airflow-site) branch add-documentation-2024-05-01 deleted (was 73d806b7ac)

2024-05-06 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2024-05-01 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 73d806b7ac exclude google The revisions that were on this branch are still contained in

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590704500 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@s

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590704995 ## tests/system/providers/pinecone/example_pinecone_cohere.py: ## @@ -44,8 +43,8 @@ def create_index(): from airflow.providers.pinecone.hooks.pinecone impo

[PR] Update providers metadata 2024-05-06 [airflow]

2024-05-06 Thread via GitHub
eladkal opened a new pull request, #39427: URL: https://github.com/apache/airflow/pull/39427 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pu

Re: [I] Status of testing Providers that were prepared on May 01, 2024 [airflow]

2024-05-06 Thread via GitHub
eladkal commented on issue #39346: URL: https://github.com/apache/airflow/issues/39346#issuecomment-2095474542 Thank you everyone. Providers are released. Google, microsoft.azure and pinecone are excluded from this wave. I invite everyone to help improve providers for the next relea

Re: [I] Status of testing Providers that were prepared on May 01, 2024 [airflow]

2024-05-06 Thread via GitHub
eladkal closed issue #39346: Status of testing Providers that were prepared on May 01, 2024 URL: https://github.com/apache/airflow/issues/39346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590723648 ## tests/system/providers/pinecone/example_pinecone_cohere.py: ## @@ -44,8 +43,8 @@ def create_index(): from airflow.providers.pinecone.hooks.pinecone imp

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590724948 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@

Re: [PR] Bugfix yaml parsing for GKEStartKueueInsideClusterOperator [airflow]

2024-05-06 Thread via GitHub
VladaZakharova commented on PR #39234: URL: https://github.com/apache/airflow/pull/39234#issuecomment-2095506052 Hi @eladkal @potiuk ! Can you please check changes here? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

(airflow-site) branch 2.9.1-docs deleted (was a2f7de4e38)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch 2.9.1-docs in repository https://gitbox.apache.org/repos/asf/airflow-site.git was a2f7de4e38 Add documentation for Apache Airflow 2.9.1 The revisions that were on this branch are s

Re: [PR] Add documentation for Apache Airflow 2.9.1 [airflow-site]

2024-05-06 Thread via GitHub
ephraimbuddy merged PR #1010: URL: https://github.com/apache/airflow-site/pull/1010 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590734592 ## airflow/providers/pinecone/operators/pinecone.py: ## @@ -119,7 +119,7 @@ def __init__( pod_type: str | None = None, metadata_config: dict | No

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590740369 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@s

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590740369 ## tests/system/providers/pinecone/example_pinecone_openai.py: ## @@ -75,15 +74,15 @@ start_date=datetime(2023, 1, 1), catchup=False, ) as dag: - -@s

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590741342 ## tests/system/providers/pinecone/example_pinecone_cohere.py: ## @@ -44,8 +43,8 @@ def create_index(): from airflow.providers.pinecone.hooks.pinecone impo

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
sunank200 commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590750505 ## airflow/providers/pinecone/operators/pinecone.py: ## @@ -119,7 +119,7 @@ def __init__( pod_type: str | None = None, metadata_config: dict | Non

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
pankajkoti commented on code in PR #39365: URL: https://github.com/apache/airflow/pull/39365#discussion_r1590759423 ## airflow/providers/pinecone/operators/pinecone.py: ## @@ -119,7 +119,7 @@ def __init__( pod_type: str | None = None, metadata_config: dict | No

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590768674 ## airflow/providers/databricks/operators/databricks.py: ## @@ -926,6 +926,7 @@ class DatabricksNotebookOperator(BaseOperator): """ template_fields = ("not

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590768931 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1041,7 +1044,21 @@ def monitor_databricks_job(self) -> None: run = self._hook.get_run(self.dat

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
Lee-W commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590772660 ## airflow/providers/databricks/operators/databricks.py: ## @@ -926,6 +926,7 @@ class DatabricksNotebookOperator(BaseOperator): """ template_fields = ("note

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590778252 ## airflow/providers/databricks/operators/databricks.py: ## @@ -926,6 +926,7 @@ class DatabricksNotebookOperator(BaseOperator): """ template_fields = ("not

Re: [PR] Fix the pinecone system test [airflow]

2024-05-06 Thread via GitHub
phanikumv merged PR #39365: URL: https://github.com/apache/airflow/pull/39365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated (eb48911817 -> 2481b7df16)

2024-05-06 Thread phanikumv
This is an automated email from the ASF dual-hosted git repository. phanikumv pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from eb48911817 feat: soft_fail TriggerDagRunOperator (#39173) add 2481b7df16 Fix the pinecone system test (#39365)

(airflow-site) 01/01: Announce Apache Airflow 2.9.1 release

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch announce-291 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit a90424a055ac4d8ae082b5c9924e710f67a50aa1 Author: Ephraim Anierobi AuthorDate: Mon May 6 11:15:20 20

(airflow-site) branch announce-291 created (now a90424a055)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch announce-291 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at a90424a055 Announce Apache Airflow 2.9.1 release This branch includes the following new commits:

[PR] Announce Apache Airflow 2.9.1 release [airflow-site]

2024-05-06 Thread via GitHub
ephraimbuddy opened a new pull request, #1011: URL: https://github.com/apache/airflow-site/pull/1011 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

[PR] Fix W605 eks [airflow]

2024-05-06 Thread via GitHub
romsharon98 opened a new pull request, #39428: URL: https://github.com/apache/airflow/pull/39428 closes: https://github.com/apache/airflow/issues/39252 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apac

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
Lee-W commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590821159 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

Re: [I] Status of testing of Apache Airflow 2.9.1rc2 [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy commented on issue #39326: URL: https://github.com/apache/airflow/issues/39326#issuecomment-2095682474 Airflow 2.9.1 has been released. Thank you all for testing this release -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Status of testing of Apache Airflow 2.9.1rc2 [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy closed issue #39326: Status of testing of Apache Airflow 2.9.1rc2 URL: https://github.com/apache/airflow/issues/39326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] Update providers metadata 2024-05-06 [airflow]

2024-05-06 Thread via GitHub
eladkal merged PR #39427: URL: https://github.com/apache/airflow/pull/39427 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated (2481b7df16 -> 98c05af823)

2024-05-06 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 2481b7df16 Fix the pinecone system test (#39365) add 98c05af823 Update providers metadata 2024-05-06 (#39427) No

Re: [PR] Unify lazy db sequence implementations [airflow]

2024-05-06 Thread via GitHub
uranusjr commented on code in PR #39426: URL: https://github.com/apache/airflow/pull/39426#discussion_r1590842956 ## airflow/models/base.py: ## @@ -48,7 +48,10 @@ def _get_schema(): mapper_registry = registry(metadata=metadata) _sentinel = object() -Base: Any = mapper_regist

Re: [PR] Fix W605 eks [airflow]

2024-05-06 Thread via GitHub
Taragolis commented on code in PR #39428: URL: https://github.com/apache/airflow/pull/39428#discussion_r1590866312 ## airflow/providers/amazon/aws/hooks/eks.py: ## @@ -76,7 +76,7 @@ class NodegroupStates(Enum): NONEXISTENT = "NONEXISTENT" -COMMAND = """ +COMMAND = r"""

Re: [PR] Fix Pod Number Exception in the sync mode if reattach_on_restart parameter is False [airflow]

2024-05-06 Thread via GitHub
e-galan commented on code in PR #39329: URL: https://github.com/apache/airflow/pull/39329#discussion_r1590870858 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -105,8 +105,8 @@ class PodEventType(Enum): NORMAL = "Normal" -class PodReattachFailure(AirflowEx

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590872300 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590872300 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

Re: [PR] Refactor `SafeDogStatsdLogger` to use `get_validator` to enable pattern matching [airflow]

2024-05-06 Thread via GitHub
pankajkoti merged PR #39370: URL: https://github.com/apache/airflow/pull/39370 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airfl

Re: [I] Add a pattern-matching support for allow and block list in Datadog metric [airflow]

2024-05-06 Thread via GitHub
pankajkoti closed issue #39368: Add a pattern-matching support for allow and block list in Datadog metric URL: https://github.com/apache/airflow/issues/39368 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(airflow) branch main updated (98c05af823 -> 0c4ffb85b3)

2024-05-06 Thread pankajkoti
This is an automated email from the ASF dual-hosted git repository. pankajkoti pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 98c05af823 Update providers metadata 2024-05-06 (#39427) add 0c4ffb85b3 Refactor `SafeDogStatsdLogger` to use

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
Lee-W commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590888549 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590896494 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

[PR] Use `back_populates` instead of `backref` in bidirectional relationships [airflow]

2024-05-06 Thread via GitHub
Taragolis opened a new pull request, #39430: URL: https://github.com/apache/airflow/pull/39430 [`backref`](https://docs.sqlalchemy.org/en/14/orm/backref.html) is a legacy approach for construct relationships, instead of that preferable way is use [`back_populates`](https://d

Re: [PR] add deferrable support to `DatabricksNotebookOperator` [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #39295: URL: https://github.com/apache/airflow/pull/39295#discussion_r1590896494 ## airflow/providers/databricks/operators/databricks.py: ## @@ -1066,3 +1083,6 @@ def execute(self, context: Context) -> None: self.launch_notebook_job()

Re: [I] Undesired ".execute cannot be called outside TaskInstance!" warning [airflow]

2024-05-06 Thread via GitHub
eladkal commented on issue #39413: URL: https://github.com/apache/airflow/issues/39413#issuecomment-2095815549 cc @dabla WDYT? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[PR] Airflow 2.9.1 has been released [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy opened a new pull request, #39431: URL: https://github.com/apache/airflow/pull/39431 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[PR] Add encryption_configuration parameter to BigQueryCheckOperator and BigQueryTableCheckOperator [airflow]

2024-05-06 Thread via GitHub
molcay opened a new pull request, #39432: URL: https://github.com/apache/airflow/pull/39432 This PR contains adding `encryption_configuration` parameter to the `BigQueryCheckOperator` and `BigQueryTableCheckOperator` to add CMEK key support for these operator.

Re: [PR] Bugfix yaml parsing for GKEStartKueueInsideClusterOperator [airflow]

2024-05-06 Thread via GitHub
eladkal commented on PR #39234: URL: https://github.com/apache/airflow/pull/39234#issuecomment-2095834895 can we have unit test to avoid regression? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] Undesired ".execute cannot be called outside TaskInstance!" warning [airflow]

2024-05-06 Thread via GitHub
Taragolis commented on issue #39413: URL: https://github.com/apache/airflow/issues/39413#issuecomment-2095836354 My 2 cents, this code use internals methods, as result it is expected that this approach could be broken on changes in airflow codebase ```python def deco(cls): o

Re: [PR] Fix Pod Number Exception in the sync mode if reattach_on_restart parameter is False [airflow]

2024-05-06 Thread via GitHub
e-galan commented on PR #39329: URL: https://github.com/apache/airflow/pull/39329#issuecomment-2095847615 > Incorrect use of find_pod is causing this problem. Use the create_pod response object V1Pod for further operations instead of calling the find_pod. And cleanup the existing pods befor

[PR] Chart: Default airflow version to 2.9.1 [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy opened a new pull request, #39433: URL: https://github.com/apache/airflow/pull/39433 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [I] Undesired ".execute cannot be called outside TaskInstance!" warning [airflow]

2024-05-06 Thread via GitHub
dabla commented on issue #39413: URL: https://github.com/apache/airflow/issues/39413#issuecomment-2095892143 > WDYT Seems like the deco method is considered as calling he execute method of the PythonOperator outside of the TaskInstance, this is the protection mechanism which would wa

[I] Wrong schedule for hourly dag [airflow]

2024-05-06 Thread via GitHub
GabrielGomiz opened a new issue, #39435: URL: https://github.com/apache/airflow/issues/39435 ### Apache Airflow version 2.9.0 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? I have several dags that are configured to ru

Re: [PR] Use `back_populates` instead of `sqlalchemy.orm.backref` in bidirectional relationships [airflow]

2024-05-06 Thread via GitHub
Taragolis commented on code in PR #39430: URL: https://github.com/apache/airflow/pull/39430#discussion_r1590962541 ## airflow/models/dag.py: ## @@ -4108,15 +4121,6 @@ def factory(*args, **kwargs): return wrapper -STATICA_HACK = True -globals()["kcah_acitats"[::-1].upper

Re: [PR] fix: use `sqlalchemy_url` property in `get_uri` for postgresql provider [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #38831: URL: https://github.com/apache/airflow/pull/38831#discussion_r1590966792 ## airflow/providers/postgres/hooks/postgres.py: ## @@ -159,6 +172,10 @@ def get_conn(self) -> connection: ]: conn_args[arg_name] = arg_v

Re: [PR] fix: use `sqlalchemy_url` property in `get_uri` for postgresql provider [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #38831: URL: https://github.com/apache/airflow/pull/38831#discussion_r1590966792 ## airflow/providers/postgres/hooks/postgres.py: ## @@ -159,6 +172,10 @@ def get_conn(self) -> connection: ]: conn_args[arg_name] = arg_v

Re: [PR] Add `cloudpickle` as serialiser option for `@task.docker` [airflow]

2024-05-06 Thread via GitHub
Taragolis commented on code in PR #39420: URL: https://github.com/apache/airflow/pull/39420#discussion_r1590971100 ## airflow/providers/docker/decorators/docker.py: ## @@ -42,6 +48,41 @@ def _generate_decode_command(env_var, file, python_command): ) +def _load_pickle():

Re: [I] Undesired ".execute cannot be called outside TaskInstance!" warning [airflow]

2024-05-06 Thread via GitHub
zhaow-de commented on issue #39413: URL: https://github.com/apache/airflow/issues/39413#issuecomment-2095949514 Thanks for the investigation and feedback, @Taragolis and @dabla! Yes, everything still works despite the warning message. I created this issue just as a "preventive" measur

Re: [I] Wrong schedule for hourly dag [airflow]

2024-05-06 Thread via GitHub
tirkarthi commented on issue #39435: URL: https://github.com/apache/airflow/issues/39435#issuecomment-2095954050 Can you please post the dag or a minimal example to reproduce this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] Undesired ".execute cannot be called outside TaskInstance!" warning [airflow]

2024-05-06 Thread via GitHub
dabla commented on issue #39413: URL: https://github.com/apache/airflow/issues/39413#issuecomment-2095961720 > Thanks for the investigation and feedback, @Taragolis and @dabla! > > Yes, everything still works despite the warning message. I created this issue just as a "preventive" mea

Re: [PR] fix: use `sqlalchemy_url` property in `get_uri` for postgresql provider [airflow]

2024-05-06 Thread via GitHub
rawwar commented on code in PR #38831: URL: https://github.com/apache/airflow/pull/38831#discussion_r1590980473 ## airflow/providers/postgres/hooks/postgres.py: ## @@ -159,6 +172,10 @@ def get_conn(self) -> connection: ]: conn_args[arg_name] = arg_v

Re: [I] Wrong schedule for hourly dag [airflow]

2024-05-06 Thread via GitHub
GabrielGomiz commented on issue #39435: URL: https://github.com/apache/airflow/issues/39435#issuecomment-2096007302 ``` #!/usr/bin/python3 from airflow import DAG from datetime import datetime from airflow.operators.bash import BashOperator from airflow.hooks.base impor

[PR] Update note about restarting triggerer proccess [airflow]

2024-05-06 Thread via GitHub
eladkal opened a new pull request, #39436: URL: https://github.com/apache/airflow/pull/39436 The note about the need to reset the triggerer is relevant for the section of writing Triggers not fo the section of writing Deferrable Operators -- This is an automated message from the Apache Gi

Re: [I] Wrong schedule for hourly dag [airflow]

2024-05-06 Thread via GitHub
GabrielGomiz commented on issue #39435: URL: https://github.com/apache/airflow/issues/39435#issuecomment-2096027282 As additional information, I've several other DAGs with hourly schedule definition, but also are incorrectly scheduled on a 4 hour interval, but they are not executing. Last r

Re: [PR] Airflow 2.9.1 has been released [airflow]

2024-05-06 Thread via GitHub
ephraimbuddy merged PR #39431: URL: https://github.com/apache/airflow/pull/39431 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch main updated: Airflow 2.9.1 has been released (#39431)

2024-05-06 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 66e426d878 Airflow 2.9.1 has been released

  1   2   3   >