(airflow) branch main updated: Fix 'implicitly coercing SELECT object to scalar subquery' in latest dag run statement (#37505)

2024-02-18 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 51bd26b56f Fix 'implicitly coercing SELECT objec

Re: [PR] Fix 'implicitly coercing SELECT object to scalar subquery' in latest dag run statement [airflow]

2024-02-18 Thread via GitHub
Taragolis merged PR #37505: URL: https://github.com/apache/airflow/pull/37505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[I] Airflow variable export-import does not include description field [airflow]

2024-02-18 Thread via GitHub
prithvi-git opened a new issue, #37532: URL: https://github.com/apache/airflow/issues/37532 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.6.3 ### What happened? On airflow UI

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
okirialbert commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1494109913 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missi

Re: [I] DatabricksSubmitRunDeferrableOperator runs in timeout when using AAD Token for SPN [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] commented on issue #27830: URL: https://github.com/apache/airflow/issues/27830#issuecomment-1951819077 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] DatabricksSubmitRunDeferrableOperator runs in timeout when using AAD Token for SPN [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] closed issue #27830: DatabricksSubmitRunDeferrableOperator runs in timeout when using AAD Token for SPN URL: https://github.com/apache/airflow/issues/27830 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494088517 ## dev/breeze/src/airflow_breeze/commands/developer_commands.py: ## @@ -640,6 +640,13 @@ def build_docs( for directory in docs_dir.rglob(dir_name):

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494088517 ## dev/breeze/src/airflow_breeze/commands/developer_commands.py: ## @@ -640,6 +640,13 @@ def build_docs( for directory in docs_dir.rglob(dir_name):

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494089005 ## dev/breeze/src/airflow_breeze/commands/developer_commands.py: ## @@ -640,6 +640,13 @@ def build_docs( for directory in docs_dir.rglob(dir_name):

Re: [PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
korolkevich commented on code in PR #37518: URL: https://github.com/apache/airflow/pull/37518#discussion_r1494086360 ## airflow/providers/google/cloud/transfers/s3_to_gcs.py: ## @@ -269,6 +269,7 @@ def transfer_files_async(self, files: list[str], gcs_hook: GCSHook, s3_hook: S3H

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on PR #37176: URL: https://github.com/apache/airflow/pull/37176#issuecomment-1951803492 One potential thing we might want to figure out and maybe put into the release note, what happens if the user upgrades Airflow (and thus receives this endpoint addition) but does not u

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494075462 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -493,6 +510,13 @@ cd "${AIRFLOW_REPO_ROOT}" breeze build-docs apache-airflow-providers cncf.kubernetes sftp --clean-

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494075799 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -493,6 +510,13 @@ cd "${AIRFLOW_REPO_ROOT}" breeze build-docs apache-airflow-providers cncf.kubernetes sftp --clean-

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on code in PR #37502: URL: https://github.com/apache/airflow/pull/37502#discussion_r1494075462 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -493,6 +510,13 @@ cd "${AIRFLOW_REPO_ROOT}" breeze build-docs apache-airflow-providers cncf.kubernetes sftp --clean-

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1494074992 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -124,3 +131,167 @@ def get_dataset_events( return dataset_event_collection_schema.dump( D

[PR] Adding missing --answer to breeze build-docs [airflow]

2024-02-18 Thread via GitHub
amoghrajesh opened a new pull request, #37530: URL: https://github.com/apache/airflow/pull/37530 The breeze documentation while running the commands shows: ``` ➜ airflow git:(addOptionAnswer) ✗ breeze build-docs mongo Good version of Docker: 24.0.2. Good version o

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
pankajastro commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1494070490 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missi

Re: [PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
pankajastro commented on code in PR #37518: URL: https://github.com/apache/airflow/pull/37518#discussion_r1494067320 ## airflow/providers/google/cloud/transfers/s3_to_gcs.py: ## @@ -269,6 +269,7 @@ def transfer_files_async(self, files: list[str], gcs_hook: GCSHook, s3_hook: S3H

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-18 Thread via GitHub
Lee-W commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1494049554 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -124,3 +131,167 @@ def get_dataset_events( return dataset_event_collection_schema.dump( Data

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1494039476 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -124,3 +131,167 @@ def get_dataset_events( return dataset_event_collection_schema.dump( D

Re: [PR] add endpoint to delete DatasetDagRunQueue [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37176: URL: https://github.com/apache/airflow/pull/37176#discussion_r1494039476 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -124,3 +131,167 @@ def get_dataset_events( return dataset_event_collection_schema.dump( D

Re: [PR] Filter Datasets by associated dag_ids (GET /datasets) [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on PR #37512: URL: https://github.com/apache/airflow/pull/37512#issuecomment-1951738404 I wonder if it’s clear enough to call this just `dag_ids`, or should a more descriptive name be used, say `comsuming_dag_ids`. -- This is an automated message from the Apache Git Ser

[PR] Add Bolke as owner to Airflow FS modules [airflow]

2024-02-18 Thread via GitHub
uranusjr opened a new pull request, #37529: URL: https://github.com/apache/airflow/pull/37529 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e

Re: [PR] Filter Datasets by associated dag_ids (GET /datasets) [airflow]

2024-02-18 Thread via GitHub
Satoshi-Sh commented on code in PR #37512: URL: https://github.com/apache/airflow/pull/37512#discussion_r1494027417 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -74,7 +77,13 @@ def get_datasets( total_entries = session.scalars(select(func.count(DatasetMod

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37524: URL: https://github.com/apache/airflow/pull/37524#discussion_r1494023527 ## airflow/providers/common/io/xcom/backend.py: ## @@ -152,7 +152,7 @@ def deserialize_value( try: p = ObjectStoragePath(path) / XComObjectSt

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37524: URL: https://github.com/apache/airflow/pull/37524#discussion_r1494022774 ## tests/io/test_path.py: ## @@ -60,34 +89,39 @@ def get_fs_no_storage_options(_: str): class TestFs: def setup_class(self): self._store_cache = _STOR

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
uranusjr commented on code in PR #37524: URL: https://github.com/apache/airflow/pull/37524#discussion_r1494021929 ## tests/providers/common/io/xcom/test_backend.py: ## @@ -181,7 +182,7 @@ def test_value_storage(self, task_instance, session): run_id=task_instance.run

Re: [PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
korolkevich commented on code in PR #37518: URL: https://github.com/apache/airflow/pull/37518#discussion_r1494021457 ## airflow/providers/google/cloud/transfers/s3_to_gcs.py: ## @@ -269,6 +269,7 @@ def transfer_files_async(self, files: list[str], gcs_hook: GCSHook, s3_hook: S3H

Re: [PR] Enhancing breeze commands with PACKAGE_LIST env variable [airflow]

2024-02-18 Thread via GitHub
amoghrajesh commented on PR #37502: URL: https://github.com/apache/airflow/pull/37502#issuecomment-1951655532 @eladkal can you take a look at this PR when you have some time? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Revoking audit_log permission from all users except admin [airflow]

2024-02-18 Thread via GitHub
amoghrajesh commented on PR #37501: URL: https://github.com/apache/airflow/pull/37501#issuecomment-1951654300 Thanks for the reviews! @potiuk / @eladkal pushed a newsfragment @jedcunningham nits handled -- This is an automated message from the Apache Git Service. To respond to the m

Re: [PR] Revoking audit_log permission from all users except admin [airflow]

2024-02-18 Thread via GitHub
amoghrajesh commented on code in PR #37501: URL: https://github.com/apache/airflow/pull/37501#discussion_r1493975862 ## docs/apache-airflow/security/security_model.rst: ## @@ -134,6 +139,14 @@ Regular users They can view and interact with the UI and API. They are able to view a

[PR] Flower probe config [airflow]

2024-02-18 Thread via GitHub
Seokyun-Ha opened a new pull request, #37528: URL: https://github.com/apache/airflow/pull/37528 I want to control flower probe configuration on helm values file. Because, I think that the flower probe period is too often (`5s`), and I want to customize it 🙏 Please,

Re: [PR] Filter Datasets by associated dag_ids (GET /datasets) [airflow]

2024-02-18 Thread via GitHub
dirrao commented on code in PR #37512: URL: https://github.com/apache/airflow/pull/37512#discussion_r1493964274 ## airflow/api_connexion/endpoints/dataset_endpoint.py: ## @@ -74,7 +77,13 @@ def get_datasets( total_entries = session.scalars(select(func.count(DatasetModel.i

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
okirialbert commented on PR #37519: URL: https://github.com/apache/airflow/pull/37519#issuecomment-1951624806 The service had minor deprecating changes I opted to take care of that were relating to #36484 -- This is an automated message from the Apache Git Service. To respond to the messa

[PR] Change margin to padding so first task can be selected [airflow]

2024-02-18 Thread via GitHub
vchiapaikeo opened a new pull request, #37527: URL: https://github.com/apache/airflow/pull/37527 Right now, selecting the first task is difficult due to additional margin from the [TaskName refactor](https://github.com/apache/airflow/pull/37254) that covers it up. You can se

Re: [I] execution_timeout not enforced, task hangs up [airflow]

2024-02-18 Thread via GitHub
kurtqq commented on issue #35474: URL: https://github.com/apache/airflow/issues/35474#issuecomment-1951598471 @Taragolis was wondering if you have a patch/workaround for this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

(airflow) branch constraints-main updated: Updating constraints. Github run id:7953536942

2024-02-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 256ded673d Updating con

(airflow) branch main updated: Fix broken hyperlink (#37526)

2024-02-18 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new aaec84221e Fix broken hyperlink (#37526) aaec842

Re: [PR] Fix broken hyperlink [airflow]

2024-02-18 Thread via GitHub
Taragolis merged PR #37526: URL: https://github.com/apache/airflow/pull/37526 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

Re: [I] Fix remaining D105 checks: Missing docstring in magic method [airflow]

2024-02-18 Thread via GitHub
manikanta1213 commented on issue #37523: URL: https://github.com/apache/airflow/issues/37523#issuecomment-1951561334 @Taragolis I'm interested in working on this. Can you please assign this to me? -- This is an automated message from the Apache Git Service. To respond to the message, plea

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
eladkal commented on PR #37519: URL: https://github.com/apache/airflow/pull/37519#issuecomment-1951525606 The list of files that needs to be fixed is in: https://github.com/apache/airflow/blob/e5688b9ae9556f3e6da3b55437bea803fd0bb444/.pre-commit-config.yaml#L328-L335 Thus like

[PR] Fix broken hyperlink [airflow]

2024-02-18 Thread via GitHub
Satoshi-Sh opened a new pull request, #37526: URL: https://github.com/apache/airflow/pull/37526 ## Description Fixed the broken url --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main

Re: [PR] Make Dag pause as a separate role from edit [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] commented on PR #36565: URL: https://github.com/apache/airflow/pull/36565#issuecomment-1951496941 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Move fs scheme definition from Python to YAML [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] commented on PR #35972: URL: https://github.com/apache/airflow/pull/35972#issuecomment-1951496973 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [I] UI: DAG Conf Parameters Form - Param Type of Boolean, Null converted to String for JSON config [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] commented on issue #36369: URL: https://github.com/apache/airflow/issues/36369#issuecomment-1951496958 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] UI: DAG Conf Parameters Form - Param Type of Boolean, Null converted to String for JSON config [airflow]

2024-02-18 Thread via GitHub
github-actions[bot] closed issue #36369: UI: DAG Conf Parameters Form - Param Type of Boolean, Null converted to String for JSON config URL: https://github.com/apache/airflow/issues/36369 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] Fix all deprecations for SQLAlchemy 2.0 [airflow]

2024-02-18 Thread via GitHub
Dev-iL commented on issue #28723: URL: https://github.com/apache/airflow/issues/28723#issuecomment-1951460606 @potiuk Sure thing, will ping when ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] Fix all deprecations for SQLAlchemy 2.0 [airflow]

2024-02-18 Thread via GitHub
potiuk commented on issue #28723: URL: https://github.com/apache/airflow/issues/28723#issuecomment-1951454071 Why don you make a PR for that @Dev-iL ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
romsharon98 commented on PR #37519: URL: https://github.com/apache/airflow/pull/37519#issuecomment-1951451185 can u explain the purpose of this PR? In this issue https://github.com/apache/airflow/issues/36484 [cloud_storage_transfer_service.py](https://github.com/apache/airflow/issues/

Re: [PR] Remove usage of deprecated `flask._request_ctx_stack` [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on PR #37522: URL: https://github.com/apache/airflow/pull/37522#issuecomment-1951449155 I guess so, this implementation based on very old vendored code and in addition it use [`kerberos`](https://github.com/apple/ccs-pykerberos) which doesn’t updated for a while.

Re: [PR] Escape html in connection form [airflow]

2024-02-18 Thread via GitHub
chrfoyer commented on code in PR #37516: URL: https://github.com/apache/airflow/pull/37516#discussion_r1493844281 ## tests/www/views/test_views_connection.py: ## @@ -443,3 +443,31 @@ def test_process_form_invalid_extra_removed(admin_client): conn = session.get(Connectio

Re: [PR] Remove usage of deprecated `flask._request_ctx_stack` [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37522: URL: https://github.com/apache/airflow/pull/37522#issuecomment-195154 I'd even consider removing the whole deprecated client auth in 2.9 (since it was experimental from the very beginning) i thinl we should be able to do just that (especially that we have

Re: [PR] Make ImapHook mail body encoding configurable [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37517: URL: https://github.com/apache/airflow/pull/37517#issuecomment-1951443285 Usually we expect unit tests modified whenever any new functionality is added. Can you add one please? It seems imap has quite comprehensive set of tests and it should be possible to add

Re: [PR] Escape html in connection form [airflow]

2024-02-18 Thread via GitHub
chrfoyer commented on code in PR #37516: URL: https://github.com/apache/airflow/pull/37516#discussion_r1493842216 ## tests/www/views/test_views_connection.py: ## @@ -443,3 +443,31 @@ def test_process_form_invalid_extra_removed(admin_client): conn = session.get(Connectio

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37524: URL: https://github.com/apache/airflow/pull/37524#issuecomment-1951441555 Also installing `pre-commit` and running `pre-commit install` is a good idea - this way all static checks will be locally run for you before you commit anything giving you a quick feedba

Re: [PR] Escape html in connection form [airflow]

2024-02-18 Thread via GitHub
hussein-awala commented on code in PR #37516: URL: https://github.com/apache/airflow/pull/37516#discussion_r1493841712 ## tests/www/views/test_views_connection.py: ## @@ -443,3 +443,31 @@ def test_process_form_invalid_extra_removed(admin_client): conn = session.get(Conn

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37524: URL: https://github.com/apache/airflow/pull/37524#issuecomment-1951441178 (I approved/run) the tests BTW. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37524: URL: https://github.com/apache/airflow/pull/37524#issuecomment-1951441014 Cool. > Also, if a core developer can point me to the easiest way to run the relevant parts of the test suite on an M2 mac that would be wonderful ❤️ This should be rather e

Re: [PR] Escape html in connection form [airflow]

2024-02-18 Thread via GitHub
chrfoyer commented on PR #37516: URL: https://github.com/apache/airflow/pull/37516#issuecomment-1951440689 > We have a module to test the connection view, could you add some tests for this change? https://github.com/apache/airflow/blob/main/tests/www/views/test_views_connection.py Th

[PR] Add swagger path to FAB Auth manager and Internal API [airflow]

2024-02-18 Thread via GitHub
Taragolis opened a new pull request, #37525: URL: https://github.com/apache/airflow/pull/37525 closes: #36975 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
ap-- commented on PR #37524: URL: https://github.com/apache/airflow/pull/37524#issuecomment-1951429536 Also, if a core developer can point me to the easiest way to run the relevant parts of the test suite on an M2 mac that would be wonderful ❤️ -- This is an automated message from the Ap

Re: [PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
boring-cyborg[bot] commented on PR #37524: URL: https://github.com/apache/airflow/pull/37524#issuecomment-1951428692 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors'

[PR] Update ObjectStoragePath for universal_pathlib>=v0.2.1 [airflow]

2024-02-18 Thread via GitHub
ap-- opened a new pull request, #37524: URL: https://github.com/apache/airflow/pull/37524 closes: #37067 related: #36546 This PR adjusts the `airflow.io.path.ObjectStoragePath` implementation to support the new `universal_pathlib>=0.2.1`. Functionality shou

(airflow) branch main updated: Add telegram connection with documnetation (#37515)

2024-02-18 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e5688b9ae9 Add telegram connection with documnetat

Re: [PR] Add telegram connection with documnetation [airflow]

2024-02-18 Thread via GitHub
eladkal merged PR #37515: URL: https://github.com/apache/airflow/pull/37515 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[I] Fix remaining D105 checks: Missing docstring in magic method [airflow]

2024-02-18 Thread via GitHub
Taragolis opened a new issue, #37523: URL: https://github.com/apache/airflow/issues/37523 ### Body Part of https://github.com/apache/airflow/issues/10742. Recently we enable [D105](https://docs.astral.sh/ruff/rules/undocumented-magic-method/) pydocstyle rule, however we still have so

Re: [PR] Add telegram connection with documnetation [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on code in PR #37515: URL: https://github.com/apache/airflow/pull/37515#discussion_r1493820128 ## airflow/providers/telegram/provider.yaml: ## @@ -52,6 +52,7 @@ integrations: external-doc-url: https://telegram.org/ how-to-guide: - /docs/apach

Re: [PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on code in PR #37518: URL: https://github.com/apache/airflow/pull/37518#discussion_r1493809910 ## airflow/providers/google/cloud/transfers/s3_to_gcs.py: ## @@ -269,6 +269,7 @@ def transfer_files_async(self, files: list[str], gcs_hook: GCSHook, s3_hook: S3H

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on PR #37519: URL: https://github.com/apache/airflow/pull/37519#issuecomment-1951389283 And also required adopt failing tests -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1493806450 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missing

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1493806450 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missing

Re: [I] UI - xcom - order by Execution Date [airflow]

2024-02-18 Thread via GitHub
lurcio commented on issue #33100: URL: https://github.com/apache/airflow/issues/33100#issuecomment-1951385227 I'd like to look into this one as my first issue please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
okirialbert commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1493806253 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missi

(airflow) branch constraints-main updated: Updating constraints. Github run id:7950138454

2024-02-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 37dfbe3a3c Updating con

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
pankajastro commented on code in PR #37519: URL: https://github.com/apache/airflow/pull/37519#discussion_r1493804426 ## airflow/providers/google/cloud/operators/cloud_storage_transfer_service.py: ## @@ -556,24 +556,24 @@ def __init__( TypeError("__init__() missi

Re: [PR] Remove usage of deprecated `flask._request_ctx_stack` [airflow]

2024-02-18 Thread via GitHub
Taragolis commented on code in PR #37522: URL: https://github.com/apache/airflow/pull/37522#discussion_r1493801764 ## airflow/api/auth/backend/kerberos_auth.py: ## @@ -64,16 +63,19 @@ log = logging.getLogger(__name__) -CLIENT_AUTH: tuple[str, str] | Any | None = HTTPKerbero

[PR] Remove usage of deprecated `flask._request_ctx_stack` [airflow]

2024-02-18 Thread via GitHub
Taragolis opened a new pull request, #37522: URL: https://github.com/apache/airflow/pull/37522 This one was removed into the Flask 3.0. We only use in in [vendored kerberos auth backend](https://github.com/deshaw/flask-kerberos/blob/master/flask_kerberos.py). > [!WARN

(airflow) branch main updated (6412b06a7b -> 77c2120afb)

2024-02-18 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 6412b06a7b Fix KPO task hanging when pod fails to start within specified timeout (#37514) add 77c2120afb Update

Re: [PR] Update providers metadata 2024-02-18 [airflow]

2024-02-18 Thread via GitHub
eladkal merged PR #37520: URL: https://github.com/apache/airflow/pull/37520 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

[PR] Prepare docs 1st wave (RC3) of Providers February 2024 [airflow]

2024-02-18 Thread via GitHub
eladkal opened a new pull request, #37521: URL: https://github.com/apache/airflow/pull/37521 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [I] Status of testing Providers that were prepared on February 17, 2024 [airflow]

2024-02-18 Thread via GitHub
eladkal closed issue #37504: Status of testing Providers that were prepared on February 17, 2024 URL: https://github.com/apache/airflow/issues/37504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] Status of testing Providers that were prepared on February 17, 2024 [airflow]

2024-02-18 Thread via GitHub
eladkal commented on issue #37504: URL: https://github.com/apache/airflow/issues/37504#issuecomment-1951369037 Thank you everyone. Providers are released. `cncf.kubernetes` is excluded and RC3 will follow shortly. I invite everyone to help improve providers for the next release, a l

[PR] Update providers metadata 2024-02-18 [airflow]

2024-02-18 Thread via GitHub
eladkal opened a new pull request, #37520: URL: https://github.com/apache/airflow/pull/37520 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

Re: [PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
okirialbert commented on PR #37519: URL: https://github.com/apache/airflow/pull/37519#issuecomment-1951367537 @romsharon98 Kindly review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

(airflow) annotated tag providers-amazon/8.18.0 updated (75182363a2 -> 310d7391ed)

2024-02-18 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-amazon/8.18.0 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-amazon/8.18.0 was modified! *** from 75182363a2 (commit) to 310

(airflow) annotated tag providers-common-sql/1.11.0 updated (75182363a2 -> 483f418a52)

2024-02-18 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to annotated tag providers-common-sql/1.11.0 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-common-sql/1.11.0 was modified! *** from 75182363a2 (commit)

(airflow-site) branch add-documentation-2024-02-17 deleted (was cbf038a3b6)

2024-02-18 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a change to branch add-documentation-2024-02-17 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was cbf038a3b6 Exclude cncf-k8s from release The revisions that were on this branch are stil

Re: [PR] Add documentation for packages - 2024-02-17 [airflow-site]

2024-02-18 Thread via GitHub
eladkal merged PR #959: URL: https://github.com/apache/airflow-site/pull/959 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

svn commit: r67407 - /dev/airflow/providers/ /release/airflow/providers/

2024-02-18 Thread eladkal
Author: eladkal Date: Sun Feb 18 15:46:26 2024 New Revision: 67407 Log: Release Airflow Providers on 2024-02-18 Added: release/airflow/providers/apache_airflow_providers_amazon-8.18.0-py3-none-any.whl - copied unchanged from r67406, dev/airflow/providers/apache_airflow_providers_amazo

[PR] templated fields logic checks for cloud_storage_transfer_service [airflow]

2024-02-18 Thread via GitHub
okirialbert opened a new pull request, #37519: URL: https://github.com/apache/airflow/pull/37519 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rs

Re: [PR] [WIP] Pinecone provider support for `pinecone-client`>=3 [airflow]

2024-02-18 Thread via GitHub
pankajastro commented on code in PR #37307: URL: https://github.com/apache/airflow/pull/37307#discussion_r1493785686 ## airflow/providers/pinecone/hooks/pinecone.py: ## @@ -135,118 +132,98 @@ def upsert( ) @staticmethod +def get_pod_spec_obj(environment, repl

Re: [I] No forbidden error when user who doesn’t have access to deployment.airflow.importError.get [airflow]

2024-02-18 Thread via GitHub
sreenusuuda commented on issue #37492: URL: https://github.com/apache/airflow/issues/37492#issuecomment-1951346149 @potiuk I apologize for not noticing your comment on the other issue earlier. This is my first time reporting an issue on a public repository. I will ensure to prioritize secur

Re: [PR] Create GKEStartKueueJobOperator operator [airflow]

2024-02-18 Thread via GitHub
pankajastro commented on code in PR #37477: URL: https://github.com/apache/airflow/pull/37477#discussion_r1493775235 ## airflow/providers/google/cloud/operators/kubernetes_engine.py: ## @@ -898,3 +898,36 @@ def execute(self, context: Context): ).fetch_cluster_info()

Re: [PR] Revoking audit_log permission from all users except admin [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37501: URL: https://github.com/apache/airflow/pull/37501#issuecomment-1951339634 When we separated FAB provider right after we created 2.8.0 - this was what we agreed to with @vincbeck - that security related and small fixeds will be cherry picked to 2.8.* airflow co

Re: [PR] Revoking audit_log permission from all users except admin [airflow]

2024-02-18 Thread via GitHub
potiuk commented on PR #37501: URL: https://github.com/apache/airflow/pull/37501#issuecomment-1951339266 No. This issue can be cherry-picked to 2.8.2 to the place where Fab was previously. We've already done that -- This is an automated message from the Apache Git Service. To respond to t

Re: [I] No forbidden error when user who doesn’t have access to deployment.airflow.importError.get [airflow]

2024-02-18 Thread via GitHub
potiuk closed issue #37492: No forbidden error when user who doesn’t have access to deployment.airflow.importError.get URL: https://github.com/apache/airflow/issues/37492 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

Re: [I] No forbidden error when user who doesn’t have access to deployment.airflow.importError.get [airflow]

2024-02-18 Thread via GitHub
potiuk commented on issue #37492: URL: https://github.com/apache/airflow/issues/37492#issuecomment-1951338626 Can you please - as mentioned before report security related issues in a way that is explained in our security policy and NOT as public issues? This is quite irresponsive behaviour

Re: [PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
boring-cyborg[bot] commented on PR #37518: URL: https://github.com/apache/airflow/pull/37518#issuecomment-1951332919 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors'

[PR] Fix credentials error for S3ToGCSOperator trigger [airflow]

2024-02-18 Thread via GitHub
korolkevich opened a new pull request, #37518: URL: https://github.com/apache/airflow/pull/37518 closes: #37331 Add gcd_conn_id for S3ToGCSOperator trigger -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

(airflow) branch main updated: Fix KPO task hanging when pod fails to start within specified timeout (#37514)

2024-02-18 Thread pankaj
This is an automated email from the ASF dual-hosted git repository. pankaj pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 6412b06a7b Fix KPO task hanging when pod fails to s

  1   2   >