Re: [PR] Add code snippet formatting in docstrings via Ruff [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36262: URL: https://github.com/apache/airflow/pull/36262#issuecomment-1859068983 > Am I reading that correctly? You can check it by wrong-formating some of those :) -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] K8S Spark Operator doesn't delete an older application with the same name anymore [airflow]

2023-12-17 Thread via GitHub
JavadHosseini commented on issue #32363: URL: https://github.com/apache/airflow/issues/32363#issuecomment-1859073622 @blcksrx Hi, We have the same problem after upgrading airflow. Do you have any estimated time of fixing this issue? -- This is an automated message from the Apache Git S

Re: [PR] Add `pod_template_dict` field to `KubernetesPodOperator` [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #33174: URL: https://github.com/apache/airflow/pull/33174#discussion_r1429096075 ## tests/providers/cncf/kubernetes/operators/test_pod.py: ## @@ -28,6 +28,7 @@ from urllib3 import HTTPResponse from airflow.exceptions import AirflowException, A

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-17 Thread via GitHub
pateash commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1859132688 ## **RCA** user_id is coming as 'None':, The error message indicates that **user_id** is being passed as the string '**None**', which is invalid for an integer field in t

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-17 Thread via GitHub
pateash commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1859133868 The issue here is , https://github.com/apache/airflow/assets/16856802/3424fbde-2f80-4d14-9a74-cabf43df93c3";> user_id is a foreign key from **ab_user** table, so wh

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-17 Thread via GitHub
pateash commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1859177684 looks like we should be able to insert null here, moving forward by inserting null, we can revisit if there is any objection. https://github.com/apache/airflow/assets/16856

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-17 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1428247519 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -241,13 +258,17 @@ def run( else: return results -@staticmethod -def

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-17 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1428246056 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -241,13 +258,17 @@ def run( else: return results -@staticmethod -def

Re: [PR] Make databricks sql hook return a namedtuple [airflow]

2023-12-17 Thread via GitHub
Joffreybvn commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1859197530 Update on this PR: - I removed all mention of serialization / serializable for clarity. Docstring and methods are now speaking about "common data structure". - The new `_make_co

Re: [PR] Add code snippet formatting in docstrings via Ruff [airflow]

2023-12-17 Thread via GitHub
josh-fell commented on PR #36262: URL: https://github.com/apache/airflow/pull/36262#issuecomment-1859200879 > This _might_ also remove the need for `blacken-docs` inferring from this comment from the [release notes of what this new version of Ruff Formatter supports](https://astral.sh/blog/

Re: [PR] Update permission docs [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36120: URL: https://github.com/apache/airflow/pull/36120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Update permission docs (#36120)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f7f7183617 Update permission docs (#36120) f7f71836

Re: [I] Airflow stops tracking pod with xcom_sidecar container [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on issue #36218: URL: https://github.com/apache/airflow/issues/36218#issuecomment-1859207177 After 7.3.0, we released 11 releases and some of them contain bug fixes related to xcom_push, could you try to upgrade the version of `apache-airflow-providers-cncf-kubernete

svn commit: r66102 - /dev/airflow/providers/

2023-12-17 Thread potiuk
Author: potiuk Date: Sun Dec 17 15:58:19 2023 New Revision: 66102 Log: Remove ignored RC releases Removed: dev/airflow/providers/apache_airflow_providers_databricks-5.1.0-py3-none-any.whl dev/airflow/providers/apache_airflow_providers_databricks-5.1.0-py3-none-any.whl.asc dev/airfl

Re: [I] pause/unpause dag logs wrong event status [airflow]

2023-12-17 Thread via GitHub
eladkal closed issue #31871: pause/unpause dag logs wrong event status URL: https://github.com/apache/airflow/issues/31871 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] pause/unpause dag logs wrong event status [airflow]

2023-12-17 Thread via GitHub
eladkal commented on issue #31871: URL: https://github.com/apache/airflow/issues/31871#issuecomment-1859213115 Solved in https://github.com/apache/airflow/pull/36182 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] Glue job not updating on iam_role_arn change GlueJobOperator/GlueJobHook [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on issue #36203: URL: https://github.com/apache/airflow/issues/36203#issuecomment-1859214239 I just checked the code source for this operator and its hook. Did you try to provide `update_config=True` to your operator? > :param update_config: If True, Operator will

Re: [I] Glue job not updating on iam_role_arn change GlueJobOperator/GlueJobHook [airflow]

2023-12-17 Thread via GitHub
hussein-awala closed issue #36203: Glue job not updating on iam_role_arn change GlueJobOperator/GlueJobHook URL: https://github.com/apache/airflow/issues/36203 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Add use_glob to GCSObjectExistenceSensor [airflow]

2023-12-17 Thread via GitHub
A-Costa commented on PR #34137: URL: https://github.com/apache/airflow/pull/34137#issuecomment-1859217555 I've added the missing test for GCSBlobTrigger and removed WIP from the title, as this is ready to be reviewed. > You'll need also to bump `gcloud-aio` version in `provider.ya

Re: [I] dag_processing.processes should be a gauge, not a counter [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on issue #36188: URL: https://github.com/apache/airflow/issues/36188#issuecomment-1859218428 @Jeoffreybauvin Defining `dag_processing.processes` as a gauge is not simple because it's relative, so we use `increment` and `decrement` to update it, and these methods are

(airflow) branch constraints-main updated: Updating constraints. Github run id:7239470716

2023-12-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new da9fa7b6fb Updating con

svn commit: r66103 - /dev/airflow/providers/ /release/airflow/providers/

2023-12-17 Thread potiuk
Author: potiuk Date: Sun Dec 17 16:42:59 2023 New Revision: 66103 Log: Release Airflow Providers on 2023-12-17 Added: release/airflow/providers/apache_airflow_providers_daskexecutor-1.1.1-py3-none-any.whl - copied unchanged from r66102, dev/airflow/providers/apache_airflow_providers_d

Re: [I] dag_processing.processes should be a gauge, not a counter [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on issue #36188: URL: https://github.com/apache/airflow/issues/36188#issuecomment-1859223334 I just checked OTEL code source and found that it doesn't allow negative results in all its counters (including `UpDownCounter`, which we use); maybe we need to implement a c

[PR] Fix few caveats in provider rlease process [airflow]

2023-12-17 Thread via GitHub
potiuk opened a new pull request, #36264: URL: https://github.com/apache/airflow/pull/36264 There were few small problems in release process: 1) When the SVN directories were in symbolically linked directories, svn got into locked directory status 2) Cleaning old relases faile

(airflow) annotated tag providers-odbc/4.3.0 updated (64931b1a65 -> f60f9a5fb8)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to annotated tag providers-odbc/4.3.0 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-odbc/4.3.0 was modified! *** from 64931b1a65 (commit) to f60f9a5fb8

(airflow) annotated tag providers-docker/3.9.0 updated (64931b1a65 -> 3f0d329843)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to annotated tag providers-docker/3.9.0 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-docker/3.9.0 was modified! *** from 64931b1a65 (commit) to 3f0d32

(airflow) annotated tag providers-daskexecutor/1.1.1 updated (64931b1a65 -> e1812ec042)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to annotated tag providers-daskexecutor/1.1.1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag providers-daskexecutor/1.1.1 was modified! *** from 64931b1a65 (commit)

[PR] Update providers metadata 2023-12-17 [airflow]

2023-12-17 Thread via GitHub
potiuk opened a new pull request, #36265: URL: https://github.com/apache/airflow/pull/36265 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)*

Re: [I] dag_run.get_previous_dagrun() returning wrong dag_run with manual DAG triggering [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on issue #36178: URL: https://github.com/apache/airflow/issues/36178#issuecomment-1859229094 Here are some concepts in Airflow: - There is a difference between the dag run logical date and starting date; the first one represents the start interval date in the sched

Re: [I] dag_run.get_previous_dagrun() returning wrong dag_run with manual DAG triggering [airflow]

2023-12-17 Thread via GitHub
hussein-awala closed issue #36178: dag_run.get_previous_dagrun() returning wrong dag_run with manual DAG triggering URL: https://github.com/apache/airflow/issues/36178 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
potiuk opened a new pull request, #36267: URL: https://github.com/apache/airflow/pull/36267 There are few steps missing in the provider release process if you followed it meticulously - the working directory was not changed to the AIRFLOW_ROOT and main should be checked out right before we

Re: [PR] Add documentation for packages - 2023-12-12 [airflow-site]

2023-12-17 Thread via GitHub
potiuk merged PR #908: URL: https://github.com/apache/airflow-site/pull/908 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

Re: [PR] Update providers metadata 2023-12-17 [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36265: URL: https://github.com/apache/airflow/pull/36265#issuecomment-1859232282 Yeah. Something is odd here :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] Add code snippet formatting in docstrings via Ruff [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36262: URL: https://github.com/apache/airflow/pull/36262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add code snippet formatting in docstrings via Ruff (#36262)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e9ba37bb58 Add code snippet formatting in docstring

[PR] k8s spark operator compatibility [airflow]

2023-12-17 Thread via GitHub
blcksrx opened a new pull request, #36268: URL: https://github.com/apache/airflow/pull/36268 Changes in this PR: - Added `override_existing` argument with default to the operator. - Uses the K8S application `uid` instead of naming --- **^ Add meaningful

[PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk opened a new pull request, #36269: URL: https://github.com/apache/airflow/pull/36269 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)*

Re: [PR] Add `pod_template_dict` field to `KubernetesPodOperator` [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #33174: URL: https://github.com/apache/airflow/pull/33174#discussion_r1429222336 ## tests/providers/cncf/kubernetes/operators/test_pod.py: ## @@ -28,6 +28,7 @@ from urllib3 import HTTPResponse from airflow.exceptions import AirflowException, A

Re: [PR] Update yarn to yarnpkg to avoid conflicts with Hadoop [airflow-site]

2023-12-17 Thread via GitHub
pierrejeambrun commented on PR #910: URL: https://github.com/apache/airflow-site/pull/910#issuecomment-1859234914 I would say that this is specific to your installation and that the doc does not need to be updated. It is obvious to which `yarn` we are referencing in this guide, but w

Re: [PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
hussein-awala commented on code in PR #36269: URL: https://github.com/apache/airflow/pull/36269#discussion_r1429222924 ## .github/boring-cyborg.yml: ## @@ -183,21 +183,16 @@ labelPRBasedOnFilePath: - tests/providers/common/sql/**/* - tests/system/providers/common/sql/*

Re: [PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #36269: URL: https://github.com/apache/airflow/pull/36269#discussion_r1429223043 ## docs/spelling_wordlist.txt: ## @@ -359,7 +359,6 @@ DagRunState DAGs Dask dask Review Comment: can we remove these too? -- This is an automated message f

Re: [PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #36269: URL: https://github.com/apache/airflow/pull/36269#discussion_r1429223203 ## scripts/ci/pre_commit/pre_commit_insert_extras.py: ## @@ -45,13 +45,6 @@ CONSTANTS_HEADER = "# START EXTRAS HERE" CONSTANTS_FOOTER = "# END EXTRAS HERE" -DEFAUL

Re: [PR] Update providers metadata 2023-12-17 [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on PR #36265: URL: https://github.com/apache/airflow/pull/36265#issuecomment-1859235795 šŸ‘€ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #36269: URL: https://github.com/apache/airflow/pull/36269#discussion_r1429224455 ## .github/boring-cyborg.yml: ## @@ -183,21 +183,16 @@ labelPRBasedOnFilePath: - tests/providers/common/sql/**/* - tests/system/providers/common/sql/**/* -

(airflow-site) branch gh-pages updated (ec515eef74 -> 67e709f0b5)

2023-12-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard ec515eef74 Rewritten history to remove past gh-pages deployments new 67e709f0b5 Rewritten history to

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429224373 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```shell scr

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429224764 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```shell scri

Re: [PR] Rmeove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #36269: URL: https://github.com/apache/airflow/pull/36269#discussion_r1429224978 ## docs/spelling_wordlist.txt: ## @@ -359,7 +359,6 @@ DagRunState DAGs Dask dask Review Comment: Yeah. We can't even remove `daskexecutor` because of release no

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429225303 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```shell scr

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429226210 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```sh

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
eladkal commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429229259 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```shell scr

Re: [PR] allows users to write dag_id and task_id in their national characters, added display name for dag / task [airflow]

2023-12-17 Thread via GitHub
pierrejeambrun commented on PR #32520: URL: https://github.com/apache/airflow/pull/32520#issuecomment-1859240356 > I will try on this but Iā€™m surely not a frontend expert. No worries, try your best. If you feel like this is too much, I think we can do that in follow up PRs. cc:

Re: [PR] Fix few caveats in provider release process [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36264: URL: https://github.com/apache/airflow/pull/36264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #36267: URL: https://github.com/apache/airflow/pull/36267#discussion_r1429235895 ## dev/README_RELEASE_PROVIDER_PACKAGES.md: ## @@ -1110,6 +,8 @@ Make sure you create the following branch from the git tag (steps before) and no ```shell scri

(airflow) branch main updated: Fix few caveats in provider rlease process (#36264)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ca7299e88c Fix few caveats in provider rlease proce

Re: [PR] Fix few clarifications in provider release process [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36267: URL: https://github.com/apache/airflow/pull/36267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Fix few clarifications in provider release process (#36267)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4a400f243c Fix few clarifications in provider relea

Re: [PR] Update yarn to yarnpkg to avoid conflicts with Hadoop [airflow-site]

2023-12-17 Thread via GitHub
potiuk commented on PR #910: URL: https://github.com/apache/airflow-site/pull/910#issuecomment-1859246420 > I would say that this is specific to your installation and that the doc does not need to be updated. Agree with @pierrejeambrun -- This is an automated message from the

Re: [PR] Update yarn to yarnpkg to avoid conflicts with Hadoop [airflow-site]

2023-12-17 Thread via GitHub
potiuk closed pull request #910: Update yarn to yarnpkg to avoid conflicts with Hadoop URL: https://github.com/apache/airflow-site/pull/910 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

Re: [PR] k8s spark operator compatibility [airflow]

2023-12-17 Thread via GitHub
josh-fell commented on code in PR #36268: URL: https://github.com/apache/airflow/pull/36268#discussion_r1429239828 ## airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py: ## @@ -59,7 +59,7 @@ class SparkKubernetesOperator(BaseOperator): def __init__( se

Re: [PR] Add `pod_template_dict` field to `KubernetesPodOperator` [airflow]

2023-12-17 Thread via GitHub
eladkal merged PR #33174: URL: https://github.com/apache/airflow/pull/33174 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

Re: [PR] Add `pod_template_dict` field to `KubernetesPodOperator` [airflow]

2023-12-17 Thread via GitHub
boring-cyborg[bot] commented on PR #33174: URL: https://github.com/apache/airflow/pull/33174#issuecomment-1859254906 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: Add `pod_template_dict` field to `KubernetesPodOperator` (#33174)

2023-12-17 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new f81dfd731f Add `pod_template_dict` field to `Kuber

Re: [I] Conflict Between Yarn Installation Locally and Hadoop YARN [airflow-site]

2023-12-17 Thread via GitHub
pierrejeambrun closed issue #909: Conflict Between Yarn Installation Locally and Hadoop YARN URL: https://github.com/apache/airflow-site/issues/909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

Re: [I] Conflict Between Yarn Installation Locally and Hadoop YARN [airflow-site]

2023-12-17 Thread via GitHub
pierrejeambrun commented on issue #909: URL: https://github.com/apache/airflow-site/issues/909#issuecomment-1859259313 Closing, cf https://github.com/apache/airflow-site/pull/910 for more context. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] Remove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36269: URL: https://github.com/apache/airflow/pull/36269 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Rmeove daskexcutor provider from Airflow code (#36269)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0ef3225b1d Rmeove daskexcutor provider from Airflow

Re: [PR] Remove daskexcutor provider from Airflow code [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36269: URL: https://github.com/apache/airflow/pull/36269#issuecomment-1859261994 Booom! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

Re: [I] Flaky dask backfill test in quarantine [airflow]

2023-12-17 Thread via GitHub
potiuk closed issue #32778: Flaky dask backfill test in quarantine URL: https://github.com/apache/airflow/issues/32778 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

Re: [PR] Add use_glob to GCSObjectExistenceSensor [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #34137: URL: https://github.com/apache/airflow/pull/34137#issuecomment-1859265547 Is there a minimum version of gcloud-aio needed for that ? if so we should set >= MIN -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] k8s spark operator compatibility [airflow]

2023-12-17 Thread via GitHub
blcksrx commented on code in PR #36268: URL: https://github.com/apache/airflow/pull/36268#discussion_r1429261594 ## airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py: ## @@ -59,7 +59,7 @@ class SparkKubernetesOperator(BaseOperator): def __init__( self

Re: [PR] k8s spark operator compatibility [airflow]

2023-12-17 Thread via GitHub
blcksrx commented on code in PR #36268: URL: https://github.com/apache/airflow/pull/36268#discussion_r1429261594 ## airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py: ## @@ -59,7 +59,7 @@ class SparkKubernetesOperator(BaseOperator): def __init__( self

[PR] Upgrade to just released `pip` 23.3.2 [airflow]

2023-12-17 Thread via GitHub
potiuk opened a new pull request, #36271: URL: https://github.com/apache/airflow/pull/36271 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)*

Re: [I] Fix User name and other parameters potentially containing HTLM characters [airflow]

2023-12-17 Thread via GitHub
shaiksamad commented on issue #36270: URL: https://github.com/apache/airflow/issues/36270#issuecomment-1859281913 I think I can do. what I have to do is: if any parameter contains html chars like `

(airflow) branch constraints-main updated: Updating constraints. Github run id:7240617604

2023-12-17 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 955019e74a Updating con

Re: [I] Fix User name and other parameters potentially containing HTLM characters [airflow]

2023-12-17 Thread via GitHub
potiuk commented on issue #36270: URL: https://github.com/apache/airflow/issues/36270#issuecomment-1859286708 Well. Part of the task is to find where it is. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Re: [PR] Add use_glob to GCSObjectExistenceSensor [airflow]

2023-12-17 Thread via GitHub
A-Costa commented on PR #34137: URL: https://github.com/apache/airflow/pull/34137#issuecomment-1859290045 Yes, the `match_glob` parameter is first exposed in the `9.0.0` release: https://github.com/talkiq/gcloud-aio/releases/tag/storage-9.0.0 I'll add the minimum version -- This

Re: [PR] Fix broken regex for allowed_deserialization_classes [airflow]

2023-12-17 Thread via GitHub
tobiaszorzetto commented on code in PR #36147: URL: https://github.com/apache/airflow/pull/36147#discussion_r1429283240 ## airflow/serialization/serde.py: ## @@ -360,7 +360,7 @@ def _register(): @functools.lru_cache(maxsize=None) def _get_patterns() -> list[Pattern]: patt

Re: [PR] Make databricks sql hook return a namedtuple [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1859303139 Well, We've just released ODBC **with** make_serializable . However we can still Yank it if we have a quick approval @bolkedebruin @phanikumv ? -- This is an automated message from the

Re: [PR] Add use_glob to GCSObjectExistenceSensor [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #34137: URL: https://github.com/apache/airflow/pull/34137 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add use_glob to GCSObjectExistenceSensor (#34137)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 92335417d8 Add use_glob to GCSObjectExistenceSensor

Re: [PR] Add use_glob to GCSObjectExistenceSensor [airflow]

2023-12-17 Thread via GitHub
boring-cyborg[bot] commented on PR #34137: URL: https://github.com/apache/airflow/pull/34137#issuecomment-1859306225 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: Improve audit_logs.rst (#36213)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new cbe8245990 Improve audit_logs.rst (#36213) cbe82459

Re: [PR] Improve audit_logs.rst [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36213: URL: https://github.com/apache/airflow/pull/36213#issuecomment-1859325087 But this is a great first step :D -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [PR] Improve audit_logs.rst [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36213: URL: https://github.com/apache/airflow/pull/36213 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Improve audit_logs.rst [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #36213: URL: https://github.com/apache/airflow/pull/36213#issuecomment-1859324953 Indeed. Long way to go :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] Move fs scheme definition from Python to YAML [airflow]

2023-12-17 Thread via GitHub
potiuk commented on PR #35972: URL: https://github.com/apache/airflow/pull/35972#issuecomment-1859326601 The test needs to be fixed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [PR] Convert DagFileProcessor.execute_callbacks to Internal API [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1429319698 ## airflow/models/dag.py: ## @@ -1383,8 +1384,43 @@ def normalized_schedule_interval(self) -> ScheduleInterval: _schedule_interval = self.schedule_interv

Re: [PR] Convert DagFileProcessor.execute_callbacks to Internal API [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1429319698 ## airflow/models/dag.py: ## @@ -1383,8 +1384,43 @@ def normalized_schedule_interval(self) -> ScheduleInterval: _schedule_interval = self.schedule_interv

Re: [PR] Convert DagFileProcessor.execute_callbacks to Internal API [airflow]

2023-12-17 Thread via GitHub
potiuk commented on code in PR #28900: URL: https://github.com/apache/airflow/pull/28900#discussion_r1429319698 ## airflow/models/dag.py: ## @@ -1383,8 +1384,43 @@ def normalized_schedule_interval(self) -> ScheduleInterval: _schedule_interval = self.schedule_interv

Re: [PR] Fix wrong execution date in SLA alerts [airflow]

2023-12-17 Thread via GitHub
github-actions[bot] commented on PR #35389: URL: https://github.com/apache/airflow/pull/35389#issuecomment-1859338929 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Fixes typing in `get_provider_name_from_short_hand` and its uses [airflow]

2023-12-17 Thread via GitHub
github-actions[bot] commented on PR #34507: URL: https://github.com/apache/airflow/pull/34507#issuecomment-1859338975 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for you

Re: [PR] Add ability to run streaming Job for BeamRunPythonPipelineOperator in non deferrable mode [airflow]

2023-12-17 Thread via GitHub
potiuk merged PR #36108: URL: https://github.com/apache/airflow/pull/36108 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add ability to run streaming Job for BeamRunPythonPipelineOperator in non deferrable mode (#36108)

2023-12-17 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d793fda391 Add ability to run streaming Job for Be

  1   2   >