Re: [PR] Add data_interval_start and data_interval_end in dagrun create API endpoint [airflow]

2024-01-08 Thread via GitHub
karakanb commented on code in PR #36630: URL: https://github.com/apache/airflow/pull/36630#discussion_r1444299962 ## tests/api_connexion/endpoints/test_dag_run_endpoint.py: ## @@ -1076,32 +1076,62 @@ def test_end_date_gte_lte(self, payload, expected_dag_run_ids): class TestPos

Re: [PR] Add data_interval_start and data_interval_end in dagrun create API endpoint [airflow]

2024-01-08 Thread via GitHub
karakanb commented on code in PR #36630: URL: https://github.com/apache/airflow/pull/36630#discussion_r1444302507 ## airflow/api_connexion/endpoints/dag_run_endpoint.py: ## @@ -319,11 +320,38 @@ def post_dag_run(*, dag_id: str, session: Session = NEW_SESSION) -> APIResponse:

Re: [I] KubernetesPodOperator prints empty log lines without respecting the log format [airflow]

2024-01-08 Thread via GitHub
karakanb commented on issue #36571: URL: https://github.com/apache/airflow/issues/36571#issuecomment-1880597850 Here's the dockerfile I use for this deployment: ```dockerfile FROM apache/airflow:2.8.0-python3.11 ENV PYTHONPATH "${PYTHONPATH}:${AIRFLOW_HOME}" ENV SQLALCHEMY

Re: [PR] add deferrable mode to RedshiftDataOperator [airflow]

2024-01-08 Thread via GitHub
Lee-W commented on code in PR #36586: URL: https://github.com/apache/airflow/pull/36586#discussion_r1444364917 ## airflow/providers/amazon/aws/operators/redshift_data.py: ## @@ -87,6 +90,7 @@ def __init__( aws_conn_id: str = "aws_default", region: str | None =

Re: [I] Status of testing Providers that were prepared on January 07, 2024 [airflow]

2024-01-08 Thread via GitHub
Lee-W commented on issue #36644: URL: https://github.com/apache/airflow/issues/36644#issuecomment-1880677584 We've tested with the following providers with our example DAGs without encountering issues. * apache-airflow-providers-amazon==8.16.0rc1 (this includes https://github.com/apa

[PR] check sagemaker processing job status before deferring [airflow]

2024-01-08 Thread via GitHub
Lee-W opened a new pull request, #36658: URL: https://github.com/apache/airflow/pull/36658 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guide

Re: [PR] Add openlineage support for CopyFromExternalStageToSnowflakeOperator [airflow]

2024-01-08 Thread via GitHub
mobuchowski commented on code in PR #36535: URL: https://github.com/apache/airflow/pull/36535#discussion_r141436 ## airflow/providers/snowflake/transfers/copy_into_snowflake.py: ## @@ -137,5 +141,158 @@ def execute(self, context: Any) -> None: {self.validation_mode

Re: [PR] Add openlineage support for CopyFromExternalStageToSnowflakeOperator [airflow]

2024-01-08 Thread via GitHub
kacpermuda commented on code in PR #36535: URL: https://github.com/apache/airflow/pull/36535#discussion_r146974 ## airflow/providers/snowflake/transfers/copy_into_snowflake.py: ## @@ -137,5 +141,158 @@ def execute(self, context: Any) -> None: {self.validation_mode o

Re: [PR] Add openlineage support for CopyFromExternalStageToSnowflakeOperator [airflow]

2024-01-08 Thread via GitHub
kacpermuda commented on code in PR #36535: URL: https://github.com/apache/airflow/pull/36535#discussion_r146974 ## airflow/providers/snowflake/transfers/copy_into_snowflake.py: ## @@ -137,5 +141,158 @@ def execute(self, context: Any) -> None: {self.validation_mode o

Re: [PR] Add SparkKubernetesOperator crd implementation [airflow]

2024-01-08 Thread via GitHub
hamedhsn commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1880820881 > > If I could run that locally it would have been much faster to test. > > You can. > > See the output of the failed build It contains detailed instructions right after t

Re: [PR] Add SparkKubernetesOperator crd implementation [airflow]

2024-01-08 Thread via GitHub
bolkedebruin commented on PR #22253: URL: https://github.com/apache/airflow/pull/22253#issuecomment-1880862580 @hamedhsn documentation generation is always a bit tough especially in the beginning and I speak from experience. I have added some comments. Make sure to check the error message c

Re: [PR] Add openlineage support for CopyFromExternalStageToSnowflakeOperator [airflow]

2024-01-08 Thread via GitHub
mobuchowski merged PR #36535: URL: https://github.com/apache/airflow/pull/36535 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airf

(airflow) branch main updated: feat: Add openlineage support for CopyFromExternalStageToSnowflakeOperator (#36535)

2024-01-08 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 3dc99d8a28 feat: Add openlineage support for

(airflow) branch constraints-main updated: Updating constraints. Github run id:7447117856

2024-01-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 0e276faf4e Updating con

[PR] OpenLineage: Add dag_id when generating run_id for task instance. [airflow]

2024-01-08 Thread via GitHub
kacpermuda opened a new pull request, #36659: URL: https://github.com/apache/airflow/pull/36659 We might get the same run_id for the corresponding tasks even though they come from different dags. This happens when two dags are almost identical (same task ids, same schedules).

Re: [I] Status of testing Providers that were prepared on January 07, 2024 [airflow]

2024-01-08 Thread via GitHub
vatsrahul1001 commented on issue #36644: URL: https://github.com/apache/airflow/issues/36644#issuecomment-1880999377 Re-tested providers mentioned by @Lee-W also verified apache-airflow-providers-mysql==5.5.1rc1. LGTM -- This is an automated message from the Apache Git Service. To respon

Re: [PR] Updated config.yml for environment variable sql_alchemy_connect_args [airflow]

2024-01-08 Thread via GitHub
koushik-rout-samsung commented on code in PR #36526: URL: https://github.com/apache/airflow/pull/36526#discussion_r1444695089 ## airflow/config_templates/config.yml: ## @@ -583,11 +583,12 @@ database: description: | Import path for connect args in SqlAlchemy. Def

Re: [PR] Deferrable sensors can timeout with no retries [airflow]

2024-01-08 Thread via GitHub
robg-eb commented on PR #33718: URL: https://github.com/apache/airflow/pull/33718#issuecomment-1881109501 We want to keep this PR active - I can test this week as needed! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] Refactor the Design of AzureSynapsePipeline class [airflow]

2024-01-08 Thread via GitHub
pankajastro commented on code in PR #36622: URL: https://github.com/apache/airflow/pull/36622#discussion_r1444778853 ## airflow/providers/microsoft/azure/hooks/synapse.py: ## @@ -240,53 +296,22 @@ class AzureSynapsePipelineRunException(AirflowException): """An exception tha

Re: [PR] [FEAT] adds repair run functionality for databricks [airflow]

2024-01-08 Thread via GitHub
pankajastro commented on code in PR #36601: URL: https://github.com/apache/airflow/pull/36601#discussion_r1444781397 ## airflow/providers/databricks/hooks/databricks.py: ## @@ -519,13 +519,27 @@ def delete_run(self, run_id: int) -> None: json = {"run_id": run_id}

Re: [PR] Refactor the Design of AzureSynapsePipeline class [airflow]

2024-01-08 Thread via GitHub
ambika-garg commented on code in PR #36622: URL: https://github.com/apache/airflow/pull/36622#discussion_r1444840503 ## airflow/providers/microsoft/azure/hooks/synapse.py: ## @@ -56,8 +56,64 @@ class AzureSynapseSparkBatchRunStatus: TERMINAL_STATUSES = {SUCCESS, DEAD, KILLE

Re: [PR] Refactor the Design of AzureSynapsePipeline class [airflow]

2024-01-08 Thread via GitHub
ambika-garg commented on code in PR #36622: URL: https://github.com/apache/airflow/pull/36622#discussion_r1444851811 ## airflow/providers/microsoft/azure/hooks/synapse.py: ## @@ -240,53 +296,22 @@ class AzureSynapsePipelineRunException(AirflowException): """An exception tha

(airflow) branch switch-to-hatch updated (0435ad854b -> a1679e51e4)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch switch-to-hatch in repository https://gitbox.apache.org/repos/asf/airflow.git omit 0435ad854b Standardize airflow build process and switch to Hatchling build backend add 3dc99d8a28 feat

[PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36660: URL: https://github.com/apache/airflow/pull/36660 This is a regular dump of Amazon-provider related dependencies. The way how botocore releases are done, they are putting a lot of strain on `pip` to resolve the right set of dependencies, including l

[PR] Bump min version for grpcio-status in spark provider [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36662: URL: https://github.com/apache/airflow/pull/36662 Previously we limited grpcio minimum version to stop backtracking of `pip` from happening and we could not do it in the limits of spark provider, becaue some google dependencies used it and conflicte

[PR] Add templated fields to `BigQueryToSqlBaseOperator` from `BigQueryToPostgresOperator` [airflow]

2024-01-08 Thread via GitHub
romsharon98 opened a new pull request, #36663: URL: https://github.com/apache/airflow/pull/36663 This PR fix the breaking changes that comes with #36491 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com

Re: [PR] feat(helm): Add `enable` property to metric-exporter sidecar [airflow]

2024-01-08 Thread via GitHub
V0lantis commented on PR #35633: URL: https://github.com/apache/airflow/pull/35633#issuecomment-1881503659 Updated with some tests. Couldn't tests everything because it seems there is some issue with pendulum installation and py3.12 https://github.com/sdispater/pendulum/issues/457#issuecomm

Re: [PR] [FEAT] adds repair run functionality for databricks [airflow]

2024-01-08 Thread via GitHub
gaurav7261 commented on PR #36601: URL: https://github.com/apache/airflow/pull/36601#issuecomment-1881509640 Hi @pankajastro , I got the issue, seems like I missed the comma in method definition -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FEAT] adds repair run functionality for databricks [airflow]

2024-01-08 Thread via GitHub
gaurav7261 commented on code in PR #36601: URL: https://github.com/apache/airflow/pull/36601#discussion_r1445039708 ## airflow/providers/databricks/hooks/databricks.py: ## @@ -519,13 +519,27 @@ def delete_run(self, run_id: int) -> None: json = {"run_id": run_id}

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
eladkal commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445050648 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
eladkal commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445050648 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] prevent templated field logic checks in operators `__init__` in `BigQueryToPostgresOperator` operator [airflow]

2024-01-08 Thread via GitHub
eladkal commented on code in PR #36491: URL: https://github.com/apache/airflow/pull/36491#discussion_r1445052492 ## airflow/providers/google/cloud/transfers/bigquery_to_postgres.py: ## @@ -36,8 +34,6 @@ class BigQueryToPostgresOperator(BigQueryToSqlBaseOperator): :param pos

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445063015 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445063015 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
eladkal commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445069626 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] feat(helm): Add `enable` property to metric-exporter sidecar [airflow]

2024-01-08 Thread via GitHub
eladkal commented on PR #35633: URL: https://github.com/apache/airflow/pull/35633#issuecomment-1881556126 > Updated with some tests. Couldn't tests everything because it seems there is some issue with pendulum installation and py3.12 [sdispater/pendulum#457 (comment)](https://github.com/sdi

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
o-nikolas commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445073914 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] Bump min version for grpcio-status in spark provider [airflow]

2024-01-08 Thread via GitHub
potiuk merged PR #36662: URL: https://github.com/apache/airflow/pull/36662 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (3dc99d8a28 -> ded01a5aba)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 3dc99d8a28 feat: Add openlineage support for CopyFromExternalStageToSnowflakeOperator (#36535) add ded01a5aba Bum

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445076951 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445082881 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445084997 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445082881 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] feat(helm): Add `enable` property to metric-exporter sidecar [airflow]

2024-01-08 Thread via GitHub
V0lantis commented on PR #35633: URL: https://github.com/apache/airflow/pull/35633#issuecomment-1881602249 Because when I am committing and the pre-commit hook runs, [`Lint Helm Chart` installs `k8s_env`](https://github.com/apache/airflow/blob/f3ddefccf610833dc8d6012431f372f2af03053c/script

Re: [PR] Add a fuzzy match for metric allow and block list [airflow]

2024-01-08 Thread via GitHub
o-nikolas commented on code in PR #36250: URL: https://github.com/apache/airflow/pull/36250#discussion_r1445117071 ## airflow/config_templates/config.yml: ## @@ -944,6 +944,14 @@ metrics: description: | StatsD (https://github.com/etsy/statsd) integration settings. opt

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
shubham22 commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445126271 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

(airflow) branch constraints-main updated: Updating constraints. Github run id:7451254787

2024-01-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 543a5932da Updating con

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
o-nikolas commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445134189 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445135899 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445138342 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

[PR] Add deprecation information in deprecated endpoints + generate Rest API documentation from fab provider [airflow]

2024-01-08 Thread via GitHub
vincbeck opened a new pull request, #36664: URL: https://github.com/apache/airflow/pull/36664 See #36624 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
ferruzzi commented on PR #36660: URL: https://github.com/apache/airflow/pull/36660#issuecomment-1881648106 Looks like CI failures, but feel free to merge after those are sorted -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] Add deprecation information in deprecated endpoints + generate Rest API documentation from fab provider [airflow]

2024-01-08 Thread via GitHub
vincbeck commented on PR #36664: URL: https://github.com/apache/airflow/pull/36664#issuecomment-1881649446 I could not find a way to properly test the documentation generated for fab provider rest API. If anyone knows how to do it, I am all ears :) -- This is an automated message from the

[PR] Update EMR index docs [airflow]

2024-01-08 Thread via GitHub
dacort opened a new pull request, #36665: URL: https://github.com/apache/airflow/pull/36665 --- - Updates EMR index page to describe the different deployment options -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] Implement `is_authorized_dag` in AWS auth manager [airflow]

2024-01-08 Thread via GitHub
o-nikolas commented on code in PR #36619: URL: https://github.com/apache/airflow/pull/36619#discussion_r1445145049 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -163,7 +179,7 @@ def is_authorized_view( access_view: AccessView, user: Ba

Re: [PR] Implement `is_authorized_dag` in AWS auth manager [airflow]

2024-01-08 Thread via GitHub
vincbeck commented on code in PR #36619: URL: https://github.com/apache/airflow/pull/36619#discussion_r1445153195 ## airflow/providers/amazon/aws/auth_manager/aws_auth_manager.py: ## @@ -163,7 +179,7 @@ def is_authorized_view( access_view: AccessView, user: Bas

[PR] Bump Cohere min version to limit backtracking on upgrade [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #3: URL: https://github.com/apache/airflow/pull/3 While testing #36537 I noticed cohere backracking quite a bit with older version. Bumping Cohere to more recent minimum version (released in November) decreased it quite a bit. Since Cohere is

Re: [PR] Update EMR index docs [airflow]

2024-01-08 Thread via GitHub
eladkal merged PR #36665: URL: https://github.com/apache/airflow/pull/36665 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow) branch main updated: Update EMR index.rst (#36665)

2024-01-08 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 90fb783953 Update EMR index.rst (#36665) 90fb78395

Re: [PR] Standardize airflow build process and switch to Hatchling build backend [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #36537: URL: https://github.com/apache/airflow/pull/36537#issuecomment-1881670615 FYI. I am close to getting this one green. There is one more test failing due to some k8s dependencies which I am tracking down, right now I see what I can extract separately to merge be

Re: [PR] Implement task duration page in react. [airflow]

2024-01-08 Thread via GitHub
bbovenzi commented on PR #35863: URL: https://github.com/apache/airflow/pull/35863#issuecomment-1881679531 Just rebased and made some updates. Most notably, support for task groups and moving Task Duration into a general Task Details tab. https://github.com/apache/airflow/assets/46009

[PR] Fix reference to MANAGING_PROVIDERS_LIFECYCLE.rst [airflow]

2024-01-08 Thread via GitHub
eladkal opened a new pull request, #36667: URL: https://github.com/apache/airflow/pull/36667 file name was changed in https://github.com/apache/airflow/pull/35492 but we didn't fix the link in PROVIDERS.rst -- This is an automated message from the Apache Git Service. To respond to the mes

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
shubham22 commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445234109 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
eladkal commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445241982 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http

Re: [PR] Implement `is_authorized_dag` in AWS auth manager [airflow]

2024-01-08 Thread via GitHub
vincbeck merged PR #36619: URL: https://github.com/apache/airflow/pull/36619 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch main updated: Implement `is_authorized_dag` in AWS auth manager (#36619)

2024-01-08 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 43afb2f6b8 Implement `is_authorized_dag` in AWS a

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk merged PR #36660: URL: https://github.com/apache/airflow/pull/36660 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Bump min version of amazon-provider related dependencies [airflow]

2024-01-08 Thread via GitHub
potiuk commented on code in PR #36660: URL: https://github.com/apache/airflow/pull/36660#discussion_r1445254037 ## airflow/providers/amazon/provider.yaml: ## @@ -81,23 +81,14 @@ dependencies: - apache-airflow-providers-common-sql>=1.3.1 - apache-airflow-providers-http #

(airflow) branch main updated: Bump min version of amazon-provider related dependencies (#36660)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 298c37d355 Bump min version of amazon-provider rela

Re: [PR] Bump Cohere min version to limit backtracking on upgrade [airflow]

2024-01-08 Thread via GitHub
potiuk merged PR #3: URL: https://github.com/apache/airflow/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Bump Cohere min version to limit backtracking on upgrade (#36666)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 9797f9278a Bump Cohere min version to limit backtra

[PR] Bump min version of mysql-connector-python [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36668: URL: https://github.com/apache/airflow/pull/36668 As part of extraction from #36537 I noticed that mysql-connector-python causes also a lot of backtracking. This PR bumps minimum version of the mysql-connection-python from REALLY OLD (2018) t

Re: [PR] Add a fuzzy match for metric allow and block list [airflow]

2024-01-08 Thread via GitHub
ferruzzi commented on code in PR #36250: URL: https://github.com/apache/airflow/pull/36250#discussion_r1445258589 ## airflow/config_templates/config.yml: ## @@ -944,6 +944,14 @@ metrics: description: | StatsD (https://github.com/etsy/statsd) integration settings. opti

[PR] Bump min provider version for papermill [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36669: URL: https://github.com/apache/airflow/pull/36669 Yet another long backtracking avoidance, We are bumping REALLY OLD papermill min version (2019) with just old from 2022. --- **^ Add meaningful description

[PR] Bump min telegram-bot version [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36670: URL: https://github.com/apache/airflow/pull/36670 This is the last one from the long-backtracking series. Telegram 20.2 has been released in March 2023 and for all practical purposes using recent version is a good idea to interact with such se

Re: [PR] Make sure `multiple_outputs` is inferred correctly even when using `TypedDict` [airflow]

2024-01-08 Thread via GitHub
jscheffl commented on PR #36652: URL: https://github.com/apache/airflow/pull/36652#issuecomment-1881745821 Now just a small "glitch" in imports due to static checks... https://github.com/apache/airflow/actions/runs/7444185558/job/20275885423?pr=36652 -- This is an automated message from t

Re: [PR] Fix reference to MANAGING_PROVIDERS_LIFECYCLE.rst [airflow]

2024-01-08 Thread via GitHub
potiuk merged PR #36667: URL: https://github.com/apache/airflow/pull/36667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Fix reference to MANAGING_PROVIDERS_LIFECYCLE.rst (#36667)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7cb954fb5d Fix reference to MANAGING_PROVIDERS_LIFE

Re: [PR] Bump min version of mysql-connector-python [airflow]

2024-01-08 Thread via GitHub
potiuk merged PR #36668: URL: https://github.com/apache/airflow/pull/36668 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Bump min version of mysql-connector-python (#36668)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new c29632aab4 Bump min version of mysql-connector-pyth

Re: [PR] Bump min version of mysql-connector-python [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #36668: URL: https://github.com/apache/airflow/pull/36668#issuecomment-1881775608 Enough that it builds. It does not bring the CI image versions up, The versions there were already higher :) -- This is an automated message from the Apache Git Service. To respond to

Re: [PR] Allow override of hovered navbar colors [airflow]

2024-01-08 Thread via GitHub
ncrocfer commented on PR #36631: URL: https://github.com/apache/airflow/pull/36631#issuecomment-1881790076 Indeed this is a good idea to allow the users to customize it too. I check to append a new commit to this PR if you want. -- This is an automated message from the Apache Git Service.

[PR] Survey: swap out flawed infographics with fixed ones [airflow-site]

2024-01-08 Thread via GitHub
merobi-hub opened a new pull request, #932: URL: https://github.com/apache/airflow-site/pull/932 This replaces two of the infographics with fixed versions. ![screencapture-0-0-0-0-3000-survey-2024-01-08-15_54_07](https://github.com/apache/airflow-site/assets/68482867/a002a5d4-62b5-4394-8a

Re: [PR] Survey: swap out flawed infographics with fixed ones [airflow-site]

2024-01-08 Thread via GitHub
potiuk merged PR #932: URL: https://github.com/apache/airflow-site/pull/932 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

(airflow-site) branch main updated: Swap out flawed graphics with fixed ones. (#932)

2024-01-08 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 5e62ac1b93 Swap out flawed graphics with fixed

Re: [PR] feat(helm): Add `enable` property to metric-exporter sidecar [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #35633: URL: https://github.com/apache/airflow/pull/35633#issuecomment-1881825386 Make sure to setup global Python < 3.12 as your global Python version -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] Allow override of hovered navbar colors [airflow]

2024-01-08 Thread via GitHub
ncrocfer commented on PR #36631: URL: https://github.com/apache/airflow/pull/36631#issuecomment-1881831921 The new `navbar_logo_text_color` setting (please tell me if you prefer another slug) now allows the customization of the logo text color: ``` navbar_logo_text_color = #d7cece

[I] [Performance] Too many calls against timetable when clicking a task instance [airflow]

2024-01-08 Thread via GitHub
mujiannan opened a new issue, #36671: URL: https://github.com/apache/airflow/issues/36671 ### Description Click any scheduled task instance for task_instance_info, `confirm` api spend long-time responding, even failing. ### Reproduce 1. Click any scheduled task instance for ta

Re: [I] [Performance] Too many calls against timetable when clicking a task instance [airflow]

2024-01-08 Thread via GitHub
boring-cyborg[bot] commented on issue #36671: URL: https://github.com/apache/airflow/issues/36671#issuecomment-1881832020 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] add deferrable mode to RedshiftClusterSensor [airflow]

2024-01-08 Thread via GitHub
vincbeck merged PR #36550: URL: https://github.com/apache/airflow/pull/36550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

(airflow) branch main updated: Add deferrable mode to RedshiftClusterSensor (#36550)

2024-01-08 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4d5e05b28b Add deferrable mode to RedshiftCluster

[PR] Generate doc for fab CLI commands [airflow]

2024-01-08 Thread via GitHub
vincbeck opened a new pull request, #36672: URL: https://github.com/apache/airflow/pull/36672 `fab` provider specifies specific CLI commands (which used to be in core Airflow). We should then have a documentation to list all these CLI commands in fab provider.

[PR] Add version check for k8s setup venv command [airflow]

2024-01-08 Thread via GitHub
potiuk opened a new pull request, #36673: URL: https://github.com/apache/airflow/pull/36673 This command install airflow in k8s venv and in case version of Python is not yet supported by Airflow, it might fail. We do not have check it lower-bound because breeze supports the same minim

(airflow-site) branch gh-pages updated (90a19336b5 -> 9495b9b062)

2024-01-08 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard 90a19336b5 Rewritten history to remove past gh-pages deployments new 9495b9b062 Rewritten history to

Re: [PR] Add version check for k8s setup venv command [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #36673: URL: https://github.com/apache/airflow/pull/36673#issuecomment-1881862370 It will print instructions like this (but with 3.12 not 3.8) https://github.com/apache/airflow/assets/595491/f90967af-46d4-4c53-9b63-03cff95e1c24";> It will automatically adj

Re: [PR] feat(helm): Add `enable` property to metric-exporter sidecar [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #35633: URL: https://github.com/apache/airflow/pull/35633#issuecomment-1881864913 Nicer diagnostics for that case and instructions how to reinstall breeze with lower python version: https://github.com/apache/airflow/pull/36673 @V0lantis https://github.com/apach

Re: [PR] Add version check for k8s setup venv command [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #36673: URL: https://github.com/apache/airflow/pull/36673#issuecomment-1881867148 cc: @V0lantis -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To u

Re: [PR] Add version check for k8s setup venv command [airflow]

2024-01-08 Thread via GitHub
potiuk commented on PR #36673: URL: https://github.com/apache/airflow/pull/36673#issuecomment-1881885718 Nope. See the commit message :) > We do not have check it lower-bound because breeze supports the same minimum version of Airflow as Airflow itself. -- This is an automa

Re: [PR] Bump min provider version for papermill [airflow]

2024-01-08 Thread via GitHub
hussein-awala merged PR #36669: URL: https://github.com/apache/airflow/pull/36669 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

(airflow) branch main updated (4d5e05b28b -> b5c6aead44)

2024-01-08 Thread husseinawala
This is an automated email from the ASF dual-hosted git repository. husseinawala pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4d5e05b28b Add deferrable mode to RedshiftClusterSensor (#36550) add b5c6aead44 Bump min provider version fo

  1   2   >