[PR] Fix grammer in dags.rst [airflow]

2024-06-06 Thread via GitHub
bangjiehan opened a new pull request, #40085: URL: https://github.com/apache/airflow/pull/40085 Minor improvement of sentences that confuse me a little. If we want to mention cross_downstream here, should we explicitly declare that `[t1, t2] >> [t3, t4]` is wrong.

[PR] Add `retry_args` parameter to `HttpOperator` [airflow]

2024-06-06 Thread via GitHub
boraberke opened a new pull request, #40086: URL: https://github.com/apache/airflow/pull/40086 This PR adds `retry_args` parameter to `HttpOperator`. closes: #39247 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](htt

Re: [PR] Make task to go to terminal state from triggerer without needing a worker [airflow]

2024-06-06 Thread via GitHub
Lee-W commented on code in PR #40084: URL: https://github.com/apache/airflow/pull/40084#discussion_r1628890268 ## airflow/dag_processing/manager.py: ## @@ -676,7 +679,7 @@ def _fetch_callbacks(self, max_callbacks: int, session: Session = NEW_SESSION): @retry_db_transaction

Re: [I] "Celery command failed", but "Marking task as SUCCESS" [airflow]

2024-06-06 Thread via GitHub
raphaelauv commented on issue #35610: URL: https://github.com/apache/airflow/issues/35610#issuecomment-2151594603 with airflow 2.9.1 since we activated the auto-scaling of workers with keda we see the same problem than @EinavDanielDX -- This is an automated message from the Apache Git S

Re: [I] Title: Error When Using Multiple DataSets as Triggers in Apache AirFlow [airflow]

2024-06-06 Thread via GitHub
boraberke commented on issue #36837: URL: https://github.com/apache/airflow/issues/36837#issuecomment-2151598276 Hi @utkarsharma2, I would like to give this a try. Could you please assign me? -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [PR] Support checking for db path absoluteness on Windows [airflow]

2024-06-06 Thread via GitHub
Dev-iL commented on code in PR #40069: URL: https://github.com/apache/airflow/pull/40069#discussion_r1628924640 ## airflow/settings.py: ## @@ -278,17 +280,29 @@ def remove(*args, **kwargs): pass +def _is_sqlite_db_path_relative(sqla_conn_str: str) -> bool: +"""D

Re: [PR] feature: callable for template_fields [airflow]

2024-06-06 Thread via GitHub
raphaelauv commented on PR #37028: URL: https://github.com/apache/airflow/pull/37028#issuecomment-2151645959 thanks for the doc , I added a new test about nested fields -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Fix grammar in dags.rst [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40085: URL: https://github.com/apache/airflow/pull/40085 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Fix grammar in dags.rst (#40085)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b03aa6caa0 Fix grammar in dags.rst (#40085) b03aa6c

Re: [I] Subsequent Dag Run mapped task not scheduled due to removed mapped task in previous Dag Run [airflow]

2024-06-06 Thread via GitHub
JosephABC commented on issue #37154: URL: https://github.com/apache/airflow/issues/37154#issuecomment-2151677374 @nathadfield , we were able to replicate the issue with the following code on Airflow v2.9.1 Following code is slightly modified from the one above. It should create the scena

Re: [I] Mapped Task details view "success" counts are off [airflow]

2024-06-06 Thread via GitHub
carlospalol commented on issue #29988: URL: https://github.com/apache/airflow/issues/29988#issuecomment-2151689395 Seeing this in Airflow 2.9.1. I cannot provide an example DAG at the moment. It is happening in a task mapping that lives inside a task group. This task mapping currently

Re: [PR] Add encryption_configuration parameter to BigQuery operators [airflow]

2024-06-06 Thread via GitHub
Lee-W commented on code in PR #40063: URL: https://github.com/apache/airflow/pull/40063#discussion_r1629006346 ## airflow/providers/google/cloud/operators/bigquery.py: ## @@ -336,6 +343,13 @@ class BigQueryValueCheckOperator(_BigQueryDbHookMixin, SQLValueCheckOperator): :p

Re: [I] Configuration option "max_templated_field_length" does not work on the rendered template content [airflow]

2024-06-06 Thread via GitHub
Pad71 commented on issue #40045: URL: https://github.com/apache/airflow/issues/40045#issuecomment-2151706074 @SamWheating Thank you very much, Sam, the problem was the the second point. What confused me was that the "truncated" data in the Task Instance Details section displayed correctly

Re: [I] Configuration option "max_templated_field_length" does not work on the rendered template content [airflow]

2024-06-06 Thread via GitHub
Pad71 commented on issue #40045: URL: https://github.com/apache/airflow/issues/40045#issuecomment-2151706720 not an error -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] doc: helm chart airflow version [airflow]

2024-06-06 Thread via GitHub
raphaelauv opened a new pull request, #40087: URL: https://github.com/apache/airflow/pull/40087 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Aip-61: Add validation on task `executor` field [airflow]

2024-06-06 Thread via GitHub
Lee-W commented on code in PR #40030: URL: https://github.com/apache/airflow/pull/40030#discussion_r1629028872 ## airflow/models/dag.py: ## @@ -800,10 +801,21 @@ def validate(self): f"inconsistent schedule: timetable {self.timetable.summary!r} "

[PR] Implement CloudComposerDAGRunSensor [airflow]

2024-06-06 Thread via GitHub
MaksYermak opened a new pull request, #40088: URL: https://github.com/apache/airflow/pull/40088 In this PR I have created a Sensor that checks if a DAG Run has been completed in Google Cloud Composer environments. --- **^ Add meaningful description above** R

Re: [I] Subsequent Dag Run mapped task not scheduled due to removed mapped task in previous Dag Run [airflow]

2024-06-06 Thread via GitHub
nathadfield commented on issue #37154: URL: https://github.com/apache/airflow/issues/37154#issuecomment-2151744470 @JosephABC Thanks very much! I can now reproduce this but the reason why this is occurring is because you have got `depends_on_past: True` defined in `default_args`. ``

Re: [PR] Upgrade google-ads version [airflow]

2024-06-06 Thread via GitHub
ahidalgob commented on PR #40079: URL: https://github.com/apache/airflow/pull/40079#issuecomment-2151820958 Hi, is this because of a new API version? should we update also the `default_api_version` in `GoogleAdsHook`? -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Sync v2-9-stable with v2-9-test to release 2.9.2 [airflow]

2024-06-06 Thread via GitHub
utkarsharma2 merged PR #40050: URL: https://github.com/apache/airflow/pull/40050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch v2-9-stable updated (2d53c1089f -> f56f134426)

2024-06-06 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to branch v2-9-stable in repository https://gitbox.apache.org/repos/asf/airflow.git from 2d53c1089f Update RELEASE_NOTES.rst add 3646de384e Add multi-team diagrams (#38861) add 0b1502a27

Re: [I] [Backfill] Support Partial DAG Backfills while still honoring dependencies [airflow]

2024-06-06 Thread via GitHub
nathadfield closed issue #38407: [Backfill] Support Partial DAG Backfills while still honoring dependencies URL: https://github.com/apache/airflow/issues/38407 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[PR] Exit instead of return in case of Providers[fab] test is ignored [airflow]

2024-06-06 Thread via GitHub
potiuk opened a new pull request, #40089: URL: https://github.com/apache/airflow/pull/40089 The #40059 added an exception for fab tests not to run on old airflow releases but it was wrong doing return instead of exit --- **^ Add meaningful description ab

Re: [PR] Add task documentation to details tab in grid view. [airflow]

2024-06-06 Thread via GitHub
potiuk commented on PR #39899: URL: https://github.com/apache/airflow/pull/39899#issuecomment-2151858996 One more fix is needed (I wrongly used return instead of exit for the check): https://github.com/apache/airflow/pull/40089 -- This is an automated message from the Apache Git Service.

Re: [PR] google: move bigquery openlineage imports inside methods [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40062: URL: https://github.com/apache/airflow/pull/40062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] google providers 10.19.0 bigquery operators directly depends on openlineage package [airflow]

2024-06-06 Thread via GitHub
potiuk closed issue #40043: google providers 10.19.0 bigquery operators directly depends on openlineage package URL: https://github.com/apache/airflow/issues/40043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

(airflow) branch main updated (b03aa6caa0 -> fe9159635f)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from b03aa6caa0 Fix grammar in dags.rst (#40085) add fe9159635f google: move openlineage imports inside methods (#40062

[PR] openlineage: Add task SLA information to AirflowRunFacet [airflow]

2024-06-06 Thread via GitHub
kacpermuda opened a new pull request, #40091: URL: https://github.com/apache/airflow/pull/40091 Adding information about task SLA to the AirflowRunFacet. --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache

Re: [PR] Exponential Backoff Not Functioning in BaseSensorOperator Reschedule Mode [airflow]

2024-06-06 Thread via GitHub
sanket2000 commented on PR #39823: URL: https://github.com/apache/airflow/pull/39823#issuecomment-2151933037 I feel this PR is ready for review along with tests. It really is a roller-coaster to work on the test files :) -- This is an automated message from the Apache Git Service. To re

(airflow) annotated tag constraints-2.9.2rc1 updated (35da30ea33 -> e4d76651ea)

2024-06-06 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to annotated tag constraints-2.9.2rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-2.9.2rc1 was modified! *** from 35da30ea33 (commit) to e4d76

[I] Env_vars from KubernetesPodOperator does not assume secret (deploy as env var) because secrets are loaded after env vars into the pods. [airflow]

2024-06-06 Thread via GitHub
ana-carolina-januario opened a new issue, #40092: URL: https://github.com/apache/airflow/issues/40092 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.6.0 ### What happened? We'

svn commit: r69562 - /dev/airflow/2.9.2rc1/

2024-06-06 Thread ephraimanierobi
Author: ephraimanierobi Date: Thu Jun 6 11:01:03 2024 New Revision: 69562 Log: Add artifacts for Airflow 2.9.2rc1 Added: dev/airflow/2.9.2rc1/ dev/airflow/2.9.2rc1/apache-airflow-2.9.2-source.tar.gz (with props) dev/airflow/2.9.2rc1/apache-airflow-2.9.2-source.tar.gz.asc dev/ai

svn commit: r69563 - /dev/airflow/2.9.1rc2/

2024-06-06 Thread ephraimanierobi
Author: ephraimanierobi Date: Thu Jun 6 11:02:35 2024 New Revision: 69563 Log: Remove old release: 2.9.1rc2 Removed: dev/airflow/2.9.1rc2/

(airflow) annotated tag 2.9.2rc1 updated (f56f134426 -> c55c2b237b)

2024-06-06 Thread utkarsharma
This is an automated email from the ASF dual-hosted git repository. utkarsharma pushed a change to annotated tag 2.9.2rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag 2.9.2rc1 was modified! *** from f56f134426 (commit) to c55c2b237b (tag) tagging f56

Re: [PR] add default gcp_conn_id to GoogleBaseAsyncHook [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40080: URL: https://github.com/apache/airflow/pull/40080 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated (fe9159635f -> f2a5b1dee1)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from fe9159635f google: move openlineage imports inside methods (#40062) add f2a5b1dee1 feat(providers/google): add def

[I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
utkarsharma2 opened a new issue, #40093: URL: https://github.com/apache/airflow/issues/40093 ### Body We are kindly requesting that contributors to [Apache Airflow RC 2.9.2rc1](https://pypi.org/project/apache-airflow/2.9.2rc1/) help test the RC. Please let us know by commen

Re: [PR] Add `retry_args` parameter to `HttpOperator` [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40086: URL: https://github.com/apache/airflow/pull/40086 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] HTTPOperator should have the possibility to retry at the page level using the http hook run_with_advanced_retry [airflow]

2024-06-06 Thread via GitHub
potiuk closed issue #39247: HTTPOperator should have the possibility to retry at the page level using the http hook run_with_advanced_retry URL: https://github.com/apache/airflow/issues/39247 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

(airflow) branch main updated: Add `retry_args` parameter to `HttpOperator` (#40086)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b358d0a6de Add `retry_args` parameter to `HttpOpera

Re: [PR] Resolve google cloud kubernetes operator and trigger deprecations in tests [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40072: URL: https://github.com/apache/airflow/pull/40072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Resolve google cloud kubernetes operator and trigger deprecations in tests (#40072)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0776bdbad1 Resolve google cloud kubernetes operator

Re: [PR] openlineage: Add task SLA and queued datetime to AirflowRunFacet [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40091: URL: https://github.com/apache/airflow/pull/40091 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add task SLA and queued datetime information to AirflowRunFacet (#40091)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1a613030e6 Add task SLA and queued datetime informa

Re: [I] Problem with pushing Xcom when using SparkKubernetesOperator [airflow]

2024-06-06 Thread via GitHub
bangnh1 commented on issue #39184: URL: https://github.com/apache/airflow/issues/39184#issuecomment-2152280013 I'm having same issue. Is there any way to solve the issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] fix typo in example_params_ui_tutorial [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on PR #40094: URL: https://github.com/apache/airflow/pull/40094#issuecomment-2152296206 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors'

[PR] fix typo in example_params_ui_tutorial [airflow]

2024-06-06 Thread via GitHub
noel-gallagher opened a new pull request, #40094: URL: https://github.com/apache/airflow/pull/40094 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests

[PR] Update _index.md [airflow-site]

2024-06-06 Thread via GitHub
navrang9 opened a new pull request, #1019: URL: https://github.com/apache/airflow-site/pull/1019 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe

[I] Chart: Allow to extend cleanup cronjob env with custom envs from secrets or config maps [airflow]

2024-06-06 Thread via GitHub
dada-engineer opened a new issue, #40095: URL: https://github.com/apache/airflow/issues/40095 ### Official Helm Chart version 1.13.1 (latest released) ### Apache Airflow version 2.9.1 ### Kubernetes Version 1.28 ### Helm Chart configuration Hi

Re: [I] Chart: Allow to extend cleanup cronjob env with custom envs from secrets or config maps [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on issue #40095: URL: https://github.com/apache/airflow/issues/40095#issuecomment-2152328900 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [I] Problem with pushing Xcom when using SparkKubernetesOperator [airflow]

2024-06-06 Thread via GitHub
gustavo-maxmilhas commented on issue #39184: URL: https://github.com/apache/airflow/issues/39184#issuecomment-2152452833 @bangnh1 Im my case, i downgraded the apache-airflow-providers-cncf-kubernetes to 7.13.0 to make it work -- This is an automated message from the Apache Git Service. To

(airflow-site) branch main updated: Update _index.md (#1019)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new c4196c8367 Update _index.md (#1019) c4196c8367

Re: [PR] Mention Airflow TM1 Provider in thrid-party providers page [airflow-site]

2024-06-06 Thread via GitHub
potiuk merged PR #1019: URL: https://github.com/apache/airflow-site/pull/1019 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

[PR] Adding Tiqets to the companies using airflow [airflow]

2024-06-06 Thread via GitHub
prakharcode opened a new pull request, #40096: URL: https://github.com/apache/airflow/pull/40096 --- Adding the Tiqets to the list of airflow users 🚀 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [PR] Adding Tiqets to the companies using airflow [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on PR #40096: URL: https://github.com/apache/airflow/pull/40096#issuecomment-2152561567 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contributors'

Re: [PR] Added kube-prometheus-stack servicemonitor to gather metrics from Airflow statsd exporter [airflow]

2024-06-06 Thread via GitHub
shalberd commented on PR #31040: URL: https://github.com/apache/airflow/pull/31040#issuecomment-2152580688 yeah, having that option, especially when statsd is enabled anyways ... is really so useful, no reason not to include ServiceMonitor -- This is an automated message from the Apache G

(airflow-site) branch gh-pages updated (086f9f968f -> 714f9f1bd6)

2024-06-06 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch gh-pages in repository https://gitbox.apache.org/repos/asf/airflow-site.git discard 086f9f968f Rewritten history to remove past gh-pages deployments new 714f9f1bd6 Rewritten history to

Re: [PR] fix typo in example_params_ui_tutorial [airflow]

2024-06-06 Thread via GitHub
potiuk merged PR #40094: URL: https://github.com/apache/airflow/pull/40094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] fix typo in example_params_ui_tutorial [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on PR #40094: URL: https://github.com/apache/airflow/pull/40094#issuecomment-2152643123 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

(airflow) branch main updated: fix typo in example_params_ui_tutorial (#40094)

2024-06-06 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new a31b10edda fix typo in example_params_ui_tutorial (

[I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
potiuk opened a new issue, #40097: URL: https://github.com/apache/airflow/issues/40097 ### Discussed in https://github.com/apache/airflow/discussions/39980 Originally posted by **weitang2022** May 31, 2024 I upgraded to Airflow 2.9.1. It's been running well for a week, but t

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152653008 Hey @vincbeck @o-nikolas -> looks like we got it now when 2.9.2rc1 is using the old celery provider. Way to reproduce: 1. Run this: ``` breeze start-airflow -

Re: [I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40093: URL: https://github.com/apache/airflow/issues/40093#issuecomment-2152658635 Checked my changes. Unfortunately there is likely a breaking "celery" change that we should make sure to handle. See https://github.com/apache/airflow/issues/40097 -- This is an

[PR] added hooks, operator and sensor [airflow]

2024-06-06 Thread via GitHub
prakharcode opened a new pull request, #40098: URL: https://github.com/apache/airflow/pull/40098 --- WIP for https://github.com/apache/airflow/issues/39954 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
o-nikolas commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152666721 #40035 (this one is just a unit test, but it links to the other issues and PR that fixes it as wel. That was merged a couple days ago) -- This is an automated message from the

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152673469 (or the other way round - maybe the celery executor 3.7.1 does not work with 2.9.2 - and likely 2.8, 2.9 in general - not sure as I am on a meeting today). -- This is an automated

Re: [I] Env_vars from KubernetesPodOperator does not assume secret (deploy as env var) because secrets are loaded after env vars into the pods. [airflow]

2024-06-06 Thread via GitHub
ana-carolina-januario commented on issue #40092: URL: https://github.com/apache/airflow/issues/40092#issuecomment-2152675914 Hi, Additionally, I've tried multiple workarounds: 1. export to other env var like: export COMMAND_1=$COMMAND without success. 2. export the

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
o-nikolas commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152676123 I'm AFK right now, I can look later, but the traceback seems to be base exec being called with a param it doesn't expect (and the type error is now caught correctly as of a coupl

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152685135 Ok. I see those were not marked for 2.9.2 so they should be in this case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40093: URL: https://github.com/apache/airflow/issues/40093#issuecomment-2152691292 UPDATE: so it seems (see #40097 ) we should also cherry-pick #40012 and #40035 in order to include fix for that (cc: @o-nikolas ). I marked them as 2.9.2 milestone. -- This is an

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
potiuk commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152692893 Marked them to be included in 2.9.2rc2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
utkarsharma2 commented on issue #40093: URL: https://github.com/apache/airflow/issues/40093#issuecomment-2152758355 Sure @potiuk, we will cherry-pick those commit and release rc2 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[I] celery_executor.py remove_running got an unexpected keyword [airflow]

2024-06-06 Thread via GitHub
asmasehlii opened a new issue, #40099: URL: https://github.com/apache/airflow/issues/40099 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? airflow/providers/celery/executors/celery_execu

Re: [I] celery_executor.py remove_running got an unexpected keyword [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on issue #40099: URL: https://github.com/apache/airflow/issues/40099#issuecomment-2152771932 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [I] Triggering DAG from UI Creates 2 DAG runs if the DAG was paused [airflow]

2024-06-06 Thread via GitHub
alvaroserper commented on issue #24534: URL: https://github.com/apache/airflow/issues/24534#issuecomment-2152813205 Hi, I am having a similar issue triggering a DAG RUN from Client in python. trigger_dag() generates two Dag Runs with 2 seconds of difference between execution date. The DAG I

Re: [I] celery_executor.py remove_running got an unexpected keyword [airflow]

2024-06-06 Thread via GitHub
vatsrahul1001 commented on issue #40099: URL: https://github.com/apache/airflow/issues/40099#issuecomment-2152820150 duplicate of https://github.com/apache/airflow/issues/40097 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] ADD prototype version dark mode for Airflow UI [airflow]

2024-06-06 Thread via GitHub
bbovenzi commented on code in PR #39355: URL: https://github.com/apache/airflow/pull/39355#discussion_r1629774464 ## airflow/www/static/js/toggle_theme.js: ## @@ -0,0 +1,52 @@ +/*! + * Licensed to the Apache Software Foundation (ASF) under one + * or more contributor license agr

Re: [PR] ADD prototype version dark mode for Airflow UI [airflow]

2024-06-06 Thread via GitHub
bbovenzi commented on code in PR #39355: URL: https://github.com/apache/airflow/pull/39355#discussion_r1629775357 ## airflow/www/templates/appbuilder/navbar.html: ## @@ -50,6 +50,16 @@ {% include 'appbuilder/navbar_menu.html' %} + + Re

Re: [I] DAG disappearing from Airflow in case of standalone DAG processor [airflow]

2024-06-06 Thread via GitHub
bmoon4 commented on issue #39332: URL: https://github.com/apache/airflow/issues/39332#issuecomment-2152848819 I found same issue in 2.9.1 .. Had to revert back to traditional schedulers :( -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [PR] Bump botocore from 1.34.90 to 1.34.106 [airflow]

2024-06-06 Thread via GitHub
ferruzzi closed pull request #40073: Bump botocore from 1.34.90 to 1.34.106 URL: https://github.com/apache/airflow/pull/40073 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [I] Airflow 2.9.1 : AirflowContextDeprecationWarning: Accessing 'yesterday_ds_nodash' from the template is deprecated and will be removed in a future version. [airflow]

2024-06-06 Thread via GitHub
boring-cyborg[bot] commented on issue #40100: URL: https://github.com/apache/airflow/issues/40100#issuecomment-2152904238 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] Airflow 2.9.1 : AirflowContextDeprecationWarning: Accessing 'yesterday_ds_nodash' from the template is deprecated and will be removed in a future version. [airflow]

2024-06-06 Thread via GitHub
michaelritsema opened a new issue, #40100: URL: https://github.com/apache/airflow/issues/40100 ### Apache Airflow version 2.9.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? related: #20603 I installed from PI

[PR] Add link to Google Providers Package System Tests Public Dashboard [airflow]

2024-06-06 Thread via GitHub
fdemiane opened a new pull request, #40101: URL: https://github.com/apache/airflow/pull/40101 Add link to Google Providers Package System Tests Public Dashboard. This dashboard shows the status of the system tests of the head revision of the Google Providers Package. The system tests

Re: [PR] doc: helm chart airflow version [airflow]

2024-06-06 Thread via GitHub
jedcunningham commented on code in PR #40087: URL: https://github.com/apache/airflow/pull/40087#discussion_r1629827538 ## chart/README.md: ## @@ -40,9 +40,9 @@ cluster using the [Helm](https://helm.sh) package manager. * Supported AWS executors with AWS provider version ``8.21.

[PR] Add link to Google Providers Package System Tests Public Dashboard [airflow]

2024-06-06 Thread via GitHub
fdemiane opened a new pull request, #40102: URL: https://github.com/apache/airflow/pull/40102 Add link to Google Providers Package System Tests Public Dashboard. This dashboard shows the status of the system tests of the head revision of the Google Providers Package. The system tests

Re: [PR] Add link to Google Providers Package System Tests Public Dashboard [airflow]

2024-06-06 Thread via GitHub
fdemiane closed pull request #40101: Add link to Google Providers Package System Tests Public Dashboard URL: https://github.com/apache/airflow/pull/40101 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [I] celery_executor got an unexpected keyword argument 'remove_running' [airflow]

2024-06-06 Thread via GitHub
vincbeck commented on issue #40097: URL: https://github.com/apache/airflow/issues/40097#issuecomment-2152925168 I marked it to be in 2.9.2 but it got removed :( But anyway, yes #40012 is the fix to this issue -- This is an automated message from the Apache Git Service. To respond to the m

(airflow) branch main updated (a31b10edda -> 42a2b1a3bb)

2024-06-06 Thread ferruzzi
This is an automated email from the ASF dual-hosted git repository. ferruzzi pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from a31b10edda fix typo in example_params_ui_tutorial (#40094) add 42a2b1a3bb Fix aws assume role session creation w

Re: [I] S3 ObjectStorage can't use AWS connection with role [airflow]

2024-06-06 Thread via GitHub
ferruzzi closed issue #39970: S3 ObjectStorage can't use AWS connection with role URL: https://github.com/apache/airflow/issues/39970 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific com

Re: [PR] Fix aws assume role session creation when deferrable [airflow]

2024-06-06 Thread via GitHub
ferruzzi merged PR #40051: URL: https://github.com/apache/airflow/pull/40051 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [I] Feature Request - Pool Support for Task Groups in Apache Airflow [airflow]

2024-06-06 Thread via GitHub
bruno-uy commented on issue #35689: URL: https://github.com/apache/airflow/issues/35689#issuecomment-2152932034 I'm trying to coordinate two groups of tasks in different pipelines and this feature would be really valuable. For my use case it would be enough to have a `pool` in the `Ta

Re: [PR] Exit instead of return in case Providers[fab] test is ignored [airflow]

2024-06-06 Thread via GitHub
jedcunningham merged PR #40089: URL: https://github.com/apache/airflow/pull/40089 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@ai

(airflow) branch main updated: Exit instead of return in case of Providers[fab] test is ignored (#40089)

2024-06-06 Thread jedcunningham
This is an automated email from the ASF dual-hosted git repository. jedcunningham pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0568e9a604 Exit instead of return in case of

[I] EmrServerlessStartJobOperator causes dag load failure when using XComArg [airflow]

2024-06-06 Thread via GitHub
fjmacagno opened a new issue, #40103: URL: https://github.com/apache/airflow/issues/40103 ### Apache Airflow Provider(s) amazon ### Versions of Apache Airflow Providers apache-airflow-providers-amazon==8.23.0 ### Apache Airflow version 2.9.1 ### Opera

Re: [PR] Align timers and timing metrics (ms) across all metrics loggers [airflow]

2024-06-06 Thread via GitHub
dirrao commented on PR #39908: URL: https://github.com/apache/airflow/pull/39908#issuecomment-2153026714 Hi @potiuk , @kaxil , @ferruzzi, Thanks for comments. I have introduced a flag to enable the consistency across all the logger timer metrics. By default the consistency flag is disabl

Re: [I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
ephraimbuddy commented on issue #40093: URL: https://github.com/apache/airflow/issues/40093#issuecomment-2153063058 > UPDATE: so it seems (see #40097 ) we should also cherry-pick #40012 and #40035 in order to include fix for that (cc: @o-nikolas ). I marked them as 2.9.2 milestone. I

Re: [PR] doc: helm chart airflow version [airflow]

2024-06-06 Thread via GitHub
raphaelauv commented on code in PR #40087: URL: https://github.com/apache/airflow/pull/40087#discussion_r1630025346 ## chart/README.md: ## @@ -40,9 +40,9 @@ cluster using the [Helm](https://helm.sh) package manager. * Supported AWS executors with AWS provider version ``8.21.0+`

Re: [I] Numerous error reports in airflow logs due to function argument mismatch [airflow]

2024-06-06 Thread via GitHub
PHameete commented on issue #40011: URL: https://github.com/apache/airflow/issues/40011#issuecomment-2153192582 Had this issue as well with Python 3.10, Airflow 3.9.1 and Celery providers 3.7.1 Downgrading Celery providers to 3.7.0 resolved this for now while waiting for the fix to b

Re: [I] Status of testing of Apache Airflow 2.9.2rc1 [airflow]

2024-06-06 Thread via GitHub
pankajastro commented on issue #40093: URL: https://github.com/apache/airflow/issues/40093#issuecomment-2153393130 https://github.com/apache/airflow/pull/39830 looking good -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

(airflow) branch openlineage-process-execution updated (23849615a9 -> 3b90e01262)

2024-06-06 Thread mobuchowski
This is an automated email from the ASF dual-hosted git repository. mobuchowski pushed a change to branch openlineage-process-execution in repository https://gitbox.apache.org/repos/asf/airflow.git omit 23849615a9 openlineage: execute extraction and message sending in separate process

  1   2   >