Re: [I] Scheduler "deadlocks" itself when max_active_runs_per_dag is reached by restart of failed task in previous run [airflow]

2023-10-30 Thread via GitHub
github-actions[bot] closed issue #17375: Scheduler "deadlocks" itself when max_active_runs_per_dag is reached by restart of failed task in previous run URL: https://github.com/apache/airflow/issues/17375 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] Scheduler "deadlocks" itself when max_active_runs_per_dag is reached by restart of failed task in previous run [airflow]

2023-10-30 Thread via GitHub
github-actions[bot] commented on issue #17375: URL: https://github.com/apache/airflow/issues/17375#issuecomment-1784590403 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

[PR] Add bandit to pre-commit to detect common security issues [airflow]

2023-10-30 Thread via GitHub
hussein-awala opened a new pull request, #34247: URL: https://github.com/apache/airflow/pull/34247 closes: #34241 This PR adds [bandit](https://github.com/PyCQA/bandit) to pre-commit hooks and static checks, to detect common security issues. I'm opening it as draft to get the r

Re: [PR] Fix: added re-raising of exceptions to dag.test() execution [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #34311: URL: https://github.com/apache/airflow/pull/34311#issuecomment-1784593399 Are you still working on it @styannik ? @dimberman - I think it waits for your input. -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] When using the docker operator and python operator together, the celery executor throws a TypeError. [airflow]

2023-10-30 Thread via GitHub
boring-cyborg[bot] commented on issue #35263: URL: https://github.com/apache/airflow/issues/35263#issuecomment-1784618333 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] When using the docker operator and python operator together, the celery executor throws a TypeError. [airflow]

2023-10-30 Thread via GitHub
phi-friday opened a new issue, #35263: URL: https://github.com/apache/airflow/issues/35263 ### Apache Airflow version 2.7.2 ### What happened When using the docker operator and python operator together, the celery executor throws a TypeError. ```log [2023-10-30

Re: [PR] Increment try_number for externally failed tasks [airflow]

2023-10-30 Thread via GitHub
pankajkoti commented on PR #32825: URL: https://github.com/apache/airflow/pull/32825#issuecomment-1784618483 hi @eladkal, yes, it might need more understanding on my end to understand the effects of try_number. This week looks tough, I just returned from my travel today and will need to cat

[PR] Add pytest db_test markers to our tests [airflow]

2023-10-30 Thread via GitHub
potiuk opened a new pull request, #35264: URL: https://github.com/apache/airflow/pull/35264 This PR is separated out from #35160 in order to make the big refactor and splitting out our test harness to DB and Non-DB tests far more easy to review. This change contains purely adding db_t

Re: [PR] Improve testing harness to separate DB and non-DB tests [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #35160: URL: https://github.com/apache/airflow/pull/35160#issuecomment-1784629964 Extracted out https://github.com/apache/airflow/pull/35264 - with purely adding `db_test` marker. Splitting that change into two should make it far easier to review. -- This is an aut

Re: [PR] Add pytest db_test markers to our tests [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #35264: URL: https://github.com/apache/airflow/pull/35264#issuecomment-1784631202 This one should ONLY contain adding db_test markers, so it should be super-easy to review even locally with `git diff` - once this is merged, the #35160 should start becoming reviewable.

Re: [PR] Add pytest db_test markers to our tests [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #35264: URL: https://github.com/apache/airflow/pull/35264#issuecomment-1784632014 This one should be NO-OP for the current code - i.e. the db_test markers are added but do nothing. -- This is an automated message from the Apache Git Service. To respond to the messag

Re: [I] Status of testing Providers that were prepared on October 28, 2023 [airflow]

2023-10-30 Thread via GitHub
moiseenkov commented on issue #35240: URL: https://github.com/apache/airflow/issues/35240#issuecomment-1784736239 #34880 works as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[PR] Make optional `output_location` attribute in `AthenaOperator` [airflow]

2023-10-30 Thread via GitHub
Taragolis opened a new pull request, #35265: URL: https://github.com/apache/airflow/pull/35265 Output location it is not mandatory field in AWS API, so make it optional which make it possible to configure it globally on Workgroup level Related: https://github.com/apach

[I] Need a backfill endpoint in REST API [airflow]

2023-10-30 Thread via GitHub
Felix-neko opened a new issue, #35266: URL: https://github.com/apache/airflow/issues/35266 ### Description Hi folks! And thank you for your great product. Please, can you add a backfill endpoint in your REST API? We really need this, because its rather tricky to get access to a

Re: [I] Need a backfill endpoint in REST API [airflow]

2023-10-30 Thread via GitHub
boring-cyborg[bot] commented on issue #35266: URL: https://github.com/apache/airflow/issues/35266#issuecomment-1784743519 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [PR] Fix for infinite recursion due to secrets_masker [airflow]

2023-10-30 Thread via GitHub
Usiel commented on PR #35048: URL: https://github.com/apache/airflow/pull/35048#issuecomment-1784750005 Rebased on `main`, incorporated the suggestion by @Taragolis (not to filter the warning log) and added the suggested fix for the underlying bug that brought me here: str-like class with c

Re: [I] Celery Executor is not working with redis-py 5.0.0 [airflow]

2023-10-30 Thread via GitHub
rdjouder commented on issue #33744: URL: https://github.com/apache/airflow/issues/33744#issuecomment-1784769872 Hello, I think the subject has been closed too early, redis 4.6.0 has this issue too Python 3.8.6 Name: kombu Version: 5.3.2 Name: apache-airflow Versi

Re: [I] Need a backfill endpoint in REST API [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on issue #35266: URL: https://github.com/apache/airflow/issues/35266#issuecomment-1784772429 - Duplicate of: https://github.com/apache/airflow/issues/18816 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] Need a backfill endpoint in REST API [airflow]

2023-10-30 Thread via GitHub
Taragolis closed issue #35266: Need a backfill endpoint in REST API URL: https://github.com/apache/airflow/issues/35266 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsub

Re: [PR] Make optional `output_location` attribute in `AthenaOperator` [airflow]

2023-10-30 Thread via GitHub
utkarsharma2 commented on code in PR #35265: URL: https://github.com/apache/airflow/pull/35265#discussion_r1375901647 ## tests/providers/amazon/aws/operators/test_athena.py: ## @@ -201,6 +202,21 @@ def test_return_value(self, mock_conn, mock_run_query, mock_check_query_status):

Re: [PR] Make optional `output_location` attribute in `AthenaOperator` [airflow]

2023-10-30 Thread via GitHub
utkarsharma2 commented on code in PR #35265: URL: https://github.com/apache/airflow/pull/35265#discussion_r1375901647 ## tests/providers/amazon/aws/operators/test_athena.py: ## @@ -201,6 +202,21 @@ def test_return_value(self, mock_conn, mock_run_query, mock_check_query_status):

Re: [PR] Add k8s recommended labels [airflow]

2023-10-30 Thread via GitHub
kimminw00 commented on PR #34735: URL: https://github.com/apache/airflow/pull/34735#issuecomment-1784790148 > I think you should also have to consider Label selectors. This means replacing the previous labels with the K8S recommended labels in label selectors. There may be proble

Re: [PR] Make optional `output_location` attribute in `AthenaOperator` [airflow]

2023-10-30 Thread via GitHub
utkarsharma2 commented on code in PR #35265: URL: https://github.com/apache/airflow/pull/35265#discussion_r1375907484 ## tests/providers/amazon/aws/operators/test_athena.py: ## @@ -201,6 +202,21 @@ def test_return_value(self, mock_conn, mock_run_query, mock_check_query_status):

Re: [PR] Make optional `output_location` attribute in `AthenaOperator` [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on code in PR #35265: URL: https://github.com/apache/airflow/pull/35265#discussion_r1375913366 ## tests/providers/amazon/aws/operators/test_athena.py: ## @@ -201,6 +202,21 @@ def test_return_value(self, mock_conn, mock_run_query, mock_check_query_status):

Re: [I] MappedTasks: Very slow execution :: taskinstance.py seems to be a bottleneck. [airflow]

2023-10-30 Thread via GitHub
boring-cyborg[bot] commented on issue #35267: URL: https://github.com/apache/airflow/issues/35267#issuecomment-1784812089 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] MappedTasks: Very slow execution :: taskinstance.py seems to be a bottleneck. [airflow]

2023-10-30 Thread via GitHub
a-meledin opened a new issue, #35267: URL: https://github.com/apache/airflow/issues/35267 ### Apache Airflow version 2.7.2 ### What happened We have a Dag with 116 tasks each having some number of MappedTasks. Overall number of tasks instances is ~6000. Problem is that

Re: [I] Links to specific dagruns don't work when older than 25 runs [airflow]

2023-10-30 Thread via GitHub
hterik commented on issue #34723: URL: https://github.com/apache/airflow/issues/34723#issuecomment-1784830804 Sorry for pinging but is there any way we can move this forward? I've already provided a fix in https://github.com/apache/airflow/pull/34887, waiting for review. IMO not being ab

Re: [PR] Fix weight_rule property type in mappedoperator [airflow]

2023-10-30 Thread via GitHub
utkarsharma2 commented on code in PR #35257: URL: https://github.com/apache/airflow/pull/35257#discussion_r1375942435 ## airflow/models/mappedoperator.py: ## @@ -470,7 +470,7 @@ def priority_weight(self) -> int: # type: ignore[override] return self.partial_kwargs.get("

Re: [I] airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... [airflow]

2023-10-30 Thread via GitHub
boring-cyborg[bot] commented on issue #35268: URL: https://github.com/apache/airflow/issues/35268#issuecomment-1784853507 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... [airflow]

2023-10-30 Thread via GitHub
kapuza opened a new issue, #35268: URL: https://github.com/apache/airflow/issues/35268 ### Apache Airflow version 2.7.2 ### What happened I am using [this](https://airflow.apache.org/docs/apache-airflow/stable/core-concepts/executor/celery.html) docs. System: Ubuntu

Re: [I] airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on issue #35268: URL: https://github.com/apache/airflow/issues/35268#issuecomment-1784876890 I assume that you do not set correct executor type and in this case it won't load non-related configs in airflow cli https://airflow.apache.org/docs/apache-airflow-provide

Re: [I] airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... [airflow]

2023-10-30 Thread via GitHub
Taragolis closed issue #35268: airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... URL: https://github.com/apache/airflow/issues/35268 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [I] MappedTasks: Very slow execution :: taskinstance.py seems to be a bottleneck. [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on issue #35267: URL: https://github.com/apache/airflow/issues/35267#issuecomment-1784887119 > Invetigation required on taskinstance.py code. Airflow is OSS and developed by different contributors (most of them also users of Airflow), so this required if someone sp

Re: [PR] [DOC] README 2.7.2 - K8S support [airflow]

2023-10-30 Thread via GitHub
raphaelauv commented on code in PR #35213: URL: https://github.com/apache/airflow/pull/35213#discussion_r1375987594 ## README.md: ## @@ -89,15 +89,15 @@ Airflow is not a streaming solution, but it is often used to process real-time d Apache Airflow is tested with: -|

Re: [I] When using the docker operator and python operator together, the celery executor throws a TypeError. [airflow]

2023-10-30 Thread via GitHub
phi-friday commented on issue #35263: URL: https://github.com/apache/airflow/issues/35263#issuecomment-1784896325 # update ## How to reproduce ### docker-compose.yaml ```yaml --- version: '3.8' x-airflow-common: &airflow-common image: apache/airflow:2.7.2-python3.1

Re: [PR] remove K8S 1.24 support [airflow]

2023-10-30 Thread via GitHub
raphaelauv commented on PR #35214: URL: https://github.com/apache/airflow/pull/35214#issuecomment-1784900472 we could just remove ``` Except for Kubernetes, a version stays supported by Airflow if two major cloud providers still provide support for it ``` since cloud prov

Re: [PR] Add description on what goes into the next release [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #35245: URL: https://github.com/apache/airflow/pull/35245#issuecomment-1784905066 Let me merge it so that people can see it - if there are any more corrections, they can be added later :) -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] Add description on what goes into the next release [airflow]

2023-10-30 Thread via GitHub
potiuk merged PR #35245: URL: https://github.com/apache/airflow/pull/35245 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add description on what goes into the next release (#35245)

2023-10-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1edd00cb17 Add description on what goes into the ne

Re: [PR] Bug fix fetch_callback of Partial Subset DAG [airflow]

2023-10-30 Thread via GitHub
Lee-W commented on code in PR #35256: URL: https://github.com/apache/airflow/pull/35256#discussion_r1375999496 ## airflow/models/dag.py: ## @@ -1428,6 +1428,13 @@ def fetch_callback( dagrun = DAG.fetch_dagrun(dag_id=dag.dag_id, run_id=dag_run_id, session=session)

Re: [PR] Don't get DAG out of DagBag when we already have it [airflow]

2023-10-30 Thread via GitHub
ashb commented on PR #35243: URL: https://github.com/apache/airflow/pull/35243#issuecomment-1784926965 The difference between an LRU cache and the cache in dagbag is that the later does a `datetime.now()` call (more or less). Additionally the change here to `dag = dag_run.dag or self

[PR] Update README information about number of companies using Airflow [airflow]

2023-10-30 Thread via GitHub
potiuk opened a new pull request, #35269: URL: https://github.com/apache/airflow/pull/35269 We have currently 494 organisations in the "in-the-wild", also we know this is only a subset of all the users. --- **^ Add meaningful description above** Read

Re: [I] airflow celery flower - airflow command error: argument GROUP_OR_COMMAND: invalid choice: 'celery' ... [airflow]

2023-10-30 Thread via GitHub
kapuza commented on issue #35268: URL: https://github.com/apache/airflow/issues/35268#issuecomment-1784954571 Thank you. Who came up with the idea of giving help based on set parameters, and not all possible options? ```bash # Create base config airflow config list

Re: [PR] Allow custom columns in cli dags list [airflow]

2023-10-30 Thread via GitHub
Lee-W commented on code in PR #35250: URL: https://github.com/apache/airflow/pull/35250#discussion_r1376017092 ## airflow/cli/commands/dag_command.py: ## @@ -351,8 +351,16 @@ def print_execution_interval(interval: DataInterval | None): @cli_utils.action_cli @suppress_logs_and

Re: [PR] Update README information about number of companies using Airflow [airflow]

2023-10-30 Thread via GitHub
potiuk merged PR #35269: URL: https://github.com/apache/airflow/pull/35269 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Update README information about number of companies using Airflow (#35269)

2023-10-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 03b8acb21c Update README information about number o

Re: [PR] Bugfix/prevent concurrency with cached venv [airflow]

2023-10-30 Thread via GitHub
potiuk merged PR #35258: URL: https://github.com/apache/airflow/pull/35258 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Bugfix/prevent concurrency with cached venv (#35258)

2023-10-30 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 2f48bc9bf8 Bugfix/prevent concurrency with cached v

Re: [PR] Use base aws classes in AWS Batch Operators/Sensors/Triggers [airflow]

2023-10-30 Thread via GitHub
Lee-W commented on code in PR #35226: URL: https://github.com/apache/airflow/pull/35226#discussion_r1376049250 ## tests/providers/amazon/aws/sensors/test_batch.py: ## @@ -106,215 +134,167 @@ def test_execute_failure_in_deferrable_mode_with_soft_fail(self, deferrable_batc

(airflow) 03/46: Mark tasks with `all_skipped` trigger rule as `skipped` if any task is in `upstream_failed` state (#34392)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8cbe5d9e09483f87b74339329c3c587d68200dd9 Author: Tamara Janina Fingerlin <90063506+tja...@users.noreply.gith

(airflow) 08/46: Add missing multiple_outputs=True param in the TaskFlow example (#34812)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 8a83d403fc7bff9be10343d1364624c7aec3b117 Author: Pankaj Koti AuthorDate: Sun Oct 8 06:05:29 2023 -0700

(airflow) branch v2-7-test updated (eb86d6057c -> c673cc71ed)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git discard eb86d6057c Added example for defaults in conn.extras (#35165) discard 69538406f3 Fix subtle bug in mocki

(airflow) 12/46: Fixing typo in airflow kerberos (#34827)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit a7cf2770b8606e4ac01c39c64284c8d250c96f49 Author: Amogh Desai AuthorDate: Mon Oct 9 23:58:17 2023 +0530

(airflow) 09/46: Remove unused set from `SchedulerJobRunner` (#34810)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit aff98bf70071cb19343547c27a186dfe7d812f0d Author: Jed Cunningham <66968678+jedcunning...@users.noreply.github

(airflow) 01/46: Use latest LTS clients of Oracle MySQL and MariaDB (#33722)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 5847d00812a2e794a9cd13aa96ff3636df89e5e0 Author: Andrey Anshin AuthorDate: Sat Sep 16 21:09:33 2023 +0400

(airflow) 16/46: Add session configuration to deployment manager's responsibilities. (#34866)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9872d397a173d85622c380207740e416674e45b0 Author: Jarek Potiuk AuthorDate: Wed Oct 11 17:44:24 2023 -0300

(airflow) 04/46: Fix typo re schedule vs schedule_interval (#34743)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 976f467f4a16e97821566bc9e1da5ff9eaf8a874 Author: Daniel Standish <15932138+dstand...@users.noreply.github.co

(airflow) 10/46: Fix variables substitution in Airflow Documentation (#34462)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9536a303b3e44be790c21ccc3a7b28ffe68cd62e Author: Andrey Anshin AuthorDate: Sun Oct 8 22:51:05 2023 +0400

(airflow) 17/46: fix(TimeSensorAsync): use DAG timezone (#33406)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d449d9ffcd1cb3d4c86207fd48aa512d618269a7 Author: Cassandra AuthorDate: Thu Oct 12 05:27:19 2023 +0200

(airflow) 07/46: docs: remove extraneous '>' in provider section name (#34813)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 3893b36361fc789b8e029b3710c79eb55ec39682 Author: Wonseok Yang <62360849+dead-1...@users.noreply.github.com>

(airflow) 06/46: Fix imports in extra link documentation (#34547)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit cfb778b81c6cd15dfd472210874312a23781b768 Author: Achim Gädke <135793393+achimgaedkelyn...@users.noreply.gith

(airflow) 22/46: Fix the dags count filter in webserver home page (#34944)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 99e6a439ae1b4c410dbcb2a12627aa7d68dfdea6 Author: Hussein Awala AuthorDate: Sun Oct 15 07:25:34 2023 +0200

(airflow) 24/46: Enhancement: Added Code from Image as Text (#34868)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 162aba6d6c6a51d72b11ae28d2e4a1d27c3e24ce Author: Aadya <101169283+theaa...@users.noreply.github.com> AuthorD

(airflow) 27/46: Update documentation to enable test connection (#34905)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 0b48f3be62d0fab78b4e47d149249dbd35f18e1a Author: vatsrahul1001 <43964496+vatsrahul1...@users.noreply.github.

(airflow) 25/46: Update docs errors.rst - Mention sentry "transport" configuration option (#34912)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6a780519dd8e6763d17d711ce3a09e2a10dc8c7e Author: luispedroemg <32001996+luispedro...@users.noreply.github.co

(airflow) 02/46: Correct some minor typos in the `breeze.rst` doc

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 0d1e5dab9b8d7b65d48fbb0d7dcf069f80421ae0 Author: Arpita kesharwani <107834813+kesharwaniarp...@users.noreply

(airflow) 32/46: Remove redundant variables from `example_python_operator` (#35046)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c000316e36dd678d998c8dee8e34f49e9c2e534f Author: aeongsseu <81360154+humaniearn...@users.noreply.github.com>

(airflow) 30/46: Fix `get_plugin_info` for class based listeners. (#35022)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b98f4acee188a618ee165ce63c61f2b47a2251f9 Author: Jakub Dardzinski AuthorDate: Wed Oct 18 21:42:39 2023 +020

(airflow) 29/46: Bump @babel/traverse from 7.16.0 to 7.23.2 in /airflow/www (#34988)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 74d9569d4b0f7b385c325963fdc461ca4f83157a Author: Dependabot [bot] <49699333+dependabot[bot]@users.noreply.gi

(airflow) 36/46: Fix Scheduler crash looping when dagrun creation fails (#35135)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit a42206e58fd05326bfb6b390f88f64e6d876e76c Author: Ephraim Anierobi AuthorDate: Mon Oct 23 19:39:37 2023 +010

(airflow) 14/46: Executors doc update (#34324)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 371062a4d14239a4f7276fe90c3cf843b35ebb20 Author: Niko Oliveira AuthorDate: Tue Oct 10 11:47:33 2023 -0700

(airflow) 19/46: Update dags.rst to put SubDag deprecation note right after the SubDag section heading (#34925)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6eb1048a974f9bef0826c132f62e129507b54937 Author: jayljohnson AuthorDate: Fri Oct 13 21:31:51 2023 -0700

(airflow) 28/46: Bump undici from 5.19.1 to 5.26.3 in /airflow/www (#34971)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6739752fafdcd480ce9e10e9d259572ebc730c23 Author: Dependabot [bot] <49699333+dependabot[bot]@users.noreply.gi

(airflow) 05/46: Remove warning about max_tis per query > parallelism (#34742)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit bb8cceff7a13aa84c2e32557ab6fb829e0b5f628 Author: Daniel Standish <15932138+dstand...@users.noreply.github.co

(airflow) 43/46: Improve modules import in Airflow core by some of them into a type-checking block (#33755)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 334d1234e8ab568a649ff706a31e5fecb300e022 Author: Hussein Awala AuthorDate: Mon Aug 28 16:54:08 2023 +0200

(airflow) 18/46: REST API: Fix wrong plugin schema (#34858)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 95c0154f675a136975f32999a89099775da9e82f Author: Ephraim Anierobi AuthorDate: Thu Oct 12 12:56:42 2023 +010

(airflow) 26/46: Some improvements/fixes for dag_run and task_instance endpoints (#34942)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d96436e6b1324bc0414d6a92ff95dc10adc18da7 Author: Hussein Awala AuthorDate: Mon Oct 16 16:40:26 2023 +0200

(airflow) 35/46: Fix test connection with codemirror and extra (#35122)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit a149692f54b5b263b95ad414eb8190fcc22d496c Author: Victor Chiapaikeo AuthorDate: Mon Oct 23 22:18:00 2023 +07

(airflow) 23/46: Fix typo in error message when `render_content` method is not implemented (#34952)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 6bfdc7fc6054be2ce9e0bedd44c9b6b7cb55e5f2 Author: Utkarsh Sharma AuthorDate: Sun Oct 15 21:27:21 2023 +0530

(airflow) 39/46: Fix test_retry_handling_job (#34326)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 719de69d70efaee749b383c53ebbf9974b82a536 Author: Daniel Dyląg AuthorDate: Thu Sep 14 12:03:46 2023 +0200

(airflow) 37/46: Update datasets.rst issue with running example code (#35035)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 21aeadde4de28c479e3e8b5838869469472ee6f9 Author: Erik Farmer <5082725+erik-far...@users.noreply.github.com>

(airflow) 15/46: Doc: Add info on getting variables and config in custom secrets backend (#34834)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d9923e13087dda9311594abc0001cb0fe324adf0 Author: Aakcht AuthorDate: Thu Oct 12 02:32:08 2023 +0600 Doc

(airflow) 38/46: Add TriggerRule missing value in rest API (#35194)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7885869ec2d7b7d61e1bcc71023f7f60d39599fd Author: Pankaj Singh <98807258+pankajas...@users.noreply.github.com

(airflow) 11/46: Fixes python_callable function assignment context kwargs example in params.rst (#34759)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit b81f1752cba9594238dc0c5f54b39bd0a3e2185a Author: Filippo Alimonda AuthorDate: Mon Oct 9 04:26:53 2023 -0600

(airflow) 20/46: Fix triggerer thread crash in daemon mode (#34931)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7559c1cabed4fc3c7a7d5aa67ac1461915a1ead2 Author: Daniel Dyląg AuthorDate: Sat Oct 14 17:56:24 2023 +0200

(airflow) 34/46: Remove `mysql-connector-python` from recommended MySQL driver (#34287)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 9dbccb736e2968b600897c09daec786b246c3787 Author: Andrey Anshin AuthorDate: Fri Oct 20 21:27:53 2023 +0400

(airflow) 46/46: Update RELEASE_NOTES.rst

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c673cc71ed7e1ec6d6bbc71d1edbf46028c45f15 Author: Ephraim Anierobi AuthorDate: Mon Oct 30 12:24:12 2023 +010

(airflow) 33/46: doc change (#35075)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 4c499f59a88bf079678ed5a25b4fc8a1a0a56fb5 Author: Shubham Raj <48172486+shubhamraj-...@users.noreply.github.c

(airflow) 41/46: Added example for defaults in conn.extras (#35165)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c7c0df835e97535b474755df377b985d8482d2cb Author: Vedran Kolka <30286931+vedranko...@users.noreply.github.com

(airflow) 45/46: Update version to 2.7.3

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit d40692eeb965d959c5776587550afed9b6fc0659 Author: Ephraim Anierobi AuthorDate: Mon Oct 30 11:16:00 2023 +010

(airflow) 21/46: Return only the TIs of the readable dags when ~ is provided as a dag_id (#34939)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7ebc49456eaac043d5ef7974b9ed9c32ed7b83ad Author: Hussein Awala AuthorDate: Sun Oct 15 00:01:00 2023 +0200

(airflow) 13/46: Fix the broken file link (#34826)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 7a06903f5c9715c07b9a282da7616717f06e8611 Author: Shiqi Guo <39219120+guoshiqi0...@users.noreply.github.com>

(airflow) 31/46: Fix usage of cron-descriptor since BC in v1.3.0 (#34836)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit c4e2f43359882f239f6de9ee8b652726089de598 Author: Quentin Bray AuthorDate: Thu Oct 19 19:07:50 2023 +0200

(airflow) 42/46: Improve importing the module in Airflow utils package (#33803)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit e64ffe6a7a392ba4230742647523239375abea1f Author: Hussein Awala AuthorDate: Sun Aug 27 22:00:10 2023 +0200

(airflow) 40/46: Fix subtle bug in mocking processor_agent in our tests (#35221)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 49ecb5a7262de16c04c93c9a812236a6457ee6a0 Author: Jarek Potiuk AuthorDate: Fri Oct 27 21:31:14 2023 +0200

(airflow) 44/46: Fix typo s/overriden/overridden/ (#35128)

2023-10-30 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch v2-7-test in repository https://gitbox.apache.org/repos/asf/airflow.git commit 550ebe8176a7f54c036e3ae2d25b5b390a4ba7a9 Author: hugo-syn <61210734+hugo-...@users.noreply.github.com> Autho

[PR] Sync v2-7-stable with v2-7-test to release 2.7.3 [airflow]

2023-10-30 Thread via GitHub
ephraimbuddy opened a new pull request, #35270: URL: https://github.com/apache/airflow/pull/35270 Time for `2.7.3rc1`! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

Re: [I] Allow jinja templating connection ids for all third party operators [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on issue #35259: URL: https://github.com/apache/airflow/issues/35259#issuecomment-1784993978 This might be blocked by https://github.com/apache/airflow/issues/29069 . In general you could extend `S3CreateObjectOperator.template_fields` by create custom Operator

Re: [PR] remove K8S 1.24 support [airflow]

2023-10-30 Thread via GitHub
potiuk commented on PR #35214: URL: https://github.com/apache/airflow/pull/35214#issuecomment-1785024167 > since cloud providers are way more up to date with K8S versions and also Apache airflow is not astronomer and we could have the same policy that we have with python and postgres

Re: [PR] Use base aws classes in AWS Batch Operators/Sensors/Triggers [airflow]

2023-10-30 Thread via GitHub
Taragolis commented on code in PR #35226: URL: https://github.com/apache/airflow/pull/35226#discussion_r1376085439 ## tests/providers/amazon/aws/operators/test_batch.py: ## @@ -305,40 +337,55 @@ def test_monitor_job_with_logs( class TestBatchCreateComputeEnvironmentOperator

  1   2   3   4   >