This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a change to branch fork-ci-note-error-text
in repository https://gitbox.apache.org/repos/asf/airflow.git


    omit 609818a6db1 Keep the cause of retried and timed-out GitHub calls in 
Slack notes
    omit e3b5b665a7f Say why a fork CI monitor call failed in its Slack note
     add c4aa191bf63 Keep what contributors need about fork CI in the 
contributor docs (#77133)
     add 748148ccdb7 Count passed fork CI jobs and post job statuses at the 
intended rate (#77125)
     add 5c9c4d85e89 Move core Fernet helpers out of database models (#76605)
     add 542ab65b4d3 Move airflowctl assets state store commands to a subgroup 
(#75703)
     add 081db6f5ef5 Document that a mapped task state store index is 
positional (#76283)
     add 8a016b710ff Support durable execution in Databricks task operators 
(#76295)
     add e6fe78e006f Fix removed tasks fail_fast; stop finished TI overwrite 
(#76191)
     add 79b500352e0 Run Go SDK tests outside repo and on latest Go (#77014)
     add e74a7354920 UI: Speed up the latest run lookup for Dags with many old 
runs (#75873)
     add 2dae3e4e161 Log and audit when the partitioned Dag run per-tick cap is 
reached (#71072)
     add f2905a7e08f Clarify required params in Lang SDK ADR-0016 (#77081)
     add e306ae6529f Add end-to-end tests for task loops (#76886)
     add 3d8302a9ead UI: Keep Dag list filters when returning through the Dags 
link (#76953)
     add 8b471383adc UI: Keep import-error count failures out of the page 
(#76954)
     add 9fb5deaa209 Fix driverless PostgreSQL Celery `result_backend` 
requiring psycopg2 (#77166)
     add dbf7d644aa6 SDK release templates and documentation (#76807)
     add fff91b39504 Redirect to the requested page after Keycloak login 
(#76362)
     add e766e71cae7 Release the scoped session on the handler thread in the 
FAB FastAPI routes (#76403)
     add bb2ac454a42 Template the Neptune cluster operators' db_cluster_id 
argument under its own name (#70491)
     add 93aed9ad738 Fix templated page_size staying a string in mapped 
SqlToS3Operator tasks (#77153)
     add ec5151e6e9f Bump the fab-ui-package-updates group across 1 directory 
with 4 updates (#77170)
     add 9e6126a19c1 Allow mounting the Airflow config as a directory to avoid 
the subPath mount race (#70180)
     add bada0686efe Allow authenticationRef method in database connection 
(#75220)
     add 715043b8980 Honor config_file in deferrable KubernetesJobOperator 
(#76712)
     add 332649741ef Clean up triggers still referenced by task instances with 
no state (#76834)
     add 0289ce3321c Upgrade Huggingface datasets to 5.2.0 (#77150)
     add 8f88f8df531 Bump lang SDK versions after the 1.0.0 release (#77016)
     add 41619107e37 Fix import airflow slowdown from reading every package's 
metadata (#76890)
     add ba4a8117e2c Add Task SDK client contract tests (#77146)
     add e12aab3ac6d Discard task state by default on every task clear path 
(#76806)
     add 0fb56a641c4 Let deferrable operators reuse the durable reconnect 
decision tree (#77161)
     add 3a7a110f82e Java SDK: Let a task stop through onKill when Airflow asks 
it to (#75538)
     add ff9a6a926ce Add durable execution to 
AzureDataFactoryRunPipelineOperator (#77162)
     add 67607c15ca7 Fix 500 from the Keycloak auth manager when a browser 
session has no Keycloak tokens (#76353)
     add 466bfe33515 Add team-level authorization to Keycloak auth manager list 
filters (#77007)
     add 5a846fd1a8e Support durable execution for dbt cloud job runs (#76918)
     add f5f7f2b838b TS SDK: Fix the XCom map index default and reject invalid 
XCom arguments (#76893)
     add 58a14b281bb Fix two dead source links in core docs (#77193)
     add 3b35135afe9 Fail API tests that run sync DB work on the event loop 
(#76424)
     add bdc117c7e2c Fix FAB user auto-registration failing with a 500 when 
add_user fails (#76746)
     new 95879db4068 Say why a fork CI monitor call failed in its Slack note
     new b5cb493b8f5 Keep the cause of retried and timed-out GitHub calls in 
Slack notes

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (609818a6db1)
            \
             N -- N -- N   refs/heads/fork-ci-note-error-text (b5cb493b8f5)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .asf.yaml                                          |   22 +
 .github/workflows/ci-amd.yml                       |   23 +
 .github/workflows/ci-arm.yml                       |   23 +
 .github/workflows/java-sdk-release-verify.yml      |    4 +-
 .../lang-sdk/0016-mapped-tasks-across-lang-sdks.md |   18 +-
 .../task-and-asset-state-store.rst                 |    4 +-
 .../language-sdks/java.rst                         |   87 ++
 .../language-sdks/typescript.rst                   |   11 +-
 .../docs/core-concepts/auth-manager/index.rst      |    2 +-
 airflow-core/docs/core-concepts/dag-run.rst        |   10 +-
 .../docs/core-concepts/resumable-tasks.rst         |   13 +-
 .../docs/core-concepts/task-state-store.rst        |   21 +-
 airflow-core/newsfragments/76806.significant.rst   |   33 +
 .../api_fastapi/core_api/datamodels/dag_run.py     |    5 +
 .../core_api/openapi/v2-rest-api-generated.yaml    |   14 +
 .../api_fastapi/core_api/routes/public/dag_run.py  |    2 +
 .../core_api/routes/public/task_instances.py       |   10 +-
 .../airflow/api_fastapi/core_api/routes/ui/dags.py |   34 +-
 .../core_api/services/public/dag_run.py            |    2 +
 .../core_api/services/public/task_instances.py     |   43 +-
 .../airflow/api_fastapi/execution_api/AGENTS.md    |    9 +
 .../execution_api/routes/task_instances.py         |    7 +-
 airflow-core/src/airflow/cli/cli_config.py         |    7 +
 .../src/airflow/cli/commands/dag_command.py        |    3 +
 .../src/airflow/cli/commands/task_command.py       |    1 +
 .../sdk => airflow-core/src/airflow}/crypto.py     |   27 +-
 .../src/airflow/jobs/scheduler_job_runner.py       |   90 +-
 airflow-core/src/airflow/models/connection.py      |    3 +-
 airflow-core/src/airflow/models/connection_test.py |    3 +-
 airflow-core/src/airflow/models/crypto.py          |  106 +-
 airflow-core/src/airflow/models/taskinstance.py    |   67 +-
 airflow-core/src/airflow/models/trigger.py         |   12 +-
 airflow-core/src/airflow/models/variable.py        |    2 +-
 .../src/airflow/serialization/definitions/dag.py   |   11 +
 .../airflow/ui/openapi-gen/requests/schemas.gen.ts |   12 +
 .../airflow/ui/openapi-gen/requests/types.gen.ts   |    8 +
 .../ui/src/components/Clear/Run/ClearRunButton.tsx |    2 +-
 .../components/Clear/Run/ClearRunDialog.test.tsx   |  102 ++
 .../ui/src/components/Clear/Run/ClearRunDialog.tsx |   43 +-
 .../src/context/dagsListSearch/Context.ts}         |   10 +-
 .../dagsListSearch/DagsListSearchProvider.test.tsx |   72 ++
 .../dagsListSearch/DagsListSearchProvider.tsx      |   56 +
 .../{gridSelection => dagsListSearch}/index.ts     |    3 +-
 .../src/airflow/ui/src/layouts/BaseLayout.tsx      |   65 +-
 .../DagsLayout.test.tsx}                           |   30 +-
 .../src/airflow/ui/src/layouts/DagsLayout.tsx      |    5 +-
 .../airflow/ui/src/layouts/Nav/DagsButton.test.tsx |   12 +
 .../src/airflow/ui/src/layouts/Nav/DagsButton.tsx  |    3 +
 .../src/airflow/ui/src/layouts/Nav/NavButton.tsx   |   14 +-
 .../pages/DagRuns/BulkClearDagRunsButton.test.tsx  |  120 +++
 .../src/pages/DagRuns/BulkClearDagRunsButton.tsx   |   31 +-
 .../Dashboard/Stats/DagImportErrors.test.tsx}      |   39 +-
 .../src/pages/Dashboard/Stats/DagImportErrors.tsx  |    4 +-
 .../Dashboard/Stats/PluginImportErrors.test.tsx}   |   36 +-
 .../pages/Dashboard/Stats/PluginImportErrors.tsx   |    8 +-
 .../airflow/ui/src/queries/useBulkClearDagRuns.ts  |    2 +
 airflow-core/tests/unit/api_fastapi/conftest.py    |   36 +-
 .../core_api/routes/public/test_dag_run.py         |   39 +
 .../core_api/routes/public/test_dags.py            |    4 +-
 .../core_api/routes/public/test_task_instances.py  |    9 +-
 .../unit/api_fastapi/execution_api/conftest.py     |   19 +
 .../execution_api/test_task_sdk_client_contract.py |  256 +++++
 .../versions/head/test_task_instances.py           |   30 +
 .../known_api_server_threadpool_offloads.txt}      |    2 +-
 .../api_fastapi/known_sync_db_on_event_loop.txt    |   37 +
 .../unit/api_fastapi/test_event_loop_blocking.py   |  234 +++++
 .../tests/unit/cli/commands/test_dag_command.py    |   23 +-
 .../cli/commands/test_rotate_fernet_key_command.py |    2 +-
 airflow-core/tests/unit/jobs/test_scheduler_job.py |  686 +++++++++++-
 airflow-core/tests/unit/jobs/test_triggerer_job.py |    2 +-
 airflow-core/tests/unit/models/test_cleartasks.py  |   53 +
 airflow-core/tests/unit/models/test_connection.py  |    2 +-
 .../tests/unit/models/test_crypto.py               |   16 +-
 .../tests/unit/models/test_taskinstance.py         |   49 +
 airflow-core/tests/unit/models/test_trigger.py     |   22 +
 .../airflowctl_tests/test_airflowctl_commands.py   |   18 +-
 airflow-ctl/docs/images/command_hashes.txt         |    2 +-
 airflow-ctl/docs/images/output_assets.svg          |  166 ++-
 .../src/airflowctl/api/datamodels/generated.py     |   14 +
 airflow-ctl/src/airflowctl/ctl/cli_config.py       |    8 +
 .../src/airflowctl/ctl/commands/dag_command.py     |    1 +
 airflow-ctl/src/airflowctl/ctl/help_texts.yaml     |    1 +
 .../airflow_ctl/ctl/commands/test_dag_command.py   |    6 +-
 .../tests/airflow_ctl/ctl/test_cli_config.py       |    1 +
 .../java-native-bundle/gradle.properties           |    2 +-
 airflow-e2e-tests/java-test-bundle/build.gradle    |    1 +
 .../java-test-bundle/gradle.properties             |    2 +-
 .../org/apache/airflow/e2e/TestBundleBuilder.java  |   59 +-
 .../src/resources/dags/java_test_dags.py           |   24 +
 .../basic_tests/test_task_loops.py                 |  312 ++++++
 .../dags/example_task_loop_test.py                 |  125 +++
 .../airflow_e2e_tests/e2e_test_utils/clients.py    |   22 +
 .../java_sdk_tests/test_java_sdk_dag.py            |   65 ++
 chart/templates/_helpers.yaml                      |   16 +-
 chart/templates/workers/worker-deployment.yaml     |    2 +-
 chart/templates/workers/worker-kedaautoscaler.yaml |   10 +
 .../helm_tests/airflow_aux/test_airflow_common.py  |   79 ++
 chart/tests/helm_tests/other/test_keda.py          |   88 ++
 chart/values.schema.json                           |   32 +
 chart/values.yaml                                  |   15 +
 contributing-docs/05_pull_requests.rst             |   18 +-
 contributing-docs/18_contribution_workflow.rst     |  105 +-
 contributing-docs/25_maintainer_pr_triage.md       |   36 +-
 dev/AGENTS.md                                      |   12 +-
 dev/README_RELEASE_LANGUAGE_SDKS.md                |  432 ++++++++
 dev/breeze/doc/08_ci_tasks.rst                     |   31 +-
 .../doc/ci/08_fork_ci_for_external_contributors.md |  118 ++-
 .../src/airflow_breeze/utils/fork_ci_messages.py   |   50 +-
 .../src/airflow_breeze/utils/fork_ci_reconcile.py  |  220 +++-
 dev/breeze/tests/test_fork_ci_messages.py          |   66 ++
 dev/breeze/tests/test_fork_ci_reconcile.py         |  427 +++++++-
 generated/known_airflow_exceptions.txt             |    2 +-
 go-sdk/DEVELOPMENT.md                              |  101 ++
 java-sdk/DEVELOPMENT.md                            |  257 +----
 java-sdk/README.md                                 |    2 +-
 java-sdk/gradle.properties                         |    2 +-
 .../org/apache/airflow/sdk/AirflowProcessor.kt     |  145 ++-
 .../org/apache/airflow/sdk/AirflowProcessorTest.kt |  525 ++++++++++
 java-sdk/sdk/build.gradle.kts                      |   46 +
 .../main/kotlin/org/apache/airflow/sdk/Context.kt  |   62 +-
 .../main/kotlin/org/apache/airflow/sdk/DagDef.kt   |    1 +
 .../main/kotlin/org/apache/airflow/sdk/Server.kt   |   51 +-
 .../kotlin/org/apache/airflow/sdk/StoppableTask.kt |   94 ++
 .../apache/airflow/sdk/execution/Cancellation.kt   |  190 ++++
 .../org/apache/airflow/sdk/execution/Comm.kt       |   18 +-
 .../org/apache/airflow/sdk/execution/Logger.kt     |  205 +++-
 .../org/apache/airflow/sdk/execution/Task.kt       |   18 +-
 .../kotlin/org/apache/airflow/sdk/ContextTest.kt   |   14 +
 .../kotlin/org/apache/airflow/sdk/ServerTest.kt    | 1093 ++++++++++++++++++++
 .../airflow/sdk/execution/CancellationTest.kt      |  327 ++++++
 .../org/apache/airflow/sdk/execution/CommTest.kt   |   88 ++
 .../apache/airflow/sdk/execution/LogSenderTest.kt  |  767 ++++++++++++++
 .../org/apache/airflow/sdk/execution/TaskTest.kt   |   72 +-
 .../lang_sdk/java_example/gradle.properties        |    2 +-
 kubernetes-tests/lang_sdk/ts_example/package.json  |    2 +-
 .../providers/amazon/aws/operators/neptune.py      |   74 +-
 .../providers/amazon/aws/transfers/sql_to_s3.py    |   13 +-
 .../unit/amazon/aws/transfers/test_sql_to_s3.py    |   45 +-
 providers/celery/docs/changelog.rst                |    7 +
 providers/celery/provider.yaml                     |    4 +-
 .../providers/celery/executors/default_celery.py   |   23 +-
 .../airflow/providers/celery/get_provider_info.py  |    2 +-
 .../unit/celery/executors/test_celery_executor.py  |   58 +-
 .../unit/celery/executors/test_default_celery.py   |   15 +-
 providers/cncf/kubernetes/docs/changelog.rst       |   11 +
 .../providers/cncf/kubernetes/hooks/kubernetes.py  |    8 +-
 .../unit/cncf/kubernetes/hooks/test_kubernetes.py  |   43 +-
 providers/databricks/docs/operators/notebook.rst   |   55 +-
 providers/databricks/docs/operators/run_now.rst    |   21 +-
 providers/databricks/docs/operators/submit_run.rst |   21 +-
 providers/databricks/docs/operators/task.rst       |   55 +-
 .../providers/databricks/operators/databricks.py   |  207 ++--
 .../unit/databricks/operators/test_databricks.py   |  374 ++++++-
 providers/dbt/cloud/docs/operators.rst             |   38 +
 providers/dbt/cloud/pyproject.toml                 |    2 +-
 .../airflow/providers/dbt/cloud/operators/dbt.py   |  180 +++-
 .../tests/unit/dbt/cloud/operators/test_dbt.py     |  235 ++++-
 .../fab/auth_manager/api_fastapi/routes/login.py   |   35 +-
 .../fab/auth_manager/api_fastapi/routes/roles.py   |   17 +-
 .../fab/auth_manager/api_fastapi/routes/users.py   |   15 +-
 .../fab/auth_manager/cli_commands/user_command.py  |    5 +-
 .../fab/auth_manager/security_manager/override.py  |   41 +-
 .../fab/src/airflow/providers/fab/www/package.json |    8 +-
 .../src/airflow/providers/fab/www/pnpm-lock.yaml   |  762 +++++++-------
 .../api_fastapi/routes/test_session_release.py     |  117 +++
 .../auth_manager/cli_commands/test_user_command.py |   28 +
 .../auth_manager/security_manager/test_override.py |  161 +++
 .../tests/unit/fab/auth_manager/test_security.py   |    9 +-
 .../docs/auth-manager/manage/permissions.rst       |   29 +
 providers/keycloak/provider.yaml                   |   12 +
 .../providers/keycloak/auth_manager/constants.py   |    2 +
 .../keycloak/auth_manager/keycloak_auth_manager.py |  229 ++--
 .../providers/keycloak/auth_manager/middleware.py  |   30 +
 .../keycloak/auth_manager/routes/login.py          |   22 +-
 .../providers/keycloak/get_provider_info.py        |    7 +
 .../keycloak/auth_manager/routes/test_login.py     |  103 ++
 .../auth_manager/test_keycloak_auth_manager.py     |   91 ++
 .../unit/keycloak/auth_manager/test_middleware.py  |  157 ++-
 providers/microsoft/azure/docs/changelog.rst       |    8 +
 .../azure/docs/operators/adf_run_pipeline.rst      |   28 +
 .../microsoft/azure/operators/data_factory.py      |   78 +-
 .../microsoft/azure/triggers/data_factory.py       |    7 +-
 .../microsoft/azure/operators/test_data_factory.py |  149 ++-
 .../unit/microsoft/azure/operators/test_powerbi.py |   15 +-
 .../azure/tests/unit/microsoft/azure/test_utils.py |   13 +
 .../microsoft/azure/triggers/test_data_factory.py  |   16 +-
 .../ci/prek/check_airflowctl_command_coverage.py   |    1 +
 .../ci/prek/validate_operators_init_exemptions.txt |    2 -
 .../src/airflow_shared/module_loading/__init__.py  |   21 +-
 .../tests/module_loading/test_entry_points.py      |   45 +-
 .../tests/plugins_manager/test_plugins_manager.py  |   10 +-
 task-sdk/docs/api.rst                              |    2 +
 task-sdk/docs/resumable-job-mixin.rst              |   35 +-
 task-sdk/docs/ts-bundle-spec.rst                   |    2 +-
 task-sdk/src/airflow/sdk/__init__.py               |    4 +-
 task-sdk/src/airflow/sdk/__init__.pyi              |    6 +-
 .../src/airflow/sdk/bases/resumablejobmixin.py     |  154 +--
 .../tests/task_sdk/bases/test_resumablejobmixin.py |   59 ++
 ts-sdk/DEVELOPMENT.md                              |  134 ++-
 ts-sdk/README.md                                   |    4 +-
 ts-sdk/docs/index.md                               |    8 +-
 ts-sdk/docs/package-lock.json                      |    4 +-
 ts-sdk/docs/package.json                           |    2 +-
 ts-sdk/docs/tests/deployment-checks.test.mjs       |    4 +-
 ts-sdk/example/package.json                        |    2 +-
 ts-sdk/package.json                                |    5 +-
 ts-sdk/src/coordinator/client.ts                   |   71 +-
 ts-sdk/src/sdk/client-types.ts                     |   27 +-
 ts-sdk/src/sdk/client.ts                           |   11 +-
 ts-sdk/tests/coordinator/client.test.ts            |   70 +-
 ts-sdk/tests/public-api.test.ts                    |   12 +-
 uv.lock                                            |   39 +-
 212 files changed, 11967 insertions(+), 2049 deletions(-)
 create mode 100644 airflow-core/newsfragments/76806.significant.rst
 copy {task-sdk/src/airflow/sdk => airflow-core/src/airflow}/crypto.py (81%)
 create mode 100644 
airflow-core/src/airflow/ui/src/components/Clear/Run/ClearRunDialog.test.tsx
 copy 
airflow-core/src/airflow/{api_fastapi/auth/managers/simple/ui/rules/levels.js 
=> ui/src/context/dagsListSearch/Context.ts} (81%)
 create mode 100644 
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.test.tsx
 create mode 100644 
airflow-core/src/airflow/ui/src/context/dagsListSearch/DagsListSearchProvider.tsx
 copy airflow-core/src/airflow/ui/src/context/{gridSelection => 
dagsListSearch}/index.ts (95%)
 copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx => 
layouts/DagsLayout.test.tsx} (61%)
 create mode 100644 
airflow-core/src/airflow/ui/src/pages/DagRuns/BulkClearDagRunsButton.test.tsx
 copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx => 
pages/Dashboard/Stats/DagImportErrors.test.tsx} (53%)
 copy airflow-core/src/airflow/ui/src/{components/StatsCard.test.tsx => 
pages/Dashboard/Stats/PluginImportErrors.test.tsx} (55%)
 create mode 100644 
airflow-core/tests/unit/api_fastapi/execution_api/test_task_sdk_client_contract.py
 copy airflow-core/{src/airflow/api/common/__init__.py => 
tests/unit/api_fastapi/known_api_server_threadpool_offloads.txt} (87%)
 create mode 100644 
airflow-core/tests/unit/api_fastapi/known_sync_db_on_event_loop.txt
 create mode 100644 
airflow-core/tests/unit/api_fastapi/test_event_loop_blocking.py
 copy 
providers/common/compat/tests/unit/common/compat/standard/test_triggers.py => 
airflow-core/tests/unit/models/test_crypto.py (70%)
 create mode 100644 
airflow-e2e-tests/tests/airflow_e2e_tests/basic_tests/test_task_loops.py
 create mode 100644 
airflow-e2e-tests/tests/airflow_e2e_tests/dags/example_task_loop_test.py
 create mode 100644 dev/README_RELEASE_LANGUAGE_SDKS.md
 create mode 100644 
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/StoppableTask.kt
 create mode 100644 
java-sdk/sdk/src/main/kotlin/org/apache/airflow/sdk/execution/Cancellation.kt
 create mode 100644 
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/CancellationTest.kt
 create mode 100644 
java-sdk/sdk/src/test/kotlin/org/apache/airflow/sdk/execution/LogSenderTest.kt
 create mode 100644 
providers/fab/tests/unit/fab/auth_manager/api_fastapi/routes/test_session_release.py

Reply via email to