This is an automated email from the ASF dual-hosted git repository.
jhtimmins pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard c37de28 Add State types for tasks and DAGs (#15285)
discard 8f96385 Add State types for tasks and DAGs (#15285)
discard 5ea02cc Fix external elasticsearch logs link (#16357)
discard 3d6db6d Fixed broken json_client (#17529)
discard fe70111 Add 'queued' to DagRunState (#16854)
discard 1be2003 Fix task retries when they receive sigkill and have retries
and properly handle sigterm (#16301)
discard 26e8d2d Fix bug that log can't be shown when task runs failed (#16768)
discard 20ed40b Better diagnostics and self-healing of docker-compose (#17484)
discard bc79182 Install providers from sources in prod image only on main
(#17458)
discard dcfc23e Attempt to reduce flakiness of PythonVirtualeEnv
test_airflow_context (#17486)
discard 005a5d0 Disable Helm tests when branch is not main
discard 31005cb Fixes some static check errors (#17432)
discard d5f0b1a Switches to "/" convention in ghcr.io images (#17356)
discard 9d2ad2a Fix failing static checks in main (#17424)
discard 2763e8e Add timeout when asking whether to rebuild image (#17412)
discard 70629ca Optimizes structure of the Dockerfiles and use latest tools
(#17418)
discard f2da764 Improve image building documentation for new users (#17409)
discard 403a087 Enhancement to bash scripts (#17098)
discard 205d6d4 Run mini scheduler in LocalTaskJob during task exit (#16289)
discard 38d4bab Fix race condition with dagrun callbacks (#16741)
discard f7bece3 Add 'queued' state to DagRun (#16401)
discard 0bd9558 Proper warning message when recorded PID is different from
current PID (#17411)
discard 67b4ff0 commiting dagPickle session when the airflow tasks run
--ship-dag --interactive command is executed FIXES: 15748 (#15890)
discard f479eff fix: change graph focus to top of view instead of center
(#16484)
discard 4d2db2e Redact conn secrets in webserver logs (#16579)
discard 88fd2db Fix ``AttributeError``: ``datetime.timezone`` object has no
attribute ``name`` (#16599)
discard 7288621 Set Process title for Worker when using ``LocalExecutor``
(#16623)
discard 55a4645 Fix slow (cleared) tasks being be adopted by Celery worker.
(#16718)
discard 12c46c9 BugFix: Correctly handle custom `deps` and `task_group`
during DAG Serialization (#16734)
discard 479a34d Fix unchecked indexing in _build_metrics (#16744)
discard 60938f0 fix: instance name env var (#16749)
discard 3750e5e Don't check execution_date in refresh_from_db (#16809)
discard 77ce4a2 Fix minor typo in configuration.py (#16832)
discard 36f0ecb Fixed task instance retrieval in XCom view (#16923)
discard 3beb37e Fix UPDATING.md (#16933)
discard 120cbb9 Core: Enable the use of __init_subclass__ in subclasses of
BaseOperator (#17027)
discard 66897eb #16976 Add json.dumps() for templated fields objects: 'dict'
and 'list' (#17082)
discard aaa9a4b Adds more explanatory message when SecretsMasker is not
configured (#17101)
discard 1b4af0b Fix: ``TaskInstance`` does not show ``queued_by_job_id`` &
``external_executor_id`` (#17179)
discard 24e75e7 Do not seek error file when it is closed (#17187)
discard 4a4959f Fix running tasks with default_impersonation config (#17229)
discard ed76d11 Show serialization exceptions in DAG parsing log (#17277)
discard 798237a Handle and log exceptions raised during task callback (#17347)
discard 40f4388 Improve diagnostics message when users have secret_key
misconfigured (#17410)
discard eaa21db Add missing permissions to varimport (#17468)
discard cf64187 Add back missing permissions to UserModelView controls.
(#17431)
discard 4678cf54 Validate type of `priority_weight` during parsing (#16765)
discard b558205 Fix calculating duration in tree view (#16695)
discard 8e8b58a Fix CLI 'kubernetes cleanup-pods' which fails on invalid
label key (#17298)
discard 012321b Fail tasks in scheduler when executor reports they failed
(#15929)
discard 673d78a fix(smart_sensor): Unbound variable errors (#14774)
discard ac832a2 Updates to FlaskAppBuilder 3.3.2+ (#17208)
discard f14860d Update alias for field_mask in Google Memmcache (#16975)
discard 4aef457 AIRFLOW-5529 Add Apache Drill provider. (#16884)
discard ab46af9 bump dnspython (#16698)
discard f3b74d8 Add type annotations to setup.py (#16658)
discard c967d29 Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
discard e8058eb Remove SQLAlchemy <1.4 constraint (#16630)
discard 88e6305 Switch back http provider after requests removes LGPL
dependency (#16974)
discard 3d2a5cf Switches to "/" convention in ghcr.io images with
optimisations
add ab3634a Switch back http provider after requests removes LGPL
dependency (#16974)
add 68977b9 Remove SQLAlchemy <1.4 constraint (#16630)
add fe5920e Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
add dfeb73d Add type annotations to setup.py (#16658)
add 867adda bump dnspython (#16698)
add 42334b0 AIRFLOW-5529 Add Apache Drill provider. (#16884)
add 37c935d Update alias for field_mask in Google Memmcache (#16975)
add 3c0f4d9 Updates to FlaskAppBuilder 3.3.2+ (#17208)
add 7a43960 Enhancement to bash scripts (#17098)
add 70794b0 Do not pull CI image for ownership fixing on first, fresh
breeze run (#17419)
add 38c7115 Increases timeout for helm chart builds (#17417)
add 8609c82 Improve image building documentation for new users (#17409)
add 106d9f0 Optimizes structure of the Dockerfiles and use latest tools
(#17418)
add 7371f98 Add timeout when asking whether to rebuild image (#17412)
add 2df7e6e Improve diagnostics message when users have secret_key
misconfigured (#17410)
add f196690 Fix failing static checks in main (#17424)
add 8fc7697 Switches to "/" convention in ghcr.io images (#17356)
add 2ba71c9 Fixes some static check errors (#17432)
add 562be8c Disable Helm tests when branch is not main
add 8bd1a7d Attempt to reduce flakiness of PythonVirtualeEnv
test_airflow_context (#17486)
add 0948366 Install providers from sources in prod image only on main
(#17458)
add 3833fb7 Better diagnostics and self-healing of docker-compose (#17484)
new b82782c Add back missing permissions to UserModelView controls.
(#17431)
new be09eef Path correction in docs for airflow core (#17567)
new e2be8d3 fix: instance name env var (#16749)
new 0d0f4e8 Fix minor typo in configuration.py (#16832)
new 6ebbf82 fix(smart_sensor): Unbound variable errors (#14774)
new dd94647 Add State types for tasks and DAGs (#15285)
new dd3c06f commiting dagPickle session when the airflow tasks run
--ship-dag --interactive command is executed FIXES: 15748 (#15890)
new c6d09ed Fail tasks in scheduler when executor reports they failed
(#15929)
new f3d431d fix: change graph focus to top of view instead of center
(#16484)
new 6eec6d0 Redact conn secrets in webserver logs (#16579)
new e593671 Fix ``AttributeError``: ``datetime.timezone`` object has no
attribute ``name`` (#16599)
new 600309b Set Process title for Worker when using ``LocalExecutor``
(#16623)
new 748c662 Fix calculating duration in tree view (#16695)
new 3211672 Fix slow (cleared) tasks being be adopted by Celery worker.
(#16718)
new 943d3c5 BugFix: Correctly handle custom `deps` and `task_group`
during DAG Serialization (#16734)
new 1aa156a Fix unchecked indexing in _build_metrics (#16744)
new d04fe50 Validate type of `priority_weight` during parsing (#16765)
new ae4ab58 Don't check execution_date in refresh_from_db (#16809)
new 84bb043 Fixed task instance retrieval in XCom view (#16923)
new e7a87e5 Fix UPDATING.md (#16933)
new 75c3e75 Core: Enable the use of __init_subclass__ in subclasses of
BaseOperator (#17027)
new f5ef0dd #16976 Add json.dumps() for templated fields objects: 'dict'
and 'list' (#17082)
new 4709c65 Adds more explanatory message when SecretsMasker is not
configured (#17101)
new 18c6baf Switch test_backfill_job.py from unittest to pytest style
(#17112)
new 0656f10 Fix: ``TaskInstance`` does not show ``queued_by_job_id`` &
``external_executor_id`` (#17179)
new 20f6edf Do not seek error file when it is closed (#17187)
new db96ee5 Show serialization exceptions in DAG parsing log (#17277)
new 5739fed Fix CLI 'kubernetes cleanup-pods' which fails on invalid
label key (#17298)
new 0678a94 Handle and log exceptions raised during task callback (#17347)
new 93b4c7b Optimize context sent for docker build (#17415)
new 65667b5 Add missing permissions to varimport (#17468)
new 42b6e2f Fixed broken json_client (#17529)
new 84df5ff Rescue if a DagRun's DAG was removed from db (#17544)
new 43a31e1 Fix running tasks with default_impersonation config (#17229)
new 6b8398a Proper warning message when recorded PID is different from
current PID (#17411)
new effbee1 Revert "Fix DAG run state not updated while DAG is paused
(#16343)"
new 3386b12 Run mini scheduler in LocalTaskJob during task exit (#16289)
new 7e79747 Fix DAG run state not updated while DAG is paused (#16343)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (c37de28)
\
N -- N -- N refs/heads/v2-1-test (7e79747)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 38 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
Dockerfile.ci | 4 +-
airflow/api_connexion/openapi/v1.yaml | 4 +-
airflow/jobs/local_task_job.py | 40 +-
airflow/jobs/scheduler_job.py | 182 +++--
...93827b8_add_queued_at_column_to_dagrun_table.py | 49 --
airflow/models/dag.py | 10 +-
airflow/models/dagrun.py | 31 +-
airflow/models/taskinstance.py | 8 +-
.../providers/elasticsearch/log/es_task_handler.py | 9 +-
airflow/utils/log/log_reader.py | 7 +-
airflow/utils/log/logging_mixin.py | 5 -
airflow/utils/state.py | 2 -
airflow/www/static/js/tree.js | 4 +-
airflow/www/views.py | 12 +-
docs/apache-airflow/installation.rst | 2 +-
docs/apache-airflow/migrations-ref.rst | 4 +-
tests/api/common/experimental/test_mark_tasks.py | 4 +-
.../endpoints/test_dag_run_endpoint.py | 14 +-
tests/api_connexion/schemas/test_dag_run_schema.py | 3 -
tests/dag_processing/test_processor.py | 773 ---------------------
tests/jobs/test_backfill_job.py | 45 +-
tests/jobs/test_local_task_job.py | 206 +-----
tests/jobs/test_scheduler_job.py | 278 ++++----
tests/models/test_cleartasks.py | 37 -
tests/models/test_dagrun.py | 25 +-
tests/models/test_taskinstance.py | 32 -
.../elasticsearch/log/test_es_task_handler.py | 10 -
tests/sensors/test_external_task_sensor.py | 8 +-
tests/utils/log/test_log_reader.py | 21 -
tests/utils/test_dag_processing.py | 11 +-
tests/www/views/test_views_blocked.py | 84 +++
tests/www/views/test_views_log.py | 16 +-
tests/www/views/test_views_tasks.py | 118 +---
33 files changed, 461 insertions(+), 1597 deletions(-)
delete mode 100644
airflow/migrations/versions/97cdd93827b8_add_queued_at_column_to_dagrun_table.py
delete mode 100644 tests/dag_processing/test_processor.py
create mode 100644 tests/www/views/test_views_blocked.py
