This is an automated email from the ASF dual-hosted git repository.
mobuchowski pushed a change to branch openlineage-process-execution
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 44ba855e1e openlineage: execute extraction and message sending in
separate process
discard f0128ced4c local task job: add timeout, to not kill
on_task_instance_success listener prematurely
add f5c8059553 sftp_sensor: fixing resource management with sensor (#40022)
add 86e613029b Implement CloudComposerDAGRunSensor (#40088)
add b49db97b8e Fix param order in PythonOperator docstring (#40122)
add 44a5300594 Chart: enable mysql keda support for triggerer (#37365)
add 65dbf86f72 Fix openai 1.32 breaking openai tests (#40110)
add 85be1867a6 Add warning to deprecated api docs that access control
isn't applied (#40129)
add 1a61eb3afd feat: OpenSearchQueryOperator using an endpoint with a
self-signed certificate (#39788)
add 27579cb773 Upgrade to codecov@v4 (#40128)
add 22bd188439 Fix `importlib_metadata` import in aws utils (#40134)
add 62444d8cff Resolve openlineage provider deprecations in tests (#40133)
add 663d422588 Add Codecov token (#40136)
add 3c8cd1cec2 Properly pass codecov-token to composite action (#40138)
add e01877a162 Remove warnings when uploading code coverage (#40139)
add 7a254ff240 Add rpc server to helm chart (#38549)
add 15178b6953 Use stdlib `importlib.metadata` for retrieve `botocore`
package version (#40137)
add 0478e24957 Ignore exceptions when closing all sessions in tests
(#40143)
add 48b619078d Mark two tests as (trigger and deps) as flaky (#40144)
add 340d6b0dde Fix highlight of example code in dags.rst (#40114)
add cbe6c2dd24 Add `delete_topic` to `KafkaAdminClientHook` and teardown
logic to Kafka integration tests (#40142)
add 297ad80c7d Move Post Execution Log Grouping behind Exception Print
(#40146)
add 14a613fc7d Allow executors to be specified with only the class name of
the Executor (#40131)
add fc4fbb3dcf Update providers metadata 2024-06-09 (#40149)
add f7708acab9 Fix hive_partition_sensor system test (#40023)
add 072c63b539 Fix typo in providers_manager.py (#40157)
add aabe66f869 Chart: Default airflow version to 2.9.2 (#40160)
add e9d8222a19 Airflow 2.9.2 has been released (#40159)
add 3d4661dac3 local task job: add timeout, to not kill
on_task_instance_success listener prematurely
add 0e2172dfa6 openlineage: execute extraction and message sending in
separate process
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (44ba855e1e)
\
N -- N -- N refs/heads/openlineage-process-execution (0e2172dfa6)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 2 +-
.github/actions/post_tests_success/action.yml | 21 +-
.github/workflows/integration-tests.yml | 3 +
.github/workflows/run-unit-tests.yml | 3 +
Dockerfile | 5 +-
Dockerfile.ci | 6 +-
README.md | 26 +-
RELEASE_NOTES.rst | 61 ++
airflow/config_templates/config.yml | 4 +-
airflow/executors/executor_loader.py | 7 +-
airflow/models/taskinstance.py | 6 +-
airflow/operators/python.py | 4 +-
airflow/providers/amazon/aws/utils/__init__.py | 5 +-
airflow/providers/apache/kafka/hooks/base.py | 3 +-
airflow/providers/apache/kafka/hooks/client.py | 16 +
.../google/cloud/operators/dataproc_metastore.py | 23 +-
.../google/cloud/sensors/cloud_composer.py | 173 ++++-
.../google/cloud/triggers/cloud_composer.py | 115 ++++
airflow/providers/google/provider.yaml | 5 +-
airflow/providers/openai/provider.yaml | 2 +-
airflow/providers/opensearch/hooks/opensearch.py | 21 +-
.../providers/opensearch/operators/opensearch.py | 12 +-
airflow/providers/sftp/hooks/sftp.py | 10 +-
airflow/providers/sftp/sensors/sftp.py | 13 +
airflow/providers_manager.py | 4 +-
airflow/reproducible_build.yaml | 4 +-
chart/Chart.yaml | 20 +-
chart/newsfragments/39433.significant.rst | 3 -
chart/newsfragments/40160.significant.rst | 3 +
chart/templates/_helpers.yaml | 10 +
.../rpc-server-deployment.yaml} | 194 +++---
.../rpc-server-networkpolicy.yaml} | 21 +-
.../rpc-server-poddisruptionbudget.yaml} | 18 +-
.../rpc-server-service.yaml} | 28 +-
.../rpc-server-serviceaccount.yaml} | 16 +-
.../triggerer/triggerer-kedaautoscaler.yaml | 12 +
chart/templates/workers/worker-kedaautoscaler.yaml | 1 -
chart/values.schema.json | 731 ++++++++++++++++++++-
chart/values.yaml | 108 ++-
contributing-docs/testing/unit_tests.rst | 2 +-
.../src/airflow_breeze/params/shell_params.py | 1 +
.../operators/cloud/cloud_composer.rst | 20 +
docs/apache-airflow/core-concepts/dags.rst | 2 +-
docs/apache-airflow/deprecated-rest-api-ref.rst | 5 +
.../installation/supported-versions.rst | 2 +-
docs/spelling_wordlist.txt | 1 +
generated/PYPI_README.md | 24 +-
generated/provider_dependencies.json | 6 +-
generated/provider_metadata.json | 12 +
helm_tests/airflow_aux/test_basic_helm_chart.py | 105 +--
.../test_rpc_server.py} | 608 ++++++-----------
helm_tests/airflow_core/test_triggerer.py | 17 +
helm_tests/airflow_core/test_worker.py | 16 +
helm_tests/security/test_rbac.py | 48 +-
scripts/ci/pre_commit/supported_versions.py | 2 +-
tests/always/test_project_structure.py | 1 -
tests/conftest.py | 6 +-
tests/deprecations_ignore.yml | 3 -
tests/executors/test_executor_loader.py | 25 +
.../apache/kafka/hooks/test_admin_client.py | 1 +
.../providers/apache/kafka/hooks/test_consumer.py | 3 +
.../providers/apache/kafka/hooks/test_producer.py | 4 +-
tests/providers/amazon/aws/utils/test_utils.py | 13 +
tests/providers/amazon/conftest.py | 10 +-
tests/providers/apache/kafka/hooks/test_base.py | 81 +++
tests/providers/apache/kafka/hooks/test_client.py | 81 ++-
tests/providers/apache/kafka/hooks/test_consume.py | 12 +-
tests/providers/apache/kafka/hooks/test_produce.py | 12 +-
.../google/cloud/sensors/test_cloud_composer.py | 63 +-
.../google/cloud/triggers/test_cloud_composer.py | 61 +-
tests/providers/openai/hooks/test_openai.py | 1 +
.../providers/openlineage/plugins/test_listener.py | 2 +-
tests/providers/openlineage/plugins/test_utils.py | 2 +-
.../providers/opensearch/hooks/test_opensearch.py | 28 +
.../cloud/composer/example_cloud_composer.py | 25 +
...ple_dataproc_metastore_hive_partition_sensor.py | 16 +-
tests/ti_deps/deps/test_trigger_rule_dep.py | 1 +
tests/triggers/test_external_task.py | 1 +
78 files changed, 2252 insertions(+), 790 deletions(-)
delete mode 100644 chart/newsfragments/39433.significant.rst
create mode 100644 chart/newsfragments/40160.significant.rst
copy chart/templates/{webserver/webserver-deployment.yaml =>
rpc-server/rpc-server-deployment.yaml} (50%)
copy chart/templates/{webserver/webserver-networkpolicy.yaml =>
rpc-server/rpc-server-networkpolicy.yaml} (71%)
copy chart/templates/{webserver/webserver-poddisruptionbudget.yaml =>
rpc-server/rpc-server-poddisruptionbudget.yaml} (71%)
copy chart/templates/{webserver/webserver-service.yaml =>
rpc-server/rpc-server-service.yaml} (63%)
copy chart/templates/{redis/redis-serviceaccount.yaml =>
rpc-server/rpc-server-serviceaccount.yaml} (69%)
copy helm_tests/{webserver/test_webserver.py =>
airflow_core/test_rpc_server.py} (60%)
create mode 100644 tests/providers/apache/kafka/hooks/test_base.py
