(airflow) branch v2-10-test updated: Remove the referrer from Webserver to Scarf (#42901) (#42942)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch v2-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/v2-10-test by this push:
new 100247f38f Remove the referrer from Webserver to Scarf (#42901)
(#42942)
100247f38f is described below
commit 100247f38fe6955d4825ae09b81a8703caf2221a
Author: Kaxil Naik
AuthorDate: Fri Oct 11 16:35:11 2024 +0100
Remove the referrer from Webserver to Scarf (#42901) (#42942)
This will make sure we don't receive any information about the Webserver
URL sending the info like the number of plugins and such.
(cherry picked from commit 39f8e1d487ab8f1969aaec512fdffacca989813c)
---
airflow/www/templates/airflow/dags.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/airflow/www/templates/airflow/dags.html
b/airflow/www/templates/airflow/dags.html
index 1f679d880e..d02b70a396 100644
--- a/airflow/www/templates/airflow/dags.html
+++ b/airflow/www/templates/airflow/dags.html
@@ -489,6 +489,6 @@
}
{% if scarf_url %}
-
+
{% endif %}
{% endblock %}
(airflow) branch main updated: Remove the referrer from Webserver to Scarf (#42901)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 39f8e1d487 Remove the referrer from Webserver to Scarf (#42901)
39f8e1d487 is described below
commit 39f8e1d487ab8f1969aaec512fdffacca989813c
Author: Kaxil Naik
AuthorDate: Fri Oct 11 13:35:00 2024 +0100
Remove the referrer from Webserver to Scarf (#42901)
This will make sure we don't receive any information about the Webserver
URL sending the info like the number of plugins and such.
---
airflow/www/templates/airflow/dags.html | 2 +-
docs/apache-airflow/faq.rst | 1 -
2 files changed, 1 insertion(+), 2 deletions(-)
diff --git a/airflow/www/templates/airflow/dags.html
b/airflow/www/templates/airflow/dags.html
index c629936df7..6da7090a14 100644
--- a/airflow/www/templates/airflow/dags.html
+++ b/airflow/www/templates/airflow/dags.html
@@ -489,6 +489,6 @@
}
{% if scarf_url %}
-
+
{% endif %}
{% endblock %}
diff --git a/docs/apache-airflow/faq.rst b/docs/apache-airflow/faq.rst
index 5d4aea6ddd..0b2c76765e 100644
--- a/docs/apache-airflow/faq.rst
+++ b/docs/apache-airflow/faq.rst
@@ -548,4 +548,3 @@ The telemetry data collected is limited to the following:
- Number of DAGs
- Number of Airflow plugins
- Number of timetables, Flask blueprints, Flask AppBuilder views, and Flask
Appbuilder menu items from Airflow plugins
-- and information from tracking pixels like URL / IP-address as documented in
the `Scarf Privacy Policy <https://about.scarf.sh/privacy-policy>`__.
(airflow) branch main updated (df4df2a8f9 -> 61aadddf51)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from df4df2a8f9 Use url_from_endpoint inside HttpHook. (#42785) add 61aadddf51 Fix typo in Breeze (#42919) No new revisions were added by this update. Summary of changes: dev/breeze/doc/images/output_testing.svg | 4 ++-- dev/breeze/doc/images/output_testing.txt | 2 +- dev/breeze/doc/images/output_testing_non-db-tests.svg | 2 +- dev/breeze/doc/images/output_testing_non-db-tests.txt | 2 +- dev/breeze/doc/images/output_testing_tests.svg | 2 +- dev/breeze/doc/images/output_testing_tests.txt | 2 +- dev/breeze/src/airflow_breeze/commands/testing_commands.py | 6 +++--- 7 files changed, 10 insertions(+), 10 deletions(-)
(airflow) branch main updated: Exclude "not-ready" providers when building docs (#42873)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 54005f87d42 Exclude "not-ready" providers when building docs (#42873)
54005f87d42 is described below
commit 54005f87d42f9b349f7484406c858f18be04b807
Author: Kaxil Naik
AuthorDate: Wed Oct 9 23:02:42 2024 +0100
Exclude "not-ready" providers when building docs (#42873)
This fixes the issue we saw in
https://apache-airflow.slack.com/archives/C03G9H97MM2/p1728492002477169
This PR excludes the providers that aren't ready yet for building docs.
---
.../authoring-and-scheduling/{assets.rst => datasets.rst} | 0
docs/apache-airflow/authoring-and-scheduling/index.rst | 2 +-
docs/apache-airflow/templates-ref.rst | 6 +++---
docs/exts/provider_yaml_utils.py| 2 +-
4 files changed, 5 insertions(+), 5 deletions(-)
diff --git a/docs/apache-airflow/authoring-and-scheduling/assets.rst
b/docs/apache-airflow/authoring-and-scheduling/datasets.rst
similarity index 100%
rename from docs/apache-airflow/authoring-and-scheduling/assets.rst
rename to docs/apache-airflow/authoring-and-scheduling/datasets.rst
diff --git a/docs/apache-airflow/authoring-and-scheduling/index.rst
b/docs/apache-airflow/authoring-and-scheduling/index.rst
index 5ec94d6ca73..28cc46ab061 100644
--- a/docs/apache-airflow/authoring-and-scheduling/index.rst
+++ b/docs/apache-airflow/authoring-and-scheduling/index.rst
@@ -41,5 +41,5 @@ It's recommended that you first review the pages in
:doc:`core concepts
timetable
diff --git a/docs/apache-airflow/templates-ref.rst
b/docs/apache-airflow/templates-ref.rst
index 5524c82f8cc..e3de3621913 100644
--- a/docs/apache-airflow/templates-ref.rst
+++ b/docs/apache-airflow/templates-ref.rst
@@ -62,10 +62,10 @@ VariableType
Description
``{{ prev_end_date_success }}`` `pendulum.DateTime`_ End date
from prior successful :class:`~airflow.models.dagrun.DagRun` (if available).
| ``None``
``{{ inlets }}``list List of
inlets declared on the task.
-``{{ inlet_events }}`` dict[str, ...]Access past
events of inlet assets. See :doc:`Assets `.
Added in version 2.10.
+``{{ inlet_events }}`` dict[str, ...]Access past
events of inlet assets. See :doc:`Assets `.
Added in version 2.10.
``{{ outlets }}`` list List of
outlets declared on the task.
``{{ outlet_events }}`` dict[str, ...]| Accessors
to attach information to asset events that will be emitted by the current task.
- | See
:doc:`Assets `. Added in version 2.10.
+ | See
:doc:`Assets `. Added in version 2.10.
``{{ dag }}`` DAG The
currently running :class:`~airflow.models.dag.DAG`. You can read more about
DAGs in :doc:`DAGs `.
``{{ task }}`` BaseOperator | The
currently running :class:`~airflow.models.baseoperator.BaseOperator`. You can
read more about Tasks in :doc:`core-concepts/operators`
``{{ macros }}`` | A
reference to the macros package. See Macros_ below.
@@ -90,7 +90,7 @@ VariableType
Description
| Added in
version 2.5.
``{{ triggering_asset_events }}`` dict[str, | If in a
Asset Scheduled DAG, a map of Asset URI to a list of triggering
:class:`~airflow.models.asset.AssetEvent`
list[AssetEvent]] | (there may
be more than one, if there are multiple Assets with different frequencies).
- | Read more
here :doc:`Assets `.
+ | Read more
here :doc:`Assets `.
| Added in
version 2.4.
=== =
===
diff --git a/docs/exts/provider_yaml_utils.py b/docs/exts/provider_yaml_utils.py
index 6e5d3a835e1..ad99da3c10e 100644
--- a/docs/exts/provider_yaml_utils.py
+++ b/docs/exts/provider_yaml_utils.py
@@ -70,7 +70,7 @@ def load_package_data(include_suspended: bool = False) ->
list[dict[str, Any]]:
exc
(airflow) branch main updated: Bump `blacken-docs` pre-commit (#42880)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 35f7076da64 Bump `blacken-docs` pre-commit (#42880) 35f7076da64 is described below commit 35f7076da64aa85c9ba5cb46947643cf8a389f3d Author: Kaxil Naik AuthorDate: Wed Oct 9 21:59:36 2024 +0100 Bump `blacken-docs` pre-commit (#42880) Bump `blacken-docs` pre-commit from 1.18.0 -> 1.19.0 --- .pre-commit-config.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index 394e11ac205..d492747856a 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -227,7 +227,7 @@ repos: additional_dependencies: ["libcst>=1.1.0"] files: ^(providers/src/)?airflow/.*/(sensors|operators)/.*\.py$ - repo: https://github.com/asottile/blacken-docs -rev: 1.18.0 +rev: 1.19.0 hooks: - id: blacken-docs name: Run black on docs
(airflow) branch main updated: Fix deprecated stage names for Pre-commit (#42872)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 19c32b9e0df Fix deprecated stage names for Pre-commit (#42872) 19c32b9e0df is described below commit 19c32b9e0dffd193414ac0a9ad41a16b6020ce5b Author: Kaxil Naik AuthorDate: Wed Oct 9 21:31:26 2024 +0100 Fix deprecated stage names for Pre-commit (#42872) Before ``` ❯ pre-commit install [WARNING] top-level `default_stages` uses deprecated stage names (commit, push) which will be removed in a future version. run: `pre-commit migrate-config` to automatically fix this. pre-commit installed at .git/hooks/pre-commit ``` --- .pre-commit-config.yaml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml index 748a85e860b..394e11ac205 100644 --- a/.pre-commit-config.yaml +++ b/.pre-commit-config.yaml @@ -15,7 +15,7 @@ # specific language governing permissions and limitations # under the License. --- -default_stages: [commit, push] +default_stages: [pre-commit, pre-push] default_language_version: python: python3 node: 22.2.0
(airflow) branch main updated: Revert Asset to Dataset for Core Extension Doc (#42867)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new bf002356ba0 Revert Asset to Dataset for Core Extension Doc (#42867)
bf002356ba0 is described below
commit bf002356ba0a38d317adeb651f066588908a79a3
Author: Kaxil Naik
AuthorDate: Wed Oct 9 19:45:50 2024 +0100
Revert Asset to Dataset for Core Extension Doc (#42867)
This PR reverts Core Extension doc change
(https://airflow.apache.org/docs/apache-airflow-providers/core-extensions/index.html)
from https://github.com/apache/airflow/pull/41348
Since those docs only work on Airflow stable, we can only change this after
3.0
---
.../core-extensions/asset-schemes.rst | 11 +++
.../howto/create-custom-providers.rst | 7 +--
docs/exts/operators_and_hooks_ref.py | 2 +-
3 files changed, 13 insertions(+), 7 deletions(-)
diff --git a/docs/apache-airflow-providers/core-extensions/asset-schemes.rst
b/docs/apache-airflow-providers/core-extensions/asset-schemes.rst
index 0a629b9f8a4..87bfd8ae676 100644
--- a/docs/apache-airflow-providers/core-extensions/asset-schemes.rst
+++ b/docs/apache-airflow-providers/core-extensions/asset-schemes.rst
@@ -15,14 +15,17 @@
specific language governing permissions and limitations
under the License.
-asset URI Schemes
+Dataset URI Schemes
---
-This is a summary of all Apache Airflow Community provided implementations of
asset URI schemes
+This is a summary of all Apache Airflow Community provided implementations of
dataset URI schemes
exposed via Airflow core and community-managed providers.
-See :doc:`documentation on assets
` for details on how asset URIs
work.
+..
+ TODO: Change this from Dataset to Asset in Airflow 3.0
-.. airflow-asset-schemes::
+See :doc:`documentation on Datasets
` for details on how dataset
URIs work.
+
+.. airflow-dataset-schemes::
:tags: None
:header-separator: "
diff --git a/docs/apache-airflow-providers/howto/create-custom-providers.rst
b/docs/apache-airflow-providers/howto/create-custom-providers.rst
index d95719e38bc..ba6d8068c42 100644
--- a/docs/apache-airflow-providers/howto/create-custom-providers.rst
+++ b/docs/apache-airflow-providers/howto/create-custom-providers.rst
@@ -96,9 +96,12 @@ Exposing customized functionality to the Airflow's core:
* ``filesystems`` - this field should contain the list of all the filesystem
module names.
See :doc:`apache-airflow:core-concepts/objectstorage` for description of the
filesystems.
-* ``asset-uris`` - this field should contain the list of the URI schemes
together with
+..
+ TODO: Change this from Dataset to Asset in Airflow 3.0
+
+* ``dataset-uris`` - this field should contain the list of the URI schemes
together with
class names implementing normalization functions.
- See :doc:`apache-airflow:authoring-and-scheduling/assets` for description of
the asset URIs.
+ See :doc:`apache-airflow:authoring-and-scheduling/datasets` for description
of the dataset URIs.
.. note:: Deprecated values
diff --git a/docs/exts/operators_and_hooks_ref.py
b/docs/exts/operators_and_hooks_ref.py
index fe6cd5d3300..25b9d1d7794 100644
--- a/docs/exts/operators_and_hooks_ref.py
+++ b/docs/exts/operators_and_hooks_ref.py
@@ -538,7 +538,7 @@ def setup(app):
app.add_directive("airflow-executors", ExecutorsDirective)
app.add_directive("airflow-deferrable-operators",
DeferrableOperatorDirective)
app.add_directive("airflow-deprecations", DeprecationsDirective)
-app.add_directive("airflow-asset-schemes", DatasetSchemeDirective)
+app.add_directive("airflow-dataset-schemes", DatasetSchemeDirective)
return {"parallel_read_safe": True, "parallel_write_safe": True}
(airflow) branch main updated (c2486b7c090 -> 51c35700860)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from c2486b7c090 Fix spelling; `Airlfow` -> `Airflow` (#42855) add 51c35700860 Docs: Add Template field related info for python operators (#42847) No new revisions were added by this update. Summary of changes: docs/apache-airflow/howto/operator/python.rst | 40 +++ 1 file changed, 28 insertions(+), 12 deletions(-)
(airflow) branch main updated (00d6ae72e2c -> c2486b7c090)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 00d6ae72e2c Fix mark as success when pod fails while fetching log (#42815) add c2486b7c090 Fix spelling; `Airlfow` -> `Airflow` (#42855) No new revisions were added by this update. Summary of changes: airflow/providers/elasticsearch/CHANGELOG.rst | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(airflow) branch main updated (3b4c73a644 -> 04ba8ee300)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 3b4c73a644 Remove `sqlalchemy-redshift` dependency from Amazon provider (#42830) add 04ba8ee300 Simplify code for recent dbt provider change (#42840) No new revisions were added by this update. Summary of changes: airflow/providers/dbt/cloud/hooks/dbt.py | 30 +++--- 1 file changed, 11 insertions(+), 19 deletions(-)
(airflow) branch main updated (5a146f75c5 -> b98c620a38)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 5a146f75c5 Remove unused ldap3 dependency (#42829) add b98c620a38 Improve docs on adding Google secrets in AWS Secrets Manager (#42832) No new revisions were added by this update. Summary of changes: .../img/aws-secrets-manager-gcp.png | Bin 0 -> 13453 bytes .../secrets-backends/aws-secrets-manager.rst| 20 2 files changed, 16 insertions(+), 4 deletions(-) create mode 100644 docs/apache-airflow-providers-amazon/img/aws-secrets-manager-gcp.png
(airflow) branch main updated (5be7b21cbc -> 5a146f75c5)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 5be7b21cbc Update CODEOWNERS to update Kaxil's entry (#42839) add 5a146f75c5 Remove unused ldap3 dependency (#42829) No new revisions were added by this update. Summary of changes: hatch_build.py | 1 - 1 file changed, 1 deletion(-)
(airflow) branch main updated: Update CODEOWNERS to update Kaxil's entry (#42839)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 5be7b21cbc Update CODEOWNERS to update Kaxil's entry (#42839) 5be7b21cbc is described below commit 5be7b21cbc98d91a2fa29a47f9567b1ebb235c86 Author: Kaxil Naik AuthorDate: Tue Oct 8 19:57:53 2024 +0100 Update CODEOWNERS to update Kaxil's entry (#42839) I haven't been that active coding or reviewing. Although I am now returning back to focus on Task SDK (AIP-72) so narrowing down my entries in CODEOWNERS. --- .github/CODEOWNERS | 16 1 file changed, 8 insertions(+), 8 deletions(-) diff --git a/.github/CODEOWNERS b/.github/CODEOWNERS index 4de511fdfa..c20fe916f9 100644 --- a/.github/CODEOWNERS +++ b/.github/CODEOWNERS @@ -1,10 +1,10 @@ # Core -/airflow/executors/ @kaxil @XD-DENG @ashb @o-nikolas @pierrejeambrun @hussein-awala -/airflow/jobs/ @kaxil @ashb @XD-DENG -/airflow/models/ @kaxil @XD-DENG @ashb +/airflow/executors/ @XD-DENG @ashb @o-nikolas @pierrejeambrun @hussein-awala +/airflow/jobs/ @ashb @XD-DENG +/airflow/models/ @XD-DENG @ashb # DAG Serialization -/airflow/serialization/ @kaxil @ashb @bolkedebruin +/airflow/serialization/ @ashb @bolkedebruin # DAG Parsing /airflow/dag_processing @jedcunningham @ephraimbuddy @@ -17,7 +17,7 @@ /chart/ @dstandish @jedcunningham @hussein-awala # Docs (without Providers) -/docs/*.py @kaxil @potiuk +/docs/*.py @potiuk /docs/apache-airflow @potiuk /docs/docker-stack @potiuk /docs/helm-chart @dstandish @jedcunningham @@ -58,7 +58,7 @@ /docs/apache-airflow/concepts/deferring.rst @dstandish @hussein-awala # Secrets Backends -/airflow/secrets @dstandish @kaxil @potiuk @ashb +/airflow/secrets @dstandish @potiuk @ashb # Providers /airflow/providers/amazon/ @eladkal @o-nikolas @@ -85,7 +85,7 @@ /tests/system/providers/amazon/ @eladkal @o-nikolas # Dev tools -/.github/workflows/ @potiuk @ashb @kaxil +/.github/workflows/ @potiuk @ashb /dev/ @potiuk @ashb @jedcunningham /docker_tests/ @potiuk @ashb /provider_packages/ @potiuk @ashb @@ -95,7 +95,7 @@ Dockerfile.ci @potiuk @ashb # Releasing Guides & Project Guidelines /dev/PROJECT_GUIDELINES.md @kaxil -/dev/PROVIDER_PACKAGE_DETAILS.md @kaxil +/dev/PROVIDER_PACKAGE_DETAILS.md @eladkal /dev/README.md @kaxil /dev/README_RELEASE_*.md @kaxil @pierrejeambrun /dev/README_RELEASE_PROVIDER_PACKAGES.md @eladkal
(airflow) branch main updated (063c550405 -> 3d55af546f)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 063c550405 CI providers discovery update when airflow min 2.7.0 (#42767) add 3d55af546f Make Scarf details more prominent in 2.10 release notes (#42838) No new revisions were added by this update. Summary of changes: RELEASE_NOTES.rst | 12 ++-- airflow/reproducible_build.yaml | 4 ++-- docs/apache-airflow/faq.rst | 1 + 3 files changed, 9 insertions(+), 8 deletions(-)
(airflow-site) branch main updated: Revert "Add temporary banner for 2024 Airflow Summit (#1004)"
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/main by this push:
new 916a171ce7 Revert "Add temporary banner for 2024 Airflow Summit
(#1004)"
916a171ce7 is described below
commit 916a171ce7631f83e4505e0052de931a1218fd8c
Author: Kaxil Naik
AuthorDate: Tue Oct 8 19:13:48 2024 +0100
Revert "Add temporary banner for 2024 Airflow Summit (#1004)"
This reverts commit 9c16bc9be8b682e34e7dc42b937961527326a82b.
---
landing-pages/site/assets/scss/_navbar.scss | 3 +--
landing-pages/site/layouts/partials/navbar.html | 5 +
sphinx_airflow_theme/sphinx_airflow_theme/header.html | 5 +
3 files changed, 3 insertions(+), 10 deletions(-)
diff --git a/landing-pages/site/assets/scss/_navbar.scss
b/landing-pages/site/assets/scss/_navbar.scss
index 64b88e2a90..840043f398 100644
--- a/landing-pages/site/assets/scss/_navbar.scss
+++ b/landing-pages/site/assets/scss/_navbar.scss
@@ -125,8 +125,7 @@
&__drawer {
position: fixed;
- //top: 77px;
- top: 117px; // TEMP - accommodate Airflow Summit banner (77 + 40)
+ top: 77px;
left: 0;
width: 100%;
height: calc(100% - 77px);
diff --git a/landing-pages/site/layouts/partials/navbar.html
b/landing-pages/site/layouts/partials/navbar.html
index 3dce4c570f..8820cf0187 100644
--- a/landing-pages/site/layouts/partials/navbar.html
+++ b/landing-pages/site/layouts/partials/navbar.html
@@ -18,10 +18,7 @@
*/}}
{{ $cover := .HasShortcode "blocks/cover" }}
-https://airflowsummit.org"; target="_blank" class="d-block fixed-top
px-3 py-2 bg-success text-center text-bold text-white">
-Airflow Summit 2024 is coming September 10-12. Register now!
-
-
+
{{ with resources.Get "icons/airflow-logo.svg" }}{{ .Content |
safeHTML }}{{ end }}
diff --git a/sphinx_airflow_theme/sphinx_airflow_theme/header.html
b/sphinx_airflow_theme/sphinx_airflow_theme/header.html
index 0c5b4ee248..f8f1d64554 100644
--- a/sphinx_airflow_theme/sphinx_airflow_theme/header.html
+++ b/sphinx_airflow_theme/sphinx_airflow_theme/header.html
@@ -18,10 +18,7 @@
#}
-https://airflowsummit.org"; target="_blank" class="d-block
fixed-top px-3 py-2 bg-success text-center text-bold text-white">
-Airflow Summit 2024 is coming September 10-12. Register now!
-
-
+
http://www.w3.org/2000/svg"; width="155.314"
height="60" viewBox="0 0 155.314 60">
(airflow-site) branch main updated: Add Scarf details in 2.10 Announcement blog post (#1076)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new e59cd0d608 Add Scarf details in 2.10 Announcement blog post (#1076) e59cd0d608 is described below commit e59cd0d6088e92ec0ba14288df5a232cc374550c Author: Kaxil Naik AuthorDate: Tue Oct 8 18:20:06 2024 +0100 Add Scarf details in 2.10 Announcement blog post (#1076) --- landing-pages/site/content/en/blog/airflow-2.10.0/index.md | 7 +++ 1 file changed, 7 insertions(+) diff --git a/landing-pages/site/content/en/blog/airflow-2.10.0/index.md b/landing-pages/site/content/en/blog/airflow-2.10.0/index.md index befc121f96..20661df07f 100644 --- a/landing-pages/site/content/en/blog/airflow-2.10.0/index.md +++ b/landing-pages/site/content/en/blog/airflow-2.10.0/index.md @@ -19,6 +19,13 @@ I'm happy to announce that Apache Airflow 2.10.0 is now available, bringing an a 🐳 Docker Image: "docker pull apache/airflow:2.10.0" \ 🚏 Constraints: <https://github.com/apache/airflow/tree/constraints-2.10.0> +## Airflow now collects Telemetry data by default + +With the release of Airflow 2.10.0, we’ve introduced the collection of basic telemetry data, as outlined [here](https://airflow.apache.org/docs/apache-airflow/2.10.0/faq.html#does-airflow-collect-any-telemetry-data). This data will play a crucial role in helping Airflow maintainers gain a deeper understanding of how Airflow is utilized across various deployments. The insights derived from this information are invaluable in guiding the prioritization of patches, minor releases, and securi [...] + +For those who prefer not to participate in data collection, deployments can easily opt-out by setting the `[usage_data_collection] enabled` option to `False` or by using the `SCARF_ANALYTICS=false` environment variable. + + ## Multiple Executor Configuration (formerly "Hybrid Execution") Each executor comes with its unique set of strengths and weaknesses, typically balancing latency, isolation, and compute efficiency. Traditionally, an Airflow environment is limited to a single executor, requiring users to make trade-offs, as no single executor is perfectly suited for all types of tasks.
(airflow-site) branch kaxil-patch-1 created (now 46f21c1211)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 46f21c1211 Add Scarf details in 2.10 Announcement blog post This branch includes the following new commits: new 46f21c1211 Add Scarf details in 2.10 Announcement blog post The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(airflow-site) 01/01: Add Scarf details in 2.10 Announcement blog post
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit 46f21c121130acffba3ddaba5dbc8d38bfd96641 Author: Kaxil Naik AuthorDate: Tue Oct 8 18:00:42 2024 +0100 Add Scarf details in 2.10 Announcement blog post --- landing-pages/site/content/en/blog/airflow-2.10.0/index.md | 7 +++ 1 file changed, 7 insertions(+) diff --git a/landing-pages/site/content/en/blog/airflow-2.10.0/index.md b/landing-pages/site/content/en/blog/airflow-2.10.0/index.md index befc121f96..20661df07f 100644 --- a/landing-pages/site/content/en/blog/airflow-2.10.0/index.md +++ b/landing-pages/site/content/en/blog/airflow-2.10.0/index.md @@ -19,6 +19,13 @@ I'm happy to announce that Apache Airflow 2.10.0 is now available, bringing an a 🐳 Docker Image: "docker pull apache/airflow:2.10.0" \ 🚏 Constraints: <https://github.com/apache/airflow/tree/constraints-2.10.0> +## Airflow now collects Telemetry data by default + +With the release of Airflow 2.10.0, we’ve introduced the collection of basic telemetry data, as outlined [here](https://airflow.apache.org/docs/apache-airflow/2.10.0/faq.html#does-airflow-collect-any-telemetry-data). This data will play a crucial role in helping Airflow maintainers gain a deeper understanding of how Airflow is utilized across various deployments. The insights derived from this information are invaluable in guiding the prioritization of patches, minor releases, and securi [...] + +For those who prefer not to participate in data collection, deployments can easily opt-out by setting the `[usage_data_collection] enabled` option to `False` or by using the `SCARF_ANALYTICS=false` environment variable. + + ## Multiple Executor Configuration (formerly "Hybrid Execution") Each executor comes with its unique set of strengths and weaknesses, typically balancing latency, isolation, and compute efficiency. Traditionally, an Airflow environment is limited to a single executor, requiring users to make trade-offs, as no single executor is perfectly suited for all types of tasks.
(airflow) branch main updated (8267c332b8 -> 1379376b66)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 8267c332b8 Switch to using emulation for image building (#41959) add 1379376b66 Add TODOs in providers code for Subdag code removal (#41963) No new revisions were added by this update. Summary of changes: airflow/providers/cncf/kubernetes/operators/pod.py | 1 + airflow/providers/cncf/kubernetes/operators/spark_kubernetes.py | 1 + airflow/providers/fab/auth_manager/security_manager/override.py | 2 ++ 3 files changed, 4 insertions(+)
(airflow-site) branch update-sboms deleted (was cf0ed50bc8)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch update-sboms in repository https://gitbox.apache.org/repos/asf/airflow-site.git was cf0ed50bc8 Regenerated SBOM files for 2.7-2.9 using latest CDXGEN and more combos The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch kaxil-patch-2 deleted (was a818276df0)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was a818276df0 Update build.yml The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch dask deleted (was b70120e764)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch dask in repository https://gitbox.apache.org/repos/asf/airflow-site.git was b70120e764 Fix daskexecutor provider docs The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-jens-to-pmc-members deleted (was 5a79f092f9)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-jens-to-pmc-members in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 5a79f092f9 Move Jens to PMC members The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch kaxil-patch-1 updated (0909357149 -> 6ae34acc7a)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 0909357149 Update build.yml add 6ae34acc7a Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 6 ++ 1 file changed, 6 insertions(+)
(airflow-site) branch kaxil-patch-1 updated (05a324e0d2 -> 0909357149)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 05a324e0d2 Update build.yml add 0909357149 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
(airflow-site) branch kaxil-patch-1 updated (67ec634410 -> 05a324e0d2)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 67ec634410 Update build.yml add 05a324e0d2 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
(airflow-site) branch kaxil-patch-2 updated (b03df4aebf -> a818276df0)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from b03df4aebf Apply suggestions from code review add a818276df0 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 15 ++- 1 file changed, 10 insertions(+), 5 deletions(-)
(airflow-site) branch kaxil-patch-1 updated (cfa65acf28 -> 67ec634410)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from cfa65acf28 Apply suggestions from code review add 67ec634410 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow-site) branch kaxil-patch-2 updated (6d9fc35d58 -> b03df4aebf)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 6d9fc35d58 Apply suggestions from code review add b03df4aebf Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 1 + 1 file changed, 1 insertion(+)
(airflow-site) branch kaxil-patch-2 updated (9cad380e02 -> 6d9fc35d58)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 9cad380e02 Update build.yml add 6d9fc35d58 Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow-site) branch kaxil-patch-1 updated (922bace78f -> cfa65acf28)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 922bace78f Apply suggestions from code review add cfa65acf28 Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 1 - 1 file changed, 1 deletion(-)
(airflow-site) branch kaxil-patch-1 updated (ee56b4a32b -> 922bace78f)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from ee56b4a32b Apply suggestions from code review add 922bace78f Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 ++ 1 file changed, 2 insertions(+)
(airflow-site) branch kaxil-patch-2 updated (92c7cd1df2 -> 9cad380e02)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 92c7cd1df2 Try using arm add 9cad380e02 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow-site) branch kaxil-patch-1 updated (e8fb9f53d3 -> ee56b4a32b)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from e8fb9f53d3 Apply suggestions from code review add ee56b4a32b Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 4 1 file changed, 4 insertions(+)
(airflow-site) branch kaxil-patch-2 created (now 92c7cd1df2)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-2 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 92c7cd1df2 Try using arm No new revisions were added by this update.
(airflow-site) branch kaxil-patch-1 updated (b726a229eb -> e8fb9f53d3)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from b726a229eb Apply suggestions from code review add e8fb9f53d3 Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
(airflow-site) branch kaxil-patch-1 updated (5499932ccb -> b726a229eb)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 5499932ccb Apply suggestions from code review add b726a229eb Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 ++ 1 file changed, 2 insertions(+)
(airflow-site) branch kaxil-patch-1 updated (8bd0948dc5 -> 5499932ccb)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 8bd0948dc5 Update build.yml add 5499932ccb Apply suggestions from code review No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 3 --- 1 file changed, 3 deletions(-)
(airflow-site) branch kaxil-patch-1 updated (049f67fdcd -> 8bd0948dc5)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 049f67fdcd Update build.yml add 8bd0948dc5 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 26 +++--- 1 file changed, 15 insertions(+), 11 deletions(-)
(airflow-site) branch kaxil-patch-1 updated (305fee1955 -> 049f67fdcd)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 305fee1955 Update build.yml add 049f67fdcd Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow-site) branch kaxil-patch-1 updated (2f1cb77ca0 -> 305fee1955)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 2f1cb77ca0 Change directory to Mounted dir add 305fee1955 Update build.yml No new revisions were added by this update. Summary of changes: .github/workflows/build.yml | 1 - 1 file changed, 1 deletion(-)
(airflow-site) branch kaxil-patch-1 created (now 2f1cb77ca0)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 2f1cb77ca0 Change directory to Mounted dir No new revisions were added by this update.
(airflow-site) branch kaxil-patch-1 deleted (was 3333a68eec)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was a68eec Switch to public runners The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch main updated: Switch to public runners (#1054)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new 91023639ef Switch to public runners (#1054) 91023639ef is described below commit 91023639ef606a7c710126ad2743aaf6f61482b5 Author: Kaxil Naik AuthorDate: Fri Aug 16 00:16:29 2024 +0100 Switch to public runners (#1054) https://github.com/apache/airflow-site/actions/runs/10386270974 This request was automatically failed because there were no enabled runners online to process the request for more than 1 days. Based on https://github.com/apache/airflow-site/actions/runners we only have ARM runners for ASF-hosted so far now falling back to public runners --- .github/workflows/build.yml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/.github/workflows/build.yml b/.github/workflows/build.yml index b770f705ff..da826597a6 100644 --- a/.github/workflows/build.yml +++ b/.github/workflows/build.yml @@ -24,7 +24,7 @@ on: jobs: build: -runs-on: ["self-hosted", "asf-runner"] +runs-on: ["ubuntu-22.04"] steps: # Based on https://github.com/actions/runner-images/issues/2840 - name: 🪓 Remove some stuff we don't need
(airflow-site) branch kaxil-patch-1 created (now 3333a68eec)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at a68eec Switch to public runners No new revisions were added by this update.
(airflow) branch main updated (325f545d08 -> 393978d65c)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 325f545d08 Fix variable interpolation in Airflow core release guide (#41510) add 393978d65c fix: docker decorator pyi signature (#41509) No new revisions were added by this update. Summary of changes: airflow/decorators/__init__.pyi | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
(airflow) branch main updated (a70ee7209c -> 325f545d08)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from a70ee7209c Add incremental export and cross account export functionality in `DynamoDBToS3Operator` (#41304) add 325f545d08 Fix variable interpolation in Airflow core release guide (#41510) No new revisions were added by this update. Summary of changes: dev/README_RELEASE_AIRFLOW.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow) branch main updated (736ebfe3fe -> 6570c6d1bb)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 736ebfe3fe Fix tests/models/test_variable.py for database isolation mode (#41414) add 6570c6d1bb Remove deprecated SubDags (#41390) No new revisions were added by this update. Summary of changes: airflow/api/common/delete_dag.py | 26 +- airflow/api/common/mark_tasks.py | 106 +- airflow/api/common/trigger_dag.py | 30 +- airflow/api_connexion/endpoints/dag_endpoint.py|7 +- .../api_connexion/endpoints/dag_run_endpoint.py|4 - airflow/api_connexion/openapi/v1.yaml | 17 - airflow/api_connexion/schemas/dag_schema.py|2 - .../api_connexion/schemas/task_instance_schema.py |2 - airflow/api_connexion/schemas/task_schema.py |2 - airflow/cli/cli_config.py |8 - airflow/cli/commands/dag_command.py|3 - airflow/cli/commands/task_command.py |2 - airflow/dag_processing/processor.py|2 - airflow/example_dags/example_subdag_operator.py| 70 - airflow/example_dags/subdags/__init__.py | 17 - airflow/example_dags/subdags/subdag.py | 56 - airflow/jobs/backfill_job_runner.py| 28 +- .../versions/0003_3_0_0_remove_is_subdag.py| 76 + airflow/models/baseoperator.py |5 - airflow/models/dag.py | 174 +- airflow/models/dagbag.py | 59 +- airflow/models/dagrun.py |1 - airflow/models/mappedoperator.py |6 - airflow/models/serialized_dag.py | 21 +- airflow/models/taskinstance.py |7 +- airflow/operators/__init__.py |4 - airflow/operators/subdag.py| 247 --- .../celery/executors/celery_executor_utils.py |3 +- airflow/providers/cncf/kubernetes/operators/pod.py |5 +- .../cncf/kubernetes/operators/spark_kubernetes.py |2 +- .../providers/fab/auth_manager/fab_auth_manager.py |2 +- .../fab/auth_manager/security_manager/override.py |4 +- airflow/serialization/pydantic/dag.py |3 - airflow/serialization/schema.json |1 - airflow/serialization/serialized_objects.py|5 - airflow/utils/db.py|2 +- airflow/utils/task_group.py|8 +- .../www/static/js/dag/details/taskInstance/Nav.tsx | 24 +- .../static/js/dag/details/taskInstance/index.tsx |2 - airflow/www/static/js/types/api-generated.ts |8 - airflow/www/templates/airflow/dag.html | 40 +- airflow/www/views.py | 11 +- .../administration-and-deployment/pools.rst|5 - docs/apache-airflow/core-concepts/dags.rst | 92 +- docs/apache-airflow/core-concepts/overview.rst |2 +- docs/apache-airflow/img/airflow_erd.sha256 |2 +- docs/apache-airflow/img/airflow_erd.svg| 2206 ++-- docs/apache-airflow/img/subdag_after.png | Bin 30245 -> 0 bytes docs/apache-airflow/img/subdag_before.png | Bin 70382 -> 0 bytes docs/apache-airflow/img/subdag_zoom.png| Bin 145017 -> 0 bytes docs/apache-airflow/migrations-ref.rst | 17 +- docs/apache-airflow/operators-and-hooks-ref.rst|3 - newsfragments/41390.significant.rst| 14 + tests/always/test_example_dags.py |5 - tests/api_connexion/endpoints/test_dag_endpoint.py | 78 +- .../endpoints/test_dag_run_endpoint.py | 16 +- .../endpoints/test_dag_stats_endpoint.py |2 +- tests/api_connexion/endpoints/test_log_endpoint.py |6 +- .../endpoints/test_task_instance_endpoint.py | 60 +- tests/api_connexion/schemas/test_dag_schema.py | 10 - tests/api_experimental/common/test_delete_dag.py | 18 +- tests/api_experimental/common/test_mark_tasks.py | 40 +- tests/api_experimental/common/test_trigger_dag.py | 40 +- tests/cli/commands/test_task_command.py| 16 - tests/conftest.py | 11 +- tests/core/test_impersonation_tests.py |5 - tests/dags/test_clear_subdag.py| 72 - tests/dags/test_impersonation_subdag.py| 55 - tests/dags/test_subdag.py | 86 - tests/jobs/test_backfill_job.py| 148 -- tests/jobs/test_local_task_job.py |2 +- tests/jobs/test_scheduler_job.py |4 +- tests/models/test_dag.py | 280 +-- tests/models/test_
(airflow) branch main updated (4ce0cd5f13 -> 51867f02e0)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from 4ce0cd5f13 Add WebEncoder for trigger page rendering to avoid render failure (#41350) add 51867f02e0 Remove label when Bug Report is not stale (#41408) No new revisions were added by this update. Summary of changes: .github/workflows/recheck-old-bug-report.yml | 1 + 1 file changed, 1 insertion(+)
(airflow) branch main updated (d12eb43960 -> 6b9b1b225d)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from d12eb43960 feat: add debug facet to all OpenLineage events (#41217) add 6b9b1b225d Remove deprecations from `airflow.executors` & `airflow.utils` (#41395) No new revisions were added by this update. Summary of changes: airflow/executors/executor_loader.py | 8 -- airflow/settings.py| 1 - airflow/utils/dag_cycle_tester.py | 19 +- airflow/utils/file.py | 34 -- airflow/utils/state.py | 25 --- newsfragments/41395.significant.rst| 11 + tests/models/test_cleartasks.py| 1 - tests/www/views/test_views_cluster_activity.py | 2 -- tests/www/views/test_views_home.py | 2 +- 9 files changed, 13 insertions(+), 90 deletions(-) create mode 100644 newsfragments/41395.significant.rst
(airflow) branch main updated: Remove deprecated ``TaskMixin`` class (#41394)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 61a181fd59 Remove deprecated ``TaskMixin`` class (#41394)
61a181fd59 is described below
commit 61a181fd59d788d291ac47a2f45ebd96f6b2e403
Author: Kaxil Naik
AuthorDate: Mon Aug 12 03:31:15 2024 +0100
Remove deprecated ``TaskMixin`` class (#41394)
The ``airflow.models.taskMixin.TaskMixin`` class has been removed. It was
previously
deprecated in favor of the ``airflow.models.taskMixin.DependencyMixin``
class.
---
airflow/models/taskmixin.py | 21 ++---
airflow/models/xcom_arg.py | 8
airflow/utils/task_group.py | 4 ++--
newsfragments/41394.significant.rst | 6 ++
4 files changed, 14 insertions(+), 25 deletions(-)
diff --git a/airflow/models/taskmixin.py b/airflow/models/taskmixin.py
index e1520d23da..05768ff36f 100644
--- a/airflow/models/taskmixin.py
+++ b/airflow/models/taskmixin.py
@@ -16,11 +16,10 @@
# under the License.
from __future__ import annotations
-import warnings
from abc import ABCMeta, abstractmethod
from typing import TYPE_CHECKING, Any, Iterable, Sequence
-from airflow.exceptions import AirflowException, RemovedInAirflow3Warning
+from airflow.exceptions import AirflowException
from airflow.utils.types import NOTSET
if TYPE_CHECKING:
@@ -89,7 +88,7 @@ class DependencyMixin:
self, other: DependencyMixin, upstream: bool = True, edge_modifier:
EdgeModifier | None = None
) -> None:
"""
-Update relationship information about another TaskMixin. Default is
no-op.
+Update relationship information about another DependencyMixin. Default
is no-op.
Override if necessary.
"""
@@ -128,22 +127,6 @@ class DependencyMixin:
yield from cls._iter_references(o)
-class TaskMixin(DependencyMixin):
-"""
-Mixin to provide task-related things.
-
-:meta private:
-"""
-
-def __init_subclass__(cls) -> None:
-warnings.warn(
-f"TaskMixin has been renamed to DependencyMixin, please update
{cls.__name__}",
-category=RemovedInAirflow3Warning,
-stacklevel=2,
-)
-return super().__init_subclass__()
-
-
class DAGNode(DependencyMixin, metaclass=ABCMeta):
"""
A base class for a node in the graph of a workflow.
diff --git a/airflow/models/xcom_arg.py b/airflow/models/xcom_arg.py
index 590327eaa9..83ff4f25c6 100644
--- a/airflow/models/xcom_arg.py
+++ b/airflow/models/xcom_arg.py
@@ -135,12 +135,12 @@ class XComArg(ResolveMixin, DependencyMixin):
@property
def roots(self) -> list[DAGNode]:
-"""Required by TaskMixin."""
+"""Required by DependencyMixin."""
return [op for op, _ in self.iter_references()]
@property
def leaves(self) -> list[DAGNode]:
-"""Required by TaskMixin."""
+"""Required by DependencyMixin."""
return [op for op, _ in self.iter_references()]
def set_upstream(
@@ -148,7 +148,7 @@ class XComArg(ResolveMixin, DependencyMixin):
task_or_task_list: DependencyMixin | Sequence[DependencyMixin],
edge_modifier: EdgeModifier | None = None,
):
-"""Proxy to underlying operator set_upstream method. Required by
TaskMixin."""
+"""Proxy to underlying operator set_upstream method. Required by
DependencyMixin."""
for operator, _ in self.iter_references():
operator.set_upstream(task_or_task_list, edge_modifier)
@@ -157,7 +157,7 @@ class XComArg(ResolveMixin, DependencyMixin):
task_or_task_list: DependencyMixin | Sequence[DependencyMixin],
edge_modifier: EdgeModifier | None = None,
):
-"""Proxy to underlying operator set_downstream method. Required by
TaskMixin."""
+"""Proxy to underlying operator set_downstream method. Required by
DependencyMixin."""
for operator, _ in self.iter_references():
operator.set_downstream(task_or_task_list, edge_modifier)
diff --git a/airflow/utils/task_group.py b/airflow/utils/task_group.py
index d1dd9822be..f3d46ea6ea 100644
--- a/airflow/utils/task_group.py
+++ b/airflow/utils/task_group.py
@@ -369,12 +369,12 @@ class TaskGroup(DAGNode):
@property
def roots(self) -> list[BaseOperator]:
-"""Required by TaskMixin."""
+"""Required by DependencyMixin."""
return
(airflow) branch main updated: Remove deprecated `ExternalTaskSensorLink` (#41391)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 61928bc454 Remove deprecated `ExternalTaskSensorLink` (#41391)
61928bc454 is described below
commit 61928bc454d15951921a73ec5c315b3661551b05
Author: Kaxil Naik
AuthorDate: Mon Aug 12 02:46:15 2024 +0100
Remove deprecated `ExternalTaskSensorLink` (#41391)
It is replaced by `airflow.sensors.external_task.ExternalDagLink`
---
airflow/sensors/external_task.py | 21 +
newsfragments/41391.significant.rst| 5 +
tests/sensors/test_external_task_sensor.py | 9 -
3 files changed, 6 insertions(+), 29 deletions(-)
diff --git a/airflow/sensors/external_task.py b/airflow/sensors/external_task.py
index 339ad79056..8eb501e281 100644
--- a/airflow/sensors/external_task.py
+++ b/airflow/sensors/external_task.py
@@ -22,10 +22,8 @@ import os
import warnings
from typing import TYPE_CHECKING, Any, Callable, Collection, Iterable
-import attr
-
from airflow.configuration import conf
-from airflow.exceptions import AirflowException, AirflowSkipException,
RemovedInAirflow3Warning
+from airflow.exceptions import AirflowException, AirflowSkipException
from airflow.models.baseoperatorlink import BaseOperatorLink
from airflow.models.dag import DagModel
from airflow.models.dagbag import DagBag
@@ -511,20 +509,3 @@ class ExternalTaskMarker(EmptyOperator):
if not cls.__serialized_fields:
cls.__serialized_fields =
frozenset(super().get_serialized_fields() | {"recursion_depth"})
return cls.__serialized_fields
-
-
-@attr.s(auto_attribs=True)
-class ExternalTaskSensorLink(ExternalDagLink):
-"""
-This external link is deprecated.
-
-Please use :class:`airflow.sensors.external_task.ExternalDagLink`.
-"""
-
-def __attrs_post_init__(self):
-warnings.warn(
-"This external link is deprecated. "
-"Please use
:class:`airflow.sensors.external_task.ExternalDagLink`.",
-RemovedInAirflow3Warning,
-stacklevel=2,
-)
diff --git a/newsfragments/41391.significant.rst
b/newsfragments/41391.significant.rst
new file mode 100644
index 00..6ab26848f0
--- /dev/null
+++ b/newsfragments/41391.significant.rst
@@ -0,0 +1,5 @@
+**Breaking Change**
+
+The ``airflow.sensors.external_task.ExternalTaskSensorLink`` class has been
removed.
+This class was deprecated and is no longer available. Users should now use
+the ``airflow.sensors.external_task.ExternalDagLink`` class directly.
diff --git a/tests/sensors/test_external_task_sensor.py
b/tests/sensors/test_external_task_sensor.py
index fbebd3d120..8c5ed3c429 100644
--- a/tests/sensors/test_external_task_sensor.py
+++ b/tests/sensors/test_external_task_sensor.py
@@ -41,7 +41,6 @@ from airflow.operators.python import PythonOperator
from airflow.sensors.external_task import (
ExternalTaskMarker,
ExternalTaskSensor,
-ExternalTaskSensorLink,
)
from airflow.sensors.time_sensor import TimeSensor
from airflow.serialization.serialized_objects import SerializedBaseOperator
@@ -1737,11 +1736,3 @@ def
test_clear_overlapping_external_task_marker_mapped_tasks(dag_bag_head_tail_m
)
== 70
)
-
-
-class TestExternalTaskSensorLink:
-def test_deprecation_warning(self):
-with pytest.warns(DeprecationWarning) as warnings:
-ExternalTaskSensorLink()
-assert len(warnings) == 1
-assert warnings[0].filename == __file__
(airflow) branch main updated (b809ee1e8c -> aa047d7b46)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from b809ee1e8c Remove deprecated ``ImportError`` from ``airflow.models`` (#41367) add aa047d7b46 Remove deprecated param in `DayOfWeekSensor` (#41393) No new revisions were added by this update. Summary of changes: airflow/sensors/weekday.py| 11 --- newsfragments/newsfragments/41393.significant.rst | 18 ++ tests/sensors/test_weekday_sensor.py | 15 --- 3 files changed, 18 insertions(+), 26 deletions(-) create mode 100644 newsfragments/newsfragments/41393.significant.rst
(airflow) branch main updated: Remove deprecated ``ImportError`` from ``airflow.models`` (#41367)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new b809ee1e8c Remove deprecated ``ImportError`` from ``airflow.models``
(#41367)
b809ee1e8c is described below
commit b809ee1e8c97571ed406c9cc8508a2c07cf7ce86
Author: Jed Cunningham <66968678+jedcunning...@users.noreply.github.com>
AuthorDate: Sun Aug 11 19:03:42 2024 -0600
Remove deprecated ``ImportError`` from ``airflow.models`` (#41367)
---
airflow/models/__init__.py | 25 +
newsfragments/41367.significant.rst | 4
2 files changed, 9 insertions(+), 20 deletions(-)
diff --git a/airflow/models/__init__.py b/airflow/models/__init__.py
index bbf9c13567..9754df4156 100644
--- a/airflow/models/__init__.py
+++ b/airflow/models/__init__.py
@@ -69,28 +69,13 @@ def import_all_models():
def __getattr__(name):
# PEP-562: Lazy loaded attributes on python modules
-if name != "ImportError":
-path = __lazy_imports.get(name)
-if not path:
-raise AttributeError(f"module {__name__!r} has no attribute
{name!r}")
+path = __lazy_imports.get(name)
+if not path:
+raise AttributeError(f"module {__name__!r} has no attribute {name!r}")
-from airflow.utils.module_loading import import_string
+from airflow.utils.module_loading import import_string
-val = import_string(f"{path}.{name}")
-else:
-import warnings
-
-from airflow.exceptions import RemovedInAirflow3Warning
-from airflow.models.errors import ParseImportError
-
-warnings.warn(
-f"Import '{__name__}.ImportError' is deprecated due to shadowing
with builtin exception "
-f"ImportError and will be removed in the future. "
-f"Please consider to use
'{ParseImportError.__module__}.ParseImportError' instead.",
-RemovedInAirflow3Warning,
-stacklevel=2,
-)
-val = ParseImportError
+val = import_string(f"{path}.{name}")
# Store for next time
globals()[name] = val
diff --git a/newsfragments/41367.significant.rst
b/newsfragments/41367.significant.rst
new file mode 100644
index 00..410d5941bf
--- /dev/null
+++ b/newsfragments/41367.significant.rst
@@ -0,0 +1,4 @@
+Deprecated ``ImportError`` removed from ``airflow.models``
+
+The deprecated ``ImportError`` class can no longer be imported from
``airflow.models``.
+It has been moved to ``airflow.models.errors.ParseImportError``.
(airflow) branch main updated: Limit parallelism for constraints generation in CI (#41383)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new fffd41e9d9 Limit parallelism for constraints generation in CI (#41383)
fffd41e9d9 is described below
commit fffd41e9d9f0ff994d6cf7ea5a4a8c4859b5c0cc
Author: Jarek Potiuk
AuthorDate: Mon Aug 12 02:20:05 2024 +0200
Limit parallelism for constraints generation in CI (#41383)
Apparently constraints generation in 4 parallel docker containers causes
"no space left on device" error for public runners. This one limits
parallelism to 3 to limit disk usage
---
.github/workflows/generate-constraints.yml | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/.github/workflows/generate-constraints.yml
b/.github/workflows/generate-constraints.yml
index 207fd4339c..d6e536dfd0 100644
--- a/.github/workflows/generate-constraints.yml
+++ b/.github/workflows/generate-constraints.yml
@@ -95,7 +95,7 @@ jobs:
timeout-minutes: 25
run: >
breeze release-management generate-constraints --run-in-parallel
- --airflow-constraints-mode constraints-no-providers --answer yes
+ --airflow-constraints-mode constraints-no-providers --answer yes
--parallelism 3
# The no providers constraints are only needed when we want to update
constraints (in canary builds)
# They slow down the start of PROD image builds so we want to only run
them when needed.
if: inputs.generate-no-providers-constraints == 'true'
@@ -115,7 +115,7 @@ jobs:
run: >
breeze release-management generate-constraints --run-in-parallel
--airflow-constraints-mode constraints --answer yes
- --chicken-egg-providers "${{ inputs.chicken-egg-providers }}"
+ --chicken-egg-providers "${{ inputs.chicken-egg-providers }}"
--parallelism 3
- name: "Dependency upgrade summary"
shell: bash
run: |
(airflow) branch main updated (ec0e9f28ea -> c81d8f9d3c)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from ec0e9f28ea feat: add fileloc to DAG info in AirflowRunFacet (#41311) add c81d8f9d3c Add plugin data to scarf usage data collection (#41318) No new revisions were added by this update. Summary of changes: airflow/utils/usage_data_collection.py | 13 + airflow/www/views.py | 9 - docs/apache-airflow/faq.rst| 2 ++ tests/www/views/test_views.py | 23 --- 4 files changed, 39 insertions(+), 8 deletions(-)
(airflow) branch main updated: Airflow 2.9.3 has been released (#40815)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 7014eaa59f Airflow 2.9.3 has been released (#40815) 7014eaa59f is described below commit 7014eaa59f013b2a0d4d47a6040881ea618477eb Author: Utkarsh Sharma AuthorDate: Tue Jul 16 19:09:52 2024 +0530 Airflow 2.9.3 has been released (#40815) --- .github/ISSUE_TEMPLATE/airflow_bug_report.yml | 2 +- Dockerfile | 2 +- README.md | 12 ++-- RELEASE_NOTES.rst | 72 ++ airflow/reproducible_build.yaml| 4 +- .../installation/supported-versions.rst| 2 +- generated/PYPI_README.md | 10 +-- newsfragments/37936.significant.rst| 4 -- newsfragments/40286.significant.rst| 1 - scripts/ci/pre_commit/supported_versions.py| 2 +- 10 files changed, 89 insertions(+), 22 deletions(-) diff --git a/.github/ISSUE_TEMPLATE/airflow_bug_report.yml b/.github/ISSUE_TEMPLATE/airflow_bug_report.yml index ae4cc2fd73..ec5ff38325 100644 --- a/.github/ISSUE_TEMPLATE/airflow_bug_report.yml +++ b/.github/ISSUE_TEMPLATE/airflow_bug_report.yml @@ -25,7 +25,7 @@ body: the latest release or main to see if the issue is fixed before reporting it. multiple: false options: -- "2.9.2" +- "2.9.3" - "main (development)" - "Other Airflow 2 version (please specify below)" validations: diff --git a/Dockerfile b/Dockerfile index 949650a0d0..1915a6e801 100644 --- a/Dockerfile +++ b/Dockerfile @@ -45,7 +45,7 @@ ARG AIRFLOW_UID="5" ARG AIRFLOW_USER_HOME_DIR=/home/airflow # latest released version here -ARG AIRFLOW_VERSION="2.9.2" +ARG AIRFLOW_VERSION="2.9.3" ARG PYTHON_BASE_IMAGE="python:3.8-slim-bookworm" diff --git a/README.md b/README.md index 6bb7024eb7..a31b4cd3bd 100644 --- a/README.md +++ b/README.md @@ -97,7 +97,7 @@ Airflow is not a streaming solution, but it is often used to process real-time d Apache Airflow is tested with: -| | Main version (dev) | Stable version (2.9.2) | +| | Main version (dev) | Stable version (2.9.3) | |-|--|| | Python | 3.8, 3.9, 3.10, 3.11, 3.12 | 3.8, 3.9, 3.10, 3.11, 3.12 | | Platform| AMD64/ARM64(\*) | AMD64/ARM64(\*)| @@ -124,7 +124,7 @@ as this is the only environment that is supported. The only distro that is used is used in the [Community managed DockerHub image](https://hub.docker.com/p/apache/airflow) is `Debian Bookworm`. We also have support for legacy ``Debian Bullseye`` base image if you want to build a custom image but it is deprecated and option to do it will be removed in the Dockerfile that -will accompany Airflow 2.9.2 so you are advised to switch to ``Debian Bookworm`` for your custom images. +will accompany Airflow 2.9.3 so you are advised to switch to ``Debian Bookworm`` for your custom images. @@ -179,15 +179,15 @@ them to the appropriate format and workflow that your tool requires. ```bash -pip install 'apache-airflow==2.9.2' \ - --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.9.2/constraints-3.8.txt"; +pip install 'apache-airflow==2.9.3' \ + --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.9.3/constraints-3.8.txt"; ``` 2. Installing with extras (i.e., postgres, google) ```bash pip install 'apache-airflow[postgres,google]==2.8.3' \ - --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.9.2/constraints-3.8.txt"; + --constraint "https://raw.githubusercontent.com/apache/airflow/constraints-2.9.3/constraints-3.8.txt"; ``` For information on installing provider packages, check @@ -292,7 +292,7 @@ Apache Airflow version life cycle: | Version | Current Patch/Minor | State | First Release | Limited Support | EOL/Terminated | |---|---|---|-|---|--| -| 2 | 2.9.2 | Supported | Dec 17, 2020| TBD | TBD | +| 2 | 2.9.3 | Supported | Dec 17, 2020| TBD | TBD | | 1.10 | 1.10.15 | EOL | Aug 27, 2018| Dec 17, 2020 | June 17, 2021| | 1.9 | 1.9.0 | EOL | Jan 03, 2018| Aug 27, 2018 | Aug 27, 2018 | | 1.8 | 1.8.2 |
(airflow-site) branch new created (now 0623285288)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch new in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 0623285288 More cases No new revisions were added by this update.
(airflow-site) branch new deleted (was 7253720fd3)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch new in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 7253720fd3 Delete docs-archive/apache-airflow/1.10.8/_modules/airflow/operators/sed9yAJix The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch main updated: More cases for Apache Airflow® (#1041)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new cd82881a48 More cases for Apache Airflow® (#1041) cd82881a48 is described below commit cd82881a48678e1ce045621bda87c20298d7cc56 Author: Kaxil Naik AuthorDate: Mon Jul 15 14:59:21 2024 +0530 More cases for Apache Airflow® (#1041) * More cases * Delete docs-archive/apache-airflow/1.10.8/_modules/airflow/operators/sed9yAJix --- landing-pages/site/content/en/docs/_index.md | 2 +- landing-pages/site/content/en/ecosystem/_index.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/landing-pages/site/content/en/docs/_index.md b/landing-pages/site/content/en/docs/_index.md index 592aa9d77f..8a18c71d19 100644 --- a/landing-pages/site/content/en/docs/_index.md +++ b/landing-pages/site/content/en/docs/_index.md @@ -9,7 +9,7 @@ menu: # Documentation -## [Apache Airflow®](/docs/apache-airflow/stable/index.html) +## [Apache Airflow®](/docs/apache-airflow/stable/index.html) Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation. [Read the documentation >>](/docs/apache-airflow/stable/index.html) diff --git a/landing-pages/site/content/en/ecosystem/_index.md b/landing-pages/site/content/en/ecosystem/_index.md index 3db4d3d2fc..99807b5c1d 100644 --- a/landing-pages/site/content/en/ecosystem/_index.md +++ b/landing-pages/site/content/en/ecosystem/_index.md @@ -11,7 +11,7 @@ menu: # Ecosystem -These resources and services are not maintained, nor endorsed by the Apache Airflow™ Community and Apache Airflow project (maintained by the Committers and the Airflow PMC). Use them at your sole discretion. The community does not verify the licences nor validity of those tools, so it's your responsibility to verify them. +These resources and services are not maintained, nor endorsed by the Apache Airflow® Community and Apache Airflow project (maintained by the Committers and the Airflow PMC). Use them at your sole discretion. The community does not verify the licences nor validity of those tools, so it's your responsibility to verify them. If you would you like to be included on this page, please reach out to the [Apache Airflow dev or user mailing list](https://airflow.apache.org/community/) and let us know or simply open a Pull Request to that page.
(airflow-site) branch new updated (bfc552d06c -> 7253720fd3)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch new in repository https://gitbox.apache.org/repos/asf/airflow-site.git from bfc552d06c Merge branch 'main' into new add 7253720fd3 Delete docs-archive/apache-airflow/1.10.8/_modules/airflow/operators/sed9yAJix No new revisions were added by this update. Summary of changes: .../1.10.8/_modules/airflow/operators/sed9yAJix| 894 - 1 file changed, 894 deletions(-) delete mode 100644 docs-archive/apache-airflow/1.10.8/_modules/airflow/operators/sed9yAJix
(airflow-site) branch new updated (0623285288 -> bfc552d06c)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch new in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 0623285288 More cases add d23b123972 Update more Airflow(TM) mentions to Apache Airflow(R) (#1040) add bfc552d06c Merge branch 'main' into new No new revisions were added by this update. Summary of changes:
(airflow-site) branch kaxil-patch-1 deleted (was da625c1cfd)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was da625c1cfd Update more Airflow(TM) mentions to Apache Airflow(R) The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch main updated: Update more Airflow(TM) mentions to Apache Airflow(R) (#1040)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow-site.git The following commit(s) were added to refs/heads/main by this push: new d23b123972 Update more Airflow(TM) mentions to Apache Airflow(R) (#1040) d23b123972 is described below commit d23b123972bd917b88f01d3a1c65a643e53df67c Author: Kaxil Naik AuthorDate: Mon Jul 15 13:48:14 2024 +0530 Update more Airflow(TM) mentions to Apache Airflow(R) (#1040) --- landing-pages/site/content/en/docs/_index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/landing-pages/site/content/en/docs/_index.md b/landing-pages/site/content/en/docs/_index.md index 1579fda7c4..592aa9d77f 100644 --- a/landing-pages/site/content/en/docs/_index.md +++ b/landing-pages/site/content/en/docs/_index.md @@ -9,7 +9,7 @@ menu: # Documentation -## [Apache Airflow™](/docs/apache-airflow/stable/index.html) +## [Apache Airflow®](/docs/apache-airflow/stable/index.html) Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation. [Read the documentation >>](/docs/apache-airflow/stable/index.html)
(airflow-site) branch kaxil-patch-1 created (now da625c1cfd)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at da625c1cfd Update more Airflow(TM) mentions to Apache Airflow(R) This branch includes the following new commits: new da625c1cfd Update more Airflow(TM) mentions to Apache Airflow(R) The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(airflow-site) 01/01: Update more Airflow(TM) mentions to Apache Airflow(R)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git commit da625c1cfd61bfb1ab273a1db649ff4fc570fc09 Author: Kaxil Naik AuthorDate: Mon Jul 15 13:36:21 2024 +0530 Update more Airflow(TM) mentions to Apache Airflow(R) --- landing-pages/site/content/en/docs/_index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/landing-pages/site/content/en/docs/_index.md b/landing-pages/site/content/en/docs/_index.md index 1579fda7c4..592aa9d77f 100644 --- a/landing-pages/site/content/en/docs/_index.md +++ b/landing-pages/site/content/en/docs/_index.md @@ -9,7 +9,7 @@ menu: # Documentation -## [Apache Airflow™](/docs/apache-airflow/stable/index.html) +## [Apache Airflow®](/docs/apache-airflow/stable/index.html) Apache Airflow Core, which includes webserver, scheduler, CLI and other components that are needed for minimal Airflow installation. [Read the documentation >>](/docs/apache-airflow/stable/index.html)
(airflow) branch main updated: Include fatal reason for pod pending events (#39924)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git
The following commit(s) were added to refs/heads/main by this push:
new 00a2843649 Include fatal reason for pod pending events (#39924)
00a2843649 is described below
commit 00a284364906ced4d71e5109dec8f7f2f3cae076
Author: Alan Ma
AuthorDate: Thu Jun 6 20:23:32 2024 -0700
Include fatal reason for pod pending events (#39924)
---
.../cncf/kubernetes/executors/kubernetes_executor_utils.py | 9 -
1 file changed, 8 insertions(+), 1 deletion(-)
diff --git
a/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py
b/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py
index b8235bb5ac..710d5d1f9b 100644
--- a/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py
+++ b/airflow/providers/cncf/kubernetes/executors/kubernetes_executor_utils.py
@@ -230,7 +230,6 @@ class KubernetesJobWatcher(multiprocessing.Process,
LoggingMixin):
self.kube_config.worker_pod_pending_fatal_container_state_reasons
and "status" in event["raw_object"]
):
-self.log.info("Event: %s Pending, annotations: %s", pod_name,
annotations_string)
# Init containers and base container statuses to check.
# Skipping the other containers statuses check.
container_statuses_to_check = []
@@ -250,10 +249,18 @@ class KubernetesJobWatcher(multiprocessing.Process,
LoggingMixin):
and
container_status_state["waiting"]["message"] == "pull QPS exceeded"
):
continue
+self.log.error(
+"Event: %s has container %s with fatal reason
%s",
+pod_name,
+container_status["name"],
+container_status_state["waiting"]["reason"],
+)
self.watcher_queue.put(
(pod_name, namespace,
TaskInstanceState.FAILED, annotations, resource_version)
)
break
+else:
+self.log.info("Event: %s Pending, annotations: %s",
pod_name, annotations_string)
else:
self.log.debug("Event: %s Pending, annotations: %s", pod_name,
annotations_string)
elif status == "Failed":
(airflow) branch main updated: Add Scarf based telemetry (#39510)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new cd0c6a7e77 Add Scarf based telemetry (#39510) cd0c6a7e77 is described below commit cd0c6a7e77fd687e9fdce74afa064199258ceeef Author: Kaxil Naik AuthorDate: Thu May 16 21:56:33 2024 +0100 Add Scarf based telemetry (#39510) To take [the discussion about adding Telemetry](https://lists.apache.org/thread/7f6qyr8w2n8w34g63s7ybhzphgt8h43m) forward, I am creating a draft PR that adds some basic telemetry to send to Scarf. Voting thread: https://lists.apache.org/thread/h1x2glvnd42rbj2q2rgpfo3pjhmpt307 I have added docs on the data collection as well as a way to opt-out of it. Telemetry added at: - Scheduler startup [Custom telemetry](https://docs.scarf.sh/custom-telemetry/) similar to other popular projects like [Unstructured](https://github.com/Unstructured-IO/unstructured/commit/f0a63e27122972901f72c42b4b5b9eb9bed1ada3) - Webserver via a [tracking pixel](https://docs.scarf.sh/web-traffic/#creating-a-pixel), similar to [Apache Superset](https://github.com/apache/superset/pull/26011/files) Data collected: - Airflow version - Python version - Platform System info: Linux/Darwin - Machine type: arm64/aarch64 - Airflow Metadata DB: Postgres/MySQL - DB: sqlite/postgres - DB version: 12.6.3 - Number of DAGs --- airflow/cli/commands/scheduler_command.py | 3 + airflow/config_templates/config.yml| 22 ++ airflow/settings.py| 7 ++ airflow/utils/scarf.py | 89 ++ airflow/www/templates/airflow/dags.html| 3 + airflow/www/views.py | 34 - docs/apache-airflow/faq.rst| 24 ++ .../installation/installing-from-pypi.rst | 6 ++ tests/core/test_settings.py| 25 +- tests/utils/test_scarf.py | 84 tests/www/views/test_views.py | 30 tests/www/views/test_views_home.py | 14 12 files changed, 339 insertions(+), 2 deletions(-) diff --git a/airflow/cli/commands/scheduler_command.py b/airflow/cli/commands/scheduler_command.py index 2a55ca2373..4f943e961b 100644 --- a/airflow/cli/commands/scheduler_command.py +++ b/airflow/cli/commands/scheduler_command.py @@ -33,6 +33,7 @@ from airflow.jobs.scheduler_job_runner import SchedulerJobRunner from airflow.utils import cli as cli_utils from airflow.utils.cli import process_subdir from airflow.utils.providers_configuration_loader import providers_configuration_loaded +from airflow.utils.scarf import scarf_analytics from airflow.utils.scheduler_health import serve_health_check log = logging.getLogger(__name__) @@ -55,6 +56,8 @@ def scheduler(args: Namespace): """Start Airflow Scheduler.""" print(settings.HEADER) +scarf_analytics() + run_command_with_daemon_option( args=args, process_name="scheduler", diff --git a/airflow/config_templates/config.yml b/airflow/config_templates/config.yml index 95d83f9d4c..edfe56b45c 100644 --- a/airflow/config_templates/config.yml +++ b/airflow/config_templates/config.yml @@ -2591,3 +2591,25 @@ sensors: type: float example: ~ default: "604800" +telemetry_collection: + description: | +Airflow integrates `Scarf <https://about.scarf.sh/>`__ to collect basic telemetry data during operation. +This data assists Airflow maintainers in better understanding how Airflow is used. +Insights gained from this telemetry are critical for prioritizing patches, minor releases, and +security fixes. Additionally, this information supports key decisions related to the development road map. +Check the FAQ doc for more information on what data is collected. + +Deployments can opt-out of analytics by setting the ``enabled`` option +to ``False``, or the ``SCARF_ANALYTICS=false`` environment variable. +Individual users can easily opt-out of analytics in various ways documented in the +`Scarf Do Not Track docs <https://docs.scarf.sh/gateway/#do-not-track>`__. + + options: +enabled: + description: | +Enable or disable telemetry data collection and sending via Scarf. + version_added: 2.10.0 + type: boolean + example: ~ + default: "True" + see_also: ":ref:`Airflow telemetry FAQ `" diff --git a/airflow/settings.py b/airflow/settings.py index 7b8a222444..176d06270e 100644 --- a/airflow/settings.py +++ b/airflow/settings.py @@ -576,6 +576,13 @@ def initialize(): atexit.register(dispose_orm)
(airflow) branch main updated: Doc fix: Remove misplaced backquotes in ``faq.rst`` (#39661)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 435ba144d1 Doc fix: Remove misplaced backquotes in ``faq.rst`` (#39661) 435ba144d1 is described below commit 435ba144d1d56efd5bb13cc4315ca7f63fa3746b Author: Nathan Rousseau AuthorDate: Thu May 16 16:25:19 2024 +0530 Doc fix: Remove misplaced backquotes in ``faq.rst`` (#39661) In the section 'What’s the deal with start_date?' of the FAQ, two back quotes are in the middle of an inline code (line 224): ``start_date=``datetime(2024, 1, 1)``. This leads to a bad rendering where the two back quotes appears between the = and datetime(2024, 1, 1), like this: start_date=``datetime(2024, 1, 1) --- docs/apache-airflow/faq.rst | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/apache-airflow/faq.rst b/docs/apache-airflow/faq.rst index d5a3666528..9643663eb7 100644 --- a/docs/apache-airflow/faq.rst +++ b/docs/apache-airflow/faq.rst @@ -221,7 +221,7 @@ a global ``start_date`` for your tasks. This can be done by declaring your ``start_date`` directly in the ``DAG()`` object. A DAG's first DagRun will be created based on the first complete ``data_interval`` after ``start_date``. For example, for a DAG with -``start_date=``datetime(2024, 1, 1)`` and ``schedule="0 0 3 * *"``, the +``start_date=datetime(2024, 1, 1)`` and ``schedule="0 0 3 * *"``, the first DAG run will be triggered at midnight on 2024-02-03 with ``data_interval_start=datetime(2024, 1, 3)`` and ``data_interval_end=datetime(2024, 2, 3)``. From that point on, the scheduler
(airflow-site) branch kaxil-patch-1 deleted (was 05190f1b6d)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 05190f1b6d fixup! Add it to the website The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch main updated: Add Scarf Pixel to Airflow RTD Theme (#1012)
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
The following commit(s) were added to refs/heads/main by this push:
new 43517d2966 Add Scarf Pixel to Airflow RTD Theme (#1012)
43517d2966 is described below
commit 43517d2966f75b1520e736265fc06b4d577cb9ae
Author: Kaxil Naik
AuthorDate: Fri May 10 13:52:59 2024 +0100
Add Scarf Pixel to Airflow RTD Theme (#1012)
Similar to https://github.com/apache/superset/pull/25065 and
https://github.com/apache/airflow/pull/39510 but this one doesn't need to wait
for the VOTE since this adds a simple transparent tracking pixel. More detail
in https://docs.scarf.sh/web-traffic/
All of this data will be available in Scarf, creds for which are shared to
1password for PMC members, and can be reported periodically in things like Town
Hall or newsletters.
---
landing-pages/site/layouts/partials/hooks/head-end.html | 3 +++
sphinx_airflow_theme/sphinx_airflow_theme/__init__.py | 2 +-
sphinx_airflow_theme/sphinx_airflow_theme/layout.html | 3 +++
3 files changed, 7 insertions(+), 1 deletion(-)
diff --git a/landing-pages/site/layouts/partials/hooks/head-end.html
b/landing-pages/site/layouts/partials/hooks/head-end.html
index c840423105..4cfc67a632 100644
--- a/landing-pages/site/layouts/partials/hooks/head-end.html
+++ b/landing-pages/site/layouts/partials/hooks/head-end.html
@@ -46,6 +46,9 @@
})();
+
+https://static.scarf.sh/a.png?x-pxid=7265a3c4-a6dd-4933-ba8b-9e3c13903c60";
/>
+
{{ with .Site.Data.webpack }}
diff --git a/sphinx_airflow_theme/sphinx_airflow_theme/__init__.py
b/sphinx_airflow_theme/sphinx_airflow_theme/__init__.py
index fcd4e04060..b383314376 100644
--- a/sphinx_airflow_theme/sphinx_airflow_theme/__init__.py
+++ b/sphinx_airflow_theme/sphinx_airflow_theme/__init__.py
@@ -18,7 +18,7 @@
from os import path
from sphinx.application import Sphinx
-__version__ = '0.0.12'
+__version__ = '0.0.13'
__version_full__ = __version__
diff --git a/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
b/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
index f9b454d326..923f3790e8 100644
--- a/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
+++ b/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
@@ -317,6 +317,9 @@
})();
+
+https://static.scarf.sh/a.png?x-pxid=7265a3c4-a6dd-4933-ba8b-9e3c13903c60";
/>
+
{%- block extrahead %}
{% endblock %}
(airflow-site) branch patch-scarf deleted (was 03aa7c40a5)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch patch-scarf in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 03aa7c40a5 Add scarf tracking pixel to entire doc site The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch kaxil-patch-1 updated (4711d1d37c -> 05190f1b6d)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 4711d1d37c Add it to the website add 05190f1b6d fixup! Add it to the website No new revisions were added by this update. Summary of changes: sphinx_airflow_theme/sphinx_airflow_theme/__init__.py | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
(airflow-site) branch patch-scarf created (now 03aa7c40a5)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch patch-scarf in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 03aa7c40a5 Add scarf tracking pixel to entire doc site No new revisions were added by this update.
(airflow-site) branch fix-imap deleted (was b2b905729b)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch fix-imap in repository https://gitbox.apache.org/repos/asf/airflow-site.git was b2b905729b Fix IMAP configuration The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch fix_coc deleted (was 5952ee9cb8)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch fix_coc in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 5952ee9cb8 Fix up code of conduct The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch providers-can-be-in-different-states deleted (was bddbeaced7)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch providers-can-be-in-different-states in repository https://gitbox.apache.org/repos/asf/airflow-site.git was bddbeaced7 Update provider state information to airflow site The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-user-list-section deleted (was 3d16f976b8)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-user-list-section in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 3d16f976b8 Add section about joining users list The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-documentation-2023-12-23 deleted (was 4f082eb51a)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-documentation-2023-12-23 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 4f082eb51a Add documentation for packages - 2023-12-23 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch potiuk-patch-1 deleted (was 77a3dfcbf2)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch potiuk-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 77a3dfcbf2 Remove Qubole from the list of Airflow-As-A-Service The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch linkFix deleted (was f9d6c32940)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch linkFix in repository https://gitbox.apache.org/repos/asf/airflow-site.git was f9d6c32940 Fixing the link for privacy notice The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-documentation-2024-01-26 deleted (was b218e1b1bb)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-documentation-2024-01-26 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was b218e1b1bb Add documentation for packages - 2024-01-26 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch flask-oid-vulnerability deleted (was 21eb5e82b9)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch flask-oid-vulnerability in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 21eb5e82b9 Add blog post about FAB OID vulnerability The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch rewordGrammar deleted (was e445430904)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch rewordGrammar in repository https://gitbox.apache.org/repos/asf/airflow-site.git was e445430904 Rewording some text regarding suspended and removed providers The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-documentation-2023-12-12 deleted (was 2ddb8ef4c5)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-documentation-2023-12-12 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 2ddb8ef4c5 add documentation for packages - 2023-12-12 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch remove-link-to-outdated-bucket deleted (was 46ef87686c)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch remove-link-to-outdated-bucket in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 46ef87686c Remove outdated link to survey data The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch update-link-to-privacy-policy deleted (was 78f360ec81)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch update-link-to-privacy-policy in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 78f360ec81 Remove the privacy policy page with link to the ASF one The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-documentation-2023-12-28 deleted (was 10fab59006)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-documentation-2023-12-28 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 10fab59006 Add documentation for packages - 2023-12-28 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch fix-provider-indexes deleted (was 4ed5a7a53f)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch fix-provider-indexes in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 4ed5a7a53f Fix duplicated 1.0.0 entries in provider indexes The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch update-documentation deleted (was 590c117958)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch update-documentation in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 590c117958 Update docker stack documentation with today's changes The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch announce-283 deleted (was 7b42c45720)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch announce-283 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 7b42c45720 Announce Apache Airflow 2.8.3 release The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch testing deleted (was 2eb5926a90)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch testing in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 2eb5926a90 Disable github pages for the project The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch announce_1.12.0 deleted (was 6dcfbe6428)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch announce_1.12.0 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 6dcfbe6428 Announce helm chart 1.12.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch add-documentation-2024-03-25 deleted (was ae8f49b915)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch add-documentation-2024-03-25 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was ae8f49b915 Add documentation for packages - 2024-03-25 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch announce-282 deleted (was 2f61c18276)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch announce-282 in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 2f61c18276 Announce Apache Airflow 2.8.2 release The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch 2.9.0-docs deleted (was 74b4a47604)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch 2.9.0-docs in repository https://gitbox.apache.org/repos/asf/airflow-site.git was 74b4a47604 Add documentation for Apache Airflow 2.9.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository.
(airflow-site) branch kaxil-patch-1 updated (6dd0aba0b7 -> 4711d1d37c)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git from 6dd0aba0b7 Add Scarf Pixel to Airflow RTD Theme add 4711d1d37c Add it to the website No new revisions were added by this update. Summary of changes: landing-pages/site/layouts/partials/hooks/head-end.html | 3 +++ 1 file changed, 3 insertions(+)
(airflow-site) 01/01: Add Scarf Pixel to Airflow RTD Theme
This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a commit to branch kaxil-patch-1
in repository https://gitbox.apache.org/repos/asf/airflow-site.git
commit 6dd0aba0b7b1933e01326ca81fba05a31138022f
Author: Kaxil Naik
AuthorDate: Fri May 10 01:14:54 2024 +0100
Add Scarf Pixel to Airflow RTD Theme
Similar to https://github.com/apache/superset/pull/25065 and
https://github.com/apache/airflow/pull/39510 but this one doesn't need to wait
for the VOTE since this adds a simple transparent tracking pixel. More detail
in https://docs.scarf.sh/web-traffic/
All of this data will be available in Scarf, creds for which are shared to
1password for PMC members, and can be reported periodically in things like Town
Hall or newsletters.
---
sphinx_airflow_theme/sphinx_airflow_theme/layout.html | 3 +++
1 file changed, 3 insertions(+)
diff --git a/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
b/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
index f9b454d326..923f3790e8 100644
--- a/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
+++ b/sphinx_airflow_theme/sphinx_airflow_theme/layout.html
@@ -317,6 +317,9 @@
})();
+
+https://static.scarf.sh/a.png?x-pxid=7265a3c4-a6dd-4933-ba8b-9e3c13903c60";
/>
+
{%- block extrahead %}
{% endblock %}
(airflow-site) branch kaxil-patch-1 created (now 6dd0aba0b7)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a change to branch kaxil-patch-1 in repository https://gitbox.apache.org/repos/asf/airflow-site.git at 6dd0aba0b7 Add Scarf Pixel to Airflow RTD Theme This branch includes the following new commits: new 6dd0aba0b7 Add Scarf Pixel to Airflow RTD Theme The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
(airflow) branch main updated: Add Scarf Pixel to Readme (#39533)
This is an automated email from the ASF dual-hosted git repository. kaxilnaik pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 08a8028fae Add Scarf Pixel to Readme (#39533) 08a8028fae is described below commit 08a8028faefff2ed1002291b4bf6e522e8e6ed0f Author: Kaxil Naik AuthorDate: Thu May 9 21:52:35 2024 +0100 Add Scarf Pixel to Readme (#39533) Similar to https://github.com/apache/superset/pull/25065 and https://github.com/apache/airflow/pull/39510 but this one doesn't need to wait for the VOTE since this embed it to Readme. More detail in https://docs.scarf.sh/web-traffic/ All of this data will be available to interested PMC members, and reported periodically in things like Town Hall & newsletters. --- README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/README.md b/README.md index 916c682a1b..f9fc0e7c5c 100644 --- a/README.md +++ b/README.md @@ -532,3 +532,6 @@ The CI infrastructure for Apache Airflow has been sponsored by: https://astronomer.io";>https://assets2.astronomer.io/logos/logoForLIGHTbackground.png"; alt="astronomer.io" width="250px"> https://aws.amazon.com/opensource/";> + + +https://static.scarf.sh/a.png?x-pxid=1b5a5e3c-da81-42f5-befa-42d836bf1b54"; alt="Tracking Pixel" />
