This is an automated email from the ASF dual-hosted git repository.
srowen pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/spark-website.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a3693ee235 Patch 1
a3693ee235 is described below
commit a3693ee2358fde320fc9000be3a9fbc84e1df959
Author: Stefan Krawczyk <ste...@dagworks.io>
AuthorDate: Wed Jun 5 07:27:23 2024 -0500
Patch 1
This adds [Hamilton](https://github.com/DAGWorks-Inc/hamilton) to the list
of libraries with integrations.
Hamilton has PySpark support (e.g.
[examples](https://github.com/DAGWorks-Inc/hamilton/tree/main/examples/spark))
and this specific
functionality is utilized by several enterprises in production.
Author: Stefan Krawczyk <ste...@dagworks.io>
Closes #520 from skrawcz/patch-1.
---
site/third-party-projects.html | 1 +
third-party-projects.md | 1 +
2 files changed, 2 insertions(+)
diff --git a/site/third-party-projects.html b/site/third-party-projects.html
index f5e2dd2873..2629d07d38 100644
--- a/site/third-party-projects.html
+++ b/site/third-party-projects.html
@@ -153,6 +153,7 @@
<li><a href="https://github.com/awslabs/python-deequ";>python-deequ</a> -
Measures data quality in large datasets</li>
<li><a href="https://github.com/datahub-project/datahub";>datahub</a> -
Metadata platform for the modern data stack</li>
<li><a href="https://github.com/dbt-labs/dbt-spark";>dbt-spark</a> - Enables
dbt to work with Apache Spark</li>
+ <li><a href="https://github.com/DAGWorks-Inc/hamilton";>Hamilton</a> -
Enables one to declaratively describe PySpark transformations that helps keep
code testable, modular, and logically visualizable.</li>
</ul>
<h2 id="connectors">Connectors</h2>
diff --git a/third-party-projects.md b/third-party-projects.md
index e8b4b16c85..ed7e7b3353 100644
--- a/third-party-projects.md
+++ b/third-party-projects.md
@@ -18,6 +18,7 @@ This page tracks external software projects that supplement
Apache Spark and add
- [python-deequ](https://github.com/awslabs/python-deequ) - Measures data
quality in large datasets
- [datahub](https://github.com/datahub-project/datahub) - Metadata platform
for the modern data stack
- [dbt-spark](https://github.com/dbt-labs/dbt-spark) - Enables dbt to work
with Apache Spark
+- [Hamilton](https://github.com/DAGWorks-Inc/hamilton) - Enables one to
declaratively describe PySpark transformations that helps keep code testable,
modular, and logically visualizable.
## Connectors
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
