The GitHub Actions job "uv in /. - Update #1215711122" on 
iceberg-python.git/main has failed.
Run started by GitHub user dependabot[bot] (triggered by dependabot[bot]).

Head commit for run:
e6ade7ec67929a32a8f218e3763f7d483c44fe8f / Kevin Liu 
<[email protected]>
dev: add `make notebook` (#2528)

<!--
Thanks for opening a pull request!
-->

<!-- In the case this PR will resolve an issue, please replace
${GITHUB_ISSUE_ID} below with the actual Github issue id. -->
<!-- Closes #${GITHUB_ISSUE_ID} -->

# Rationale for this change
Add 2 new Make command (`make notebook`) to spin up a jupyter notebook;
`make notebook-infra` spins up jupyter notebook along with integration
test infrastructure.

### Pyiceberg Example Notebook
Pyiceberg example notebook (`notebooks/pyiceberg_example.ipynb`) is
based on the
https://py.iceberg.apache.org/#getting-started-with-pyiceberg page and
doesn't require additional test infra.

### Spark Example Notebook
Spark integration example notebook
(`notebooks/spark_integration_example.ipynb`) is based on
https://iceberg.apache.org/docs/nightly/spark-getting-started/ and
requires integration test infrastructure (Spark, IRC, S3)

With spark connect (#2491) and our testing setup, we can quickly spin up
a local env with `make test-integration-exec` which includes:
* spark
* iceberg rest catalog
* hive metastore
* minio

In the jupyter notebook, connect to spark easily
```
from pyspark.sql import SparkSession

# Create SparkSession against the remote Spark Connect server
spark = SparkSession.builder.remote("sc://localhost:15002").getOrCreate()
spark.sql("SHOW CATALOGS").show()
```

## Are these changes tested?
Yes, run both `make notebook` and `make notebook-infra` locally and run
the example notebooks

## Are there any user-facing changes?

<!-- In the case of user-facing changes, please add the changelog label.
-->

Report URL: https://github.com/apache/iceberg-python/actions/runs/21199643746

With regards,
GitHub Actions via GitBox

Reply via email to