This is an automated email from the ASF dual-hosted git repository.
dependabot[bot] pushed a change to branch
dependabot/uv/bindings/python/datafusion-53.0.0
in repository https://gitbox.apache.org/repos/asf/iceberg-rust.git
omit 49e799cdf chore(deps-dev): Bump datafusion in /bindings/python
add 8788ab7e3 chore(deps): Bump reqwest from 0.12.28 to 0.13.3 (#2450)
add d002c21aa chore(deps): Bump rand from 0.9.4 to 0.10.1 (#2449)
add 69a1ce77b chore(deps): Bump taiki-e/install-action from 2.75.30 to
2.77.1 (#2446)
add 2c80df34e chore(deps): Bump the arrow-parquet group with 2 updates
(#2448)
add 6ea742cbb ci: add check_standalone job to verify each crate compiles
independently (#2389)
add 3d8ab5e03 fix(puffin): add missing magic number validation for puffins
(#2416)
add b9b6c7e01 feat!(runtime): Support custom Runtime in Catalog (#2308)
add ab826d73d chore(deps): Bump taiki-e/install-action from 2.77.1 to
2.77.4 (#2461)
add 125645ae1 chore(deps): Bump reqwest from 0.12.28 to 0.13.3 (#2460)
add 0daf3793c chore(deps): Bump crate-ci/typos from 1.46.0 to 1.46.1
(#2459)
add 264666339 chore(deps): Bump github/codeql-action from 4.35.3 to 4.35.4
(#2457)
add 9c70b9795 chore(deps-dev): Bump maturin from 1.13.1 to 1.13.2 in
/bindings/python (#2458)
add 7c4565114 feat(encryption) [6/N] support `ArrowReaderOptions` in
`get_metadata` (#2402)
add aa58d2fdd feat(partition): adjust transform boundary for timestamp
types (#2422)
add 8c6e214fb chore(deps): Bump idna from 3.13 to 3.15 in /bindings/python
(#2470)
add 2d5444b05 feat: HuggingFace Hub storage backend and CDC table
properties (#2375)
add 67931e89a chore(deps-dev): Bump datafusion in /bindings/python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (49e799cdf)
\
N -- N -- N
refs/heads/dependabot/uv/bindings/python/datafusion-53.0.0 (67931e89a)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml | 31 +-
.../{bindings_python_ci.yml => ci_hf_cdc.yml} | 107 +++---
.github/workflows/ci_typos.yml | 2 +-
.github/workflows/codeql.yml | 4 +-
Cargo.lock | 10 +-
Cargo.toml | 2 +-
bindings/python/pyproject.toml | 3 +
bindings/python/tests/test_huggingface_and_cdc.py | 194 +++++++++++
bindings/python/uv.lock | 259 +++++++++++++-
crates/catalog/glue/src/catalog.rs | 21 +-
crates/catalog/hms/src/catalog.rs | 43 ++-
crates/catalog/rest/Cargo.toml | 2 +-
crates/catalog/rest/src/catalog.rs | 63 +++-
crates/catalog/s3tables/src/catalog.rs | 24 +-
crates/catalog/sql/src/catalog.rs | 21 +-
crates/iceberg/Cargo.toml | 4 +-
.../src/arrow/caching_delete_file_loader.rs | 22 +-
crates/iceberg/src/arrow/delete_filter.rs | 19 +-
crates/iceberg/src/arrow/reader/file_reader.rs | 14 +-
crates/iceberg/src/arrow/reader/mod.rs | 6 +-
crates/iceberg/src/arrow/reader/pipeline.rs | 5 +-
.../iceberg/src/arrow/reader/positional_deletes.rs | 7 +-
crates/iceberg/src/arrow/reader/projection.rs | 22 +-
crates/iceberg/src/arrow/reader/row_filter.rs | 9 +-
crates/iceberg/src/catalog/memory/catalog.rs | 24 +-
crates/iceberg/src/catalog/mod.rs | 10 +
crates/iceberg/src/delete_file_index.rs | 6 +-
crates/iceberg/src/io/object_cache.rs | 2 +
crates/iceberg/src/io/storage/config/hf.rs | 104 ++++++
crates/iceberg/src/io/storage/config/mod.rs | 2 +
crates/iceberg/src/lib.rs | 1 +
crates/iceberg/src/puffin/metadata.rs | 39 ++-
crates/iceberg/src/runtime/mod.rs | 293 ++++++++++++++--
crates/iceberg/src/scan/mod.rs | 157 +++++----
crates/iceberg/src/spec/table_metadata_builder.rs | 3 +
crates/iceberg/src/spec/table_properties.rs | 189 ++++++++++-
crates/iceberg/src/spec/transform.rs | 58 ++++
crates/iceberg/src/table.rs | 31 +-
crates/iceberg/src/test_utils.rs | 22 ++
crates/iceberg/src/transaction/mod.rs | 4 +
crates/iceberg/src/transaction/update_schema.rs | 1 +
.../datafusion/src/physical_plan/project.rs | 4 +
.../datafusion/src/physical_plan/repartition.rs | 9 +
.../datafusion/src/physical_plan/write.rs | 13 +-
crates/sqllogictest/Cargo.toml | 2 +-
crates/storage/opendal/Cargo.toml | 5 +-
crates/storage/opendal/src/hf.rs | 348 +++++++++++++++++++
crates/storage/opendal/src/lib.rs | 57 +++-
crates/storage/opendal/src/resolving.rs | 15 +-
crates/storage/opendal/tests/file_io_hf_test.rs | 376 +++++++++++++++++++++
50 files changed, 2412 insertions(+), 257 deletions(-)
copy .github/workflows/{bindings_python_ci.yml => ci_hf_cdc.yml} (50%)
create mode 100644 bindings/python/tests/test_huggingface_and_cdc.py
create mode 100644 crates/iceberg/src/io/storage/config/hf.rs
create mode 100644 crates/storage/opendal/src/hf.rs
create mode 100644 crates/storage/opendal/tests/file_io_hf_test.rs
