This is an automated email from the ASF dual-hosted git repository.
etseidl pushed a change to branch gh5854_thrift_remodel
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
from a69c57834e Merge remote-tracking branch 'origin/main' into
gh5854_thrift_remodel
add 0710ecce79 Improve StringArray(Utf8) sort performance (~2-4x faster)
(#7860)
add 554cafa140 Implement `DataType::Float16` => `Variant::Float` (#8073)
add 5036ca803e Support multi-threaded writing of Parquet files with
modular encryption (#8029)
add a4bcd6d34f Add arrow-avro Decoder Benchmarks (#8025)
add e845411dbf Fix new clippy lints from Rust 1.89 (#8078)
add 25bbb3ddcd Bump actions/download-artifact from 4 to 5 (#8066)
add 7a5f6d3d48 Implement `DataType::{Binary, LargeBinary, BinaryView}` =>
`Variant::Binary` (#8074)
add c561acba79 [Variant] Add `variant_get` and Shredded `VariantArray`
(#8021)
add 4a21443d2f Implement arrow-avro SchemaStore and Fingerprinting To
Enable Schema Resolution (#8006)
add 04f217b670 Speed up Parquet filter pushdown v4 (Predicate evaluation
cache for async_reader) (#7850)
add b350a5b72e Add "update branch" option in PRs (#8099)
add 7f0aae9b9d fix: Validate metadata len in IPC reader (#8097)
add 8d6fbfbb29 Use `Vec` directly in builders (#7984)
add f748db88f7 [Variant] Adding fixed size byte array to variant and test
(#8106)
new 0d2f33e5ab Merge remote-tracking branch 'origin/main' into
gh5854_thrift_remodel
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.asf.yaml | 3 +
.github/workflows/docs.yml | 2 +-
.../src/builder/fixed_size_binary_builder.rs | 14 +-
arrow-array/src/builder/generic_bytes_builder.rs | 46 +-
arrow-array/src/builder/generic_list_builder.rs | 19 +-
.../src/builder/generic_list_view_builder.rs | 23 +-
arrow-array/src/builder/map_builder.rs | 14 +-
arrow-array/src/builder/primitive_builder.rs | 34 +-
arrow-array/src/ffi.rs | 2 +-
arrow-avro/Cargo.toml | 13 +-
arrow-avro/benches/decoder.rs | 559 +++++++++++++++
arrow-avro/src/codec.rs | 51 +-
arrow-avro/src/reader/header.rs | 2 +-
arrow-avro/src/reader/mod.rs | 539 ++++++++++++---
arrow-buffer/src/buffer/boolean.rs | 2 +-
arrow-buffer/src/buffer/immutable.rs | 2 +-
arrow-cast/src/pretty.rs | 7 +-
arrow-data/src/transform/boolean.rs | 2 +-
arrow-data/src/transform/fixed_binary.rs | 2 +-
arrow-data/src/transform/fixed_size_list.rs | 2 +-
arrow-data/src/transform/list.rs | 4 +-
arrow-data/src/transform/mod.rs | 8 +-
arrow-data/src/transform/null.rs | 2 +-
arrow-data/src/transform/primitive.rs | 4 +-
arrow-data/src/transform/run.rs | 2 +-
arrow-data/src/transform/structure.rs | 2 +-
arrow-data/src/transform/union.rs | 4 +-
arrow-data/src/transform/variable_size.rs | 2 +-
arrow-flight/src/sql/metadata/sql_info.rs | 2 +-
arrow-flight/src/sql/metadata/xdbc_info.rs | 2 +-
arrow-ipc/src/lib.rs | 1 +
arrow-ipc/src/reader.rs | 56 +-
arrow-ord/src/sort.rs | 381 ++++++++++-
arrow-row/src/lib.rs | 10 +-
arrow-select/src/concat.rs | 24 +-
arrow/examples/dynamic_types.rs | 2 +-
parquet-variant-compute/Cargo.toml | 2 +-
parquet-variant-compute/src/cast_to_variant.rs | 162 ++++-
parquet-variant-compute/src/from_json.rs | 6 +-
parquet-variant-compute/src/lib.rs | 22 +-
parquet-variant-compute/src/variant_array.rs | 317 +++++++--
.../src/variant_array_builder.rs | 8 +-
parquet-variant-compute/src/variant_get.rs | 180 -----
parquet-variant-compute/src/variant_get/mod.rs | 430 ++++++++++++
.../src/variant_get/output/mod.rs | 87 +++
.../src/variant_get/output/primitive.rs | 166 +++++
.../src/variant_get/output/variant.rs | 146 ++++
parquet-variant-json/src/from_json.rs | 4 +-
parquet-variant/src/builder.rs | 24 +-
parquet-variant/src/decoder.rs | 5 +-
parquet-variant/src/path.rs | 4 +-
parquet-variant/src/variant.rs | 4 +-
parquet/src/arrow/array_reader/builder.rs | 94 ++-
.../src/arrow/array_reader/cached_array_reader.rs | 762 +++++++++++++++++++++
parquet/src/arrow/array_reader/list_array.rs | 4 +-
parquet/src/arrow/array_reader/mod.rs | 5 +-
parquet/src/arrow/array_reader/row_group_cache.rs | 206 ++++++
parquet/src/arrow/arrow_reader/metrics.rs | 135 ++++
parquet/src/arrow/arrow_reader/mod.rs | 117 +++-
parquet/src/arrow/arrow_reader/selection.rs | 53 ++
parquet/src/arrow/arrow_writer/mod.rs | 89 ++-
parquet/src/arrow/async_reader/mod.rs | 234 ++++++-
parquet/src/arrow/async_writer/mod.rs | 44 --
parquet/src/arrow/mod.rs | 7 +
parquet/src/encryption/decrypt.rs | 4 +-
parquet/src/file/properties.rs | 8 +-
parquet/src/file/reader.rs | 4 +-
parquet/src/file/serialized_reader.rs | 4 +-
parquet/src/file/writer.rs | 2 +-
parquet/src/record/api.rs | 2 +-
parquet/src/schema/types.rs | 7 +-
parquet/tests/arrow_reader/mod.rs | 2 +
parquet/tests/arrow_reader/predicate_cache.rs | 279 ++++++++
parquet/tests/encryption/encryption.rs | 68 +-
parquet/tests/encryption/encryption_async.rs | 110 ++-
parquet/tests/encryption/encryption_util.rs | 153 ++++-
76 files changed, 5109 insertions(+), 695 deletions(-)
create mode 100644 arrow-avro/benches/decoder.rs
delete mode 100644 parquet-variant-compute/src/variant_get.rs
create mode 100644 parquet-variant-compute/src/variant_get/mod.rs
create mode 100644 parquet-variant-compute/src/variant_get/output/mod.rs
create mode 100644 parquet-variant-compute/src/variant_get/output/primitive.rs
create mode 100644 parquet-variant-compute/src/variant_get/output/variant.rs
create mode 100644 parquet/src/arrow/array_reader/cached_array_reader.rs
create mode 100644 parquet/src/arrow/array_reader/row_group_cache.rs
create mode 100644 parquet/src/arrow/arrow_reader/metrics.rs
create mode 100644 parquet/tests/arrow_reader/predicate_cache.rs
