This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/datafusion.git
from acec058cb5 perf: Use Arrow vectorized eq kernel for IN list with
column references (#20528)
add 73fbd48070 Upgrade DataFusion to arrow-rs/parquet 58.0.0 /
`object_store` 0.13.0 (#19728)
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 150 ++++++++++-----------
Cargo.toml | 16 +--
datafusion-cli/src/exec.rs | 10 +-
datafusion-cli/src/main.rs | 12 +-
datafusion-cli/src/object_storage/instrumented.rs | 120 ++++++++---------
.../custom_data_source/adapter_serialization.rs | 2 +-
.../examples/custom_data_source/csv_json_opener.rs | 2 +-
.../custom_data_source/custom_file_casts.rs | 2 +-
.../custom_data_source/default_column_values.rs | 4 +-
.../examples/data_io/json_shredding.rs | 4 +-
.../examples/data_io/parquet_advanced_index.rs | 8 +-
datafusion/common/src/file_options/mod.rs | 2 +-
.../common/src/file_options/parquet_writer.rs | 8 +-
datafusion/core/benches/parquet_query_sql.rs | 4 +-
datafusion/core/benches/parquet_struct_query.rs | 4 +-
datafusion/core/benches/push_down_filter.rs | 2 +-
datafusion/core/benches/sql_query_with_io.rs | 2 +-
datafusion/core/src/datasource/file_format/csv.rs | 29 ++--
.../core/src/datasource/file_format/parquet.rs | 38 +++---
.../core/src/datasource/physical_plan/csv.rs | 2 +-
datafusion/core/src/test/object_store.rs | 65 +++++----
.../tests/catalog_listing/pruned_partition_list.rs | 2 +-
datafusion/core/tests/dataframe/mod.rs | 9 +-
.../core/tests/datasource/object_store_access.rs | 113 +++++-----------
datafusion/core/tests/fuzz_cases/pruning.rs | 4 +-
.../core/tests/fuzz_cases/topk_filter_pushdown.rs | 2 +-
datafusion/core/tests/parquet/custom_reader.rs | 2 +-
datafusion/core/tests/parquet/expr_adapter.rs | 2 +-
.../core/tests/parquet/external_access_plan.rs | 2 +-
datafusion/core/tests/parquet/filter_pushdown.rs | 4 +-
datafusion/core/tests/parquet/mod.rs | 2 +-
.../replace_with_order_preserving_variants.rs | 2 +-
datafusion/core/tests/sql/path_partition.rs | 65 ++++-----
.../core/tests/tracing/traceable_object_store.rs | 34 ++---
datafusion/datasource-arrow/src/file_format.rs | 3 +-
datafusion/datasource-arrow/src/source.rs | 2 +-
datafusion/datasource-avro/src/file_format.rs | 2 +-
datafusion/datasource-avro/src/source.rs | 2 +-
datafusion/datasource-csv/src/file_format.rs | 4 +-
datafusion/datasource-json/src/file_format.rs | 2 +-
datafusion/datasource-json/src/source.rs | 2 +-
.../benches/parquet_nested_filter_pushdown.rs | 12 +-
datafusion/datasource-parquet/src/file_format.rs | 10 +-
datafusion/datasource-parquet/src/opener.rs | 11 +-
.../datasource-parquet/src/row_group_filter.rs | 3 +-
datafusion/datasource/src/mod.rs | 2 +-
datafusion/datasource/src/url.rs | 42 +++---
datafusion/functions-nested/src/range.rs | 25 +++-
datafusion/spark/src/function/datetime/last_day.rs | 6 +-
datafusion/spark/src/function/datetime/next_day.rs | 2 +-
.../test_files/dynamic_filter_pushdown_config.slt | 2 +-
.../sqllogictest/test_files/explain_tree.slt | 14 +-
.../test_files/spark/datetime/make_interval.slt | 10 +-
datafusion/wasmtest/src/lib.rs | 2 +-
docs/source/library-user-guide/upgrading/53.0.0.md | 11 ++
55 files changed, 438 insertions(+), 460 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]