This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch
dependabot/cargo/main/all-other-cargo-deps-12247353e7
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 0066d5b912 chore(deps): bump the all-other-cargo-deps group across 1
directory with 18 updates
add 0ac434d0e5 Add case-heavy LEFT JOIN benchmark and debug timing/logging
for PushDownFilter hot paths (#20664)
add 5211a8b7c5 Fix repartition from dropping data when spilling (#20672)
add bfa0ea8056 Hash join buffering on probe side (#19761)
add 8fe926d387 test: Add `datafusion-cli` `fair` and `unbounded`
memory-pool test coverage (#20565)
add 92078d932d Copy limits before repartitions (#20736)
add 4dbb4498fc ser/de fetch in FilterExec (#20738)
add 1eb520675f feat: Integrate CastColumnExpr into PhysicalExprAdapter
(#20269)
add 37b9a466c4 feat: `partition_statistics()` for HashJoinExec (#20711)
add 15bc6bd5c8 feat: make DefaultLogicalExtensionCodec support
serialisation of buil… (#20638)
add bb421db72a Add tests for simplifying multiple aggregate expressions
(#20723)
add 33b9afa911 Allow SQL `TypePlanner` to plan SQL types as extension
types (#20676)
add b51edffc44 Update reverse UDF to emit utf8view when input is utf8view
(#20604)
add 9b3d6a4909 Make lower and upper emit Utf8View for Utf8View input
(#20616)
add 097f04c2ec fix(spark): handle divide-by-zero in Spark `mod`/`pmod`
with ANSI mode support (#20461)
add aca8c14478 Fix FilterExec converting Absent column stats to
Exact(NULL) (#20391)
add 44dfa7b8a5 Clean up date_part preimage implementation (#20350)
add 84a22eaa32 Wrap Arc to Statistics for `partition_statistics` API
(#20570)
add fd97799ddc Make Physical CastExpr Field-aware and unify cast semantics
across physical expressions (#20814)
add 10accc1773 chore(deps): bump the all-other-cargo-deps group across 1
directory with 18 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0066d5b912)
\
N -- N -- N
refs/heads/dependabot/cargo/main/all-other-cargo-deps-12247353e7 (10accc1773)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
Cargo.lock | 16 +-
benchmarks/src/imdb/run.rs | 8 +
benchmarks/src/tpcds/run.rs | 6 +
benchmarks/src/tpch/run.rs | 8 +
datafusion-cli/tests/cli_integration.rs | 49 ++-
...ory_consumers_with_mem_pool_type@no_track.snap} | 2 +
[email protected]} | 2 +
.../[email protected] | 36 ++
.../examples/relation_planner/table_sample.rs | 6 +-
datafusion/common/src/config.rs | 20 ++
datafusion/core/Cargo.toml | 6 +-
datafusion/core/benches/sql_planner_extended.rs | 239 ++++++++++++-
datafusion/core/benches/topk_repartition.rs | 90 +++++
datafusion/core/src/execution/context/mod.rs | 8 +-
datafusion/core/tests/custom_sources_cases/mod.rs | 8 +-
.../core/tests/custom_sources_cases/statistics.rs | 14 +-
datafusion/core/tests/parquet/expr_adapter.rs | 146 +++++++-
.../tests/physical_optimizer/join_selection.rs | 6 +-
.../physical_optimizer/partition_statistics.rs | 341 ++++++++++++++++---
.../core/tests/physical_optimizer/test_utils.rs | 4 +-
datafusion/core/tests/sql/path_partition.rs | 10 +-
datafusion/datasource/src/file_scan_config.rs | 18 +-
datafusion/datasource/src/memory.rs | 14 +-
datafusion/datasource/src/source.rs | 4 +-
datafusion/expr/src/planner.rs | 18 +
datafusion/functions/src/datetime/date_part.rs | 46 ++-
datafusion/functions/src/string/common.rs | 10 +-
datafusion/functions/src/string/lower.rs | 25 +-
datafusion/functions/src/string/upper.rs | 25 +-
datafusion/functions/src/unicode/reverse.rs | 64 ++--
datafusion/optimizer/src/push_down_filter.rs | 43 ++-
.../physical-expr-adapter/src/schema_rewriter.rs | 191 ++++++++---
.../src/equivalence/properties/dependency.rs | 40 ++-
.../src/equivalence/properties/mod.rs | 55 ++-
datafusion/physical-expr/src/expressions/cast.rs | 260 ++++++++++++---
.../physical-expr/src/expressions/cast_column.rs | 8 +
.../physical-optimizer/src/hash_join_buffering.rs | 103 ++++++
datafusion/physical-optimizer/src/lib.rs | 2 +
datafusion/physical-optimizer/src/optimizer.rs | 11 +
.../physical-optimizer/src/output_requirements.rs | 2 +-
.../physical-optimizer/src/topk_repartition.rs | 368 +++++++++++++++++++++
datafusion/physical-plan/src/aggregates/mod.rs | 15 +-
datafusion/physical-plan/src/buffer.rs | 2 +-
datafusion/physical-plan/src/coalesce_batches.rs | 7 +-
.../physical-plan/src/coalesce_partitions.rs | 7 +-
datafusion/physical-plan/src/coop.rs | 2 +-
datafusion/physical-plan/src/display.rs | 9 +-
datafusion/physical-plan/src/empty.rs | 4 +-
datafusion/physical-plan/src/execution_plan.rs | 19 +-
datafusion/physical-plan/src/filter.rs | 78 ++++-
datafusion/physical-plan/src/joins/cross_join.rs | 9 +-
.../physical-plan/src/joins/hash_join/exec.rs | 66 +++-
.../physical-plan/src/joins/nested_loop_join.rs | 10 +-
.../src/joins/sort_merge_join/exec.rs | 13 +-
datafusion/physical-plan/src/limit.rs | 14 +-
datafusion/physical-plan/src/placeholder_row.rs | 6 +-
datafusion/physical-plan/src/projection.rs | 13 +-
datafusion/physical-plan/src/repartition/mod.rs | 8 +-
datafusion/physical-plan/src/sorts/partial_sort.rs | 2 +-
datafusion/physical-plan/src/sorts/sort.rs | 18 +-
.../src/sorts/sort_preserving_merge.rs | 2 +-
datafusion/physical-plan/src/spill/spill_pool.rs | 102 +++++-
datafusion/physical-plan/src/test.rs | 6 +-
datafusion/physical-plan/src/test/exec.rs | 22 +-
datafusion/physical-plan/src/union.rs | 37 ++-
.../src/windows/bounded_window_agg_exec.rs | 7 +-
.../physical-plan/src/windows/window_agg_exec.rs | 9 +-
datafusion/physical-plan/src/work_table.rs | 4 +-
datafusion/proto/proto/datafusion.proto | 20 ++
datafusion/proto/src/generated/pbjson.rs | 217 ++++++++++++
datafusion/proto/src/generated/prost.rs | 52 +++
datafusion/proto/src/logical_plan/mod.rs | 103 +++++-
datafusion/proto/src/physical_plan/mod.rs | 2 +
.../proto/tests/cases/roundtrip_logical_plan.rs | 186 +++++++++++
.../proto/tests/cases/roundtrip_physical_plan.rs | 13 +
datafusion/spark/src/function/math/modulus.rs | 144 ++++++--
datafusion/sql/src/expr/mod.rs | 19 +-
datafusion/sql/src/planner.rs | 4 +-
datafusion/sql/tests/common/mod.rs | 16 +-
datafusion/sql/tests/sql_integration.rs | 8 +
.../test_files/aggregates_simplify.slt | 344 +++++++++++++++++++
datafusion/sqllogictest/test_files/explain.slt | 8 +
.../test_files/filter_without_sort_exec.slt | 44 +++
datafusion/sqllogictest/test_files/functions.slt | 50 +++
.../sqllogictest/test_files/information_schema.slt | 4 +
.../sqllogictest/test_files/spark/math/mod.slt | 29 ++
.../sqllogictest/test_files/spark/math/pmod.slt | 22 +-
.../test_files/string/string_literal.slt | 15 +
datafusion/sqllogictest/test_files/struct.slt | 2 +-
.../sqllogictest/test_files/window_limits.slt | 7 +-
.../test_files/window_topk_pushdown.slt | 141 ++++++++
docs/source/library-user-guide/extending-sql.md | 51 ++-
docs/source/library-user-guide/upgrading/54.0.0.md | 33 +-
docs/source/user-guide/configs.md | 2 +
94 files changed, 3882 insertions(+), 477 deletions(-)
copy datafusion-cli/tests/snapshots/{cli_top_memory_consumers@no_track.snap =>
cli_top_memory_consumers_with_mem_pool_type@no_track.snap} (94%)
copy datafusion-cli/tests/snapshots/{[email protected] =>
[email protected]} (95%)
create mode 100644
datafusion-cli/tests/snapshots/[email protected]
create mode 100644 datafusion/core/benches/topk_repartition.rs
create mode 100644 datafusion/physical-optimizer/src/hash_join_buffering.rs
create mode 100644 datafusion/physical-optimizer/src/topk_repartition.rs
create mode 100644 datafusion/sqllogictest/test_files/aggregates_simplify.slt
create mode 100644 datafusion/sqllogictest/test_files/window_topk_pushdown.slt
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
