This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/sqlparser-0.60.0
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit 0325bc319b chore(deps): bump sqlparser from 0.59.0 to 0.60.0
add a95c7fc2c4 feat: fix matching for named parameters with non-lowercase
signatures (#19378)
add 83ed19235b refactor: Spark `ascii` signature away from `user_defined`
(#19513)
add 36df145e97 feat: Add per-expression evaluation timing metrics to
ProjectionExec (#19447)
add 3aa0ab78b5 Fix: SparkAscii nullability to depend on input nullability
(#19531)
add 1dbf9a6df9 chore(deps): bump tracing from 0.1.41 to 0.1.43 (#19543)
add c37db42aeb chore(deps): bump substrait from 0.62.0 to 0.62.2 (#19542)
add d7e5190f78 chore(deps): bump taiki-e/install-action from 2.65.3 to
2.65.6 (#19541)
add bd10f27443 minor: run all examples by default (#19506)
add 94709dc025 perf: improve performance of string replace (#19530)
add 43567b4683 perf: improve performance of levenshtein by reusing cache
buffer (#19532)
add 3f0b3425cb feat: Improve sort memory resilience (#19494)
add 7c50448f5a perf: improve performance of translate by reusing buffers
(#19533)
add 673d7c93a0 Refactor TopKHashTable to use HashTable API (#19464)
add f9cdfea7fe docs: Improve config tables' readability (#19522)
add 8ac500bf07 Revert Spark Elt nullability change (#19510)
add 8469aa1dcd minor: implement more arms for `get_data_types()` for
`NativeType` (#19449)
add 1d2b389599 perf: Optimize `contains` for scalar search arg (#19529)
add 13f38435a2 Introduce `TypeSignatureClass::Any` (#19485)
add a6fd5cc840 Upgrade hashbrown to 0.16 (#19554)
add a51e3a079e minor : add crypto function benchmark (#19539)
add 3420a2d4ad chore(deps): bump taiki-e/install-action from 2.65.6 to
2.65.8 (#19559)
add 34addca6ba bugfix: preserve schema metadata for record batch in FFI
(#19293)
add d13d89129b feat: Add DELETE/UPDATE hooks to TableProvider trait and to
MemTable implementation (#19142)
add 1704d1e740 refactor: extract the data generate out of aggregate_topk
benchmark (#19523)
add 9690f958e2 perf: improve performance of lpad/rpad by reusing buffers
(#19558)
add 56a2be17d0 perf: optimize regexp_count to avoid String allocation when
start position is provided (#19553)
add 4e45c19d10 Enables DefaultListFilesCache by default (#19366)
add f1e5c94f3a Compute Dynamic Filters only when a consumer supports them
(#19546)
add 1ce4b51a48 Various refactors to string functions (#19402)
add 27de50d055 fix: Reverse row selection should respect the row group
index (#19557)
add 79f67b8ef2 feat: implement partition_statistics for WindowAggExec
(#18534)
add b818f93416 perf: Improve performance of `md5` (#19568)
add fd263216c9 feat: integrate batch coalescer with async fn exec (#19342)
add 8959b3d11e feat: output statistics for constant columns in projections
(#19419)
add db7b8cc4db Implement `partition_statistics` API for
`NestedLoopJoinExec` (#19468)
add cd12d51039 Replace deprecated structopt with clap in
datafusion-benchmarks (#19492)
add 818706ab78 feat: `to_time` function (#19540)
add 0db668bc99 Refactor duplicate code in `type_coercion/functions.rs`
(#19518)
add 90f5bfe309 feat: Implement Spark functions hour, minute, second
(#19512)
add bc753c201f chore(deps): bump taiki-e/install-action from 2.65.8 to
2.65.10 (#19578)
add 195d3d64bb perf: optimize strpos by eliminating double iteration for
UTF-8 (#19572)
add 9a9ff8d616 perf: Improve performance of hex encoding in spark
functions (#19586)
add 56fec71c7b Add left function benchmark (#19600)
add 987b94ca47 chore: Add TPCDS benchmark comparison for PR (#19552)
add 1320069246 Fix typo in contributor guide architecture section (#19613)
add a295698592 chore(deps): bump taiki-e/install-action from 2.65.10 to
2.65.11 (#19601)
add 715962c80b perf: optimize factorial function performance (#19575)
add 8809dae280 perf: Improve performance of ltrim, rtrim, btrim (#19551)
add 2ac032b40d fix: emit empty RecordBatch for empty file writes (#19370)
add 70daf88251 feat: plan-time SQL expression simplifying (#19311)
add 09455f1814 chore: bump testcontainers-modules to 0.14 and remove
testcontainers dep (#19620)
add 64c93ef427 chore(deps): bump sqlparser from 0.59.0 to 0.60.0
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0325bc319b)
\
N -- N -- N refs/heads/dependabot/cargo/main/sqlparser-0.60.0
(64c93ef427)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/audit.yml | 2 +-
.github/workflows/rust.yml | 4 +-
Cargo.lock | 218 ++----
Cargo.toml | 5 +-
benchmarks/Cargo.toml | 2 +-
benchmarks/README.md | 19 +-
benchmarks/bench.sh | 2 +-
benchmarks/src/bin/dfbench.rs | 15 +-
benchmarks/src/bin/external_aggr.rs | 27 +-
benchmarks/src/bin/imdb.rs | 24 +-
benchmarks/src/bin/mem_profile.rs | 22 +-
benchmarks/src/cancellation.rs | 18 +-
benchmarks/src/clickbench.rs | 30 +-
benchmarks/src/h2o.rs | 26 +-
benchmarks/src/hj.rs | 12 +-
benchmarks/src/imdb/convert.rs | 12 +-
benchmarks/src/imdb/run.rs | 22 +-
benchmarks/src/nlj.rs | 12 +-
benchmarks/src/smj.rs | 12 +-
benchmarks/src/sort_tpch.rs | 18 +-
benchmarks/src/tpcds/run.rs | 28 +-
benchmarks/src/tpch/run.rs | 28 +-
benchmarks/src/util/options.rs | 18 +-
datafusion-cli/Cargo.toml | 1 -
datafusion-cli/tests/cli_integration.rs | 8 +-
.../examples/builtin_functions/main.rs | 2 +-
.../examples/custom_data_source/main.rs | 2 +-
datafusion-examples/examples/data_io/main.rs | 2 +-
datafusion-examples/examples/dataframe/main.rs | 2 +-
.../examples/execution_monitoring/main.rs | 2 +-
.../examples/external_dependency/main.rs | 2 +-
datafusion-examples/examples/flight/main.rs | 2 +-
datafusion-examples/examples/proto/main.rs | 2 +-
.../examples/query_planning/main.rs | 2 +-
.../examples/relation_planner/main.rs | 2 +-
.../examples/relation_planner/table_sample.rs | 45 +-
datafusion-examples/examples/sql_ops/main.rs | 2 +-
datafusion-examples/examples/udf/main.rs | 2 +-
datafusion/catalog/src/memory/table.rs | 349 ++++++++-
datafusion/catalog/src/table.rs | 25 +
datafusion/common/src/lib.rs | 2 +-
datafusion/common/src/utils/mod.rs | 36 +-
datafusion/core/benches/topk_aggregate.rs | 124 +--
datafusion/core/src/dataframe/mod.rs | 2 +
.../core/src/datasource/file_format/arrow.rs | 93 +++
datafusion/core/src/datasource/file_format/csv.rs | 62 ++
datafusion/core/src/datasource/file_format/json.rs | 42 +
.../core/src/datasource/file_format/parquet.rs | 22 +
datafusion/core/src/physical_planner.rs | 162 +++-
.../tests/custom_sources_cases/dml_planning.rs | 297 +++++++
datafusion/core/tests/custom_sources_cases/mod.rs | 1 +
.../core/tests/datasource/object_store_access.rs | 76 +-
datafusion/core/tests/fuzz_cases/window_fuzz.rs | 4 +-
.../physical_optimizer/filter_pushdown/mod.rs | 88 +++
.../physical_optimizer/partition_statistics.rs | 180 ++++-
datafusion/datasource-parquet/src/opener.rs | 119 ++-
datafusion/datasource-parquet/src/sort.rs | 865 ++++++++++++++++++---
datafusion/datasource/src/write/demux.rs | 17 +
datafusion/execution/src/cache/cache_manager.rs | 27 +-
datafusion/execution/src/lib.rs | 1 -
datafusion/expr-common/src/signature.rs | 74 +-
datafusion/expr/src/arguments.rs | 433 ++++++++++-
datafusion/expr/src/expr_schema.rs | 24 +-
datafusion/expr/src/lib.rs | 4 +
datafusion/expr/src/logical_plan/dml.rs | 8 +-
datafusion/expr/src/type_coercion/functions.rs | 304 ++++----
datafusion/expr/src/udf.rs | 6 +-
datafusion/ffi/src/record_batch_stream.rs | 42 +-
datafusion/ffi/src/udaf/mod.rs | 4 +-
datafusion/ffi/src/udf/mod.rs | 11 +-
datafusion/ffi/src/udwf/mod.rs | 4 +-
datafusion/functions-aggregate/src/array_agg.rs | 2 +-
datafusion/functions/Cargo.toml | 42 +-
.../benches/{ends_with.rs => contains.rs} | 70 +-
.../functions/benches/{upper.rs => crypto.rs} | 49 +-
.../functions/benches/{uuid.rs => factorial.rs} | 35 +-
datafusion/functions/benches/left.rs | 111 +++
datafusion/functions/benches/levenshtein.rs | 87 +++
datafusion/functions/benches/pad.rs | 314 ++++++--
datafusion/functions/benches/regexp_count.rs | 118 +++
.../functions/benches/{repeat.rs => replace.rs} | 108 +--
datafusion/functions/benches/translate.rs | 90 +++
datafusion/functions/benches/{ltrim.rs => trim.rs} | 200 +++--
datafusion/functions/src/core/arrow_cast.rs | 13 +-
datafusion/functions/src/core/arrow_metadata.rs | 28 +-
datafusion/functions/src/crypto/basic.rs | 34 +-
datafusion/functions/src/datetime/mod.rs | 7 +
datafusion/functions/src/datetime/to_time.rs | 252 ++++++
datafusion/functions/src/math/factorial.rs | 78 +-
datafusion/functions/src/regex/regexpcount.rs | 12 +-
datafusion/functions/src/string/btrim.rs | 2 +-
datafusion/functions/src/string/common.rs | 234 +++---
datafusion/functions/src/string/contains.rs | 89 ++-
datafusion/functions/src/string/ends_with.rs | 8 +-
datafusion/functions/src/string/levenshtein.rs | 24 +-
datafusion/functions/src/string/ltrim.rs | 10 +-
datafusion/functions/src/string/replace.rs | 85 +-
datafusion/functions/src/string/rtrim.rs | 10 +-
datafusion/functions/src/string/split_part.rs | 24 +-
datafusion/functions/src/string/starts_with.rs | 8 +-
datafusion/functions/src/string/to_hex.rs | 69 +-
datafusion/functions/src/string/uuid.rs | 2 +-
datafusion/functions/src/unicode/lpad.rs | 33 +-
datafusion/functions/src/unicode/rpad.rs | 38 +-
datafusion/functions/src/unicode/strpos.rs | 39 +-
datafusion/functions/src/unicode/translate.rs | 56 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 19 +-
.../optimizer/src/simplify_expressions/mod.rs | 1 +
.../src/simplify_expressions/simplify_literal.rs | 151 ++++
datafusion/physical-expr-common/Cargo.toml | 3 +
datafusion/physical-expr-common/src/lib.rs | 1 +
.../src/metrics/baseline.rs | 4 +-
.../src/metrics/builder.rs | 2 +-
.../src/metrics/custom.rs | 2 +-
.../physical-expr-common/src/metrics/expression.rs | 88 +++
.../src/metrics/mod.rs | 4 +-
.../src/metrics/value.rs | 0
datafusion/physical-expr-common/src/sort_expr.rs | 10 +-
datafusion/physical-expr-common/src/utils.rs | 17 +-
datafusion/physical-expr/src/equivalence/class.rs | 8 +-
datafusion/physical-expr/src/expressions/case.rs | 9 +-
.../src/expressions/dynamic_filters.rs | 66 +-
datafusion/physical-expr/src/projection.rs | 317 +++++++-
datafusion/physical-expr/src/scalar_function.rs | 8 +-
datafusion/physical-expr/src/utils/mod.rs | 2 +-
.../physical-plan/src/aggregates/row_hash.rs | 2 +-
.../src/aggregates/topk/hash_table.rs | 392 ++++------
.../physical-plan/src/aggregates/topk/heap.rs | 38 -
.../src/aggregates/topk/priority_map.rs | 26 +-
datafusion/physical-plan/src/async_func.rs | 108 ++-
.../physical-plan/src/joins/hash_join/exec.rs | 37 +-
.../physical-plan/src/joins/nested_loop_join.rs | 33 +-
datafusion/physical-plan/src/joins/utils.rs | 30 +-
datafusion/physical-plan/src/metrics.rs | 6 +-
datafusion/physical-plan/src/projection.rs | 5 +-
.../physical-plan/src/sorts/multi_level_merge.rs | 12 +-
datafusion/physical-plan/src/sorts/sort.rs | 465 +++++++++--
.../physical-plan/src/spill/spill_manager.rs | 5 +-
datafusion/physical-plan/src/stream.rs | 187 ++++-
.../physical-plan/src/windows/window_agg_exec.rs | 38 +-
datafusion/spark/src/function/datetime/extract.rs | 268 +++++++
datafusion/spark/src/function/datetime/mod.rs | 18 +
datafusion/spark/src/function/hash/sha1.rs | 10 +-
datafusion/spark/src/function/math/hex.rs | 27 +-
datafusion/spark/src/function/string/ascii.rs | 77 +-
datafusion/spark/src/function/string/elt.rs | 67 +-
datafusion/sql/src/expr/function.rs | 37 +-
datafusion/sqllogictest/Cargo.toml | 2 -
datafusion/sqllogictest/bin/postgres_container.rs | 6 +-
.../sqllogictest/test_files/arrow_typeof.slt | 5 +-
.../test_files/datetime/timestamps.slt | 215 +++++
datafusion/sqllogictest/test_files/delete.slt | 16 +-
datafusion/sqllogictest/test_files/dml_delete.slt | 202 +++++
datafusion/sqllogictest/test_files/dml_update.slt | 286 +++++++
datafusion/sqllogictest/test_files/encoding.slt | 2 +-
datafusion/sqllogictest/test_files/errors.slt | 4 +-
.../sqllogictest/test_files/explain_analyze.slt | 41 +
datafusion/sqllogictest/test_files/math.slt | 2 +-
.../sqllogictest/test_files/named_arguments.slt | 3 +-
datafusion/sqllogictest/test_files/parquet.slt | 4 +
.../sqllogictest/test_files/repartition_scan.slt | 4 +
.../sqllogictest/test_files/set_variable.slt | 18 +
.../test_files/spark/datetime/hour.slt | 23 +-
.../test_files/spark/datetime/minute.slt | 23 +-
.../test_files/spark/datetime/second.slt | 23 +-
datafusion/sqllogictest/test_files/update.slt | 20 +-
docs/source/_static/theme_overrides.css | 18 +
docs/source/contributor-guide/architecture.md | 2 +-
docs/source/library-user-guide/upgrading.md | 17 +-
docs/source/user-guide/sql/scalar_functions.md | 49 +-
170 files changed, 8077 insertions(+), 2051 deletions(-)
create mode 100644 datafusion/core/tests/custom_sources_cases/dml_planning.rs
copy datafusion/functions/benches/{ends_with.rs => contains.rs} (68%)
copy datafusion/functions/benches/{upper.rs => crypto.rs} (55%)
copy datafusion/functions/benches/{uuid.rs => factorial.rs} (52%)
create mode 100644 datafusion/functions/benches/left.rs
create mode 100644 datafusion/functions/benches/levenshtein.rs
create mode 100644 datafusion/functions/benches/regexp_count.rs
copy datafusion/functions/benches/{repeat.rs => replace.rs} (56%)
create mode 100644 datafusion/functions/benches/translate.rs
rename datafusion/functions/benches/{ltrim.rs => trim.rs} (56%)
create mode 100644 datafusion/functions/src/datetime/to_time.rs
create mode 100644
datafusion/optimizer/src/simplify_expressions/simplify_literal.rs
rename datafusion/{execution => physical-expr-common}/src/metrics/baseline.rs
(98%)
rename datafusion/{execution => physical-expr-common}/src/metrics/builder.rs
(99%)
rename datafusion/{execution => physical-expr-common}/src/metrics/custom.rs
(98%)
create mode 100644 datafusion/physical-expr-common/src/metrics/expression.rs
rename datafusion/{execution => physical-expr-common}/src/metrics/mod.rs (99%)
rename datafusion/{execution => physical-expr-common}/src/metrics/value.rs
(100%)
create mode 100644 datafusion/spark/src/function/datetime/extract.rs
create mode 100644 datafusion/sqllogictest/test_files/dml_delete.slt
create mode 100644 datafusion/sqllogictest/test_files/dml_update.slt
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
