This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/cargo/main/proto-c40a7389eb
in repository https://gitbox.apache.org/repos/asf/datafusion.git
omit fccd0b936f chore(deps): bump the proto group with 3 updates
add 8e95627d3e chore(deps): bump sphinx-reredirects from 1.0.0 to 1.1.0 in
/docs (#19455)
add 5fedb84232 chore(deps): bump insta from 1.44.3 to 1.45.0 (#19454)
add a886b9eb42 added support for negative scale for log decimal32/64 and
power (#19409)
add 1e591640dd Remove core dependency from ffi (#19422)
add bb9a4a7ea1 bench: increase in_list benchmark coverage (#19443)
add 48f5d0b721 fix: Fix skip aggregate test to cover regression (#19461)
add d0d93117b9 fix: [19450]Added flush for tokio file(substrait) write
(#19456)
add 258e18cf88 Use SortMergeJoinExec name consistently in physical plan
outputs (#19246)
add d844f8687a Add:arrow_metadata() UDF (#19435)
add 4a1f69f9bc Update date_bin to support Time32 and Time64 data types
(#19341)
add 72f1746169 feat: Add decimal support for round (#19384)
add e6faacbf58 Fix panic during spill to disk in clickbench query (#19421)
add 677c543aef Optimize memory footprint of view arrays from
`ScalarValue::to_array_of_size` (#19441)
add 33ac70dd6d minor: refactoring of some `ScalarValue` code (#19439)
add 0bd880931e fix: csv schema_infer_max_records set to 0 return null
datatype (#19432)
add 902d3b32be fix: Add custom nullability for Spark LIKE function (#19218)
add 67b526a620 Refactor Spark crc32 & sha1 to remove unnecessary scalar
argument check (#19466)
add 47ddd50353 Add link to arrow-rs ticket in comments (#19479)
add a405d3fe4a Support nested field access in `get_field` with multiple
path arguments (#19389)
add d2830b6bed chore(deps): bump taiki-e/install-action from 2.65.1 to
2.65.2 (#19474)
add 6ce237492d Improve plan_to_sql handling of empty projections with
dialect-specific SELECT list support (#19221)
add ef2c1a30eb examples: replace sql_dialect with custom_sql_parser
example (#19383)
add 03904e1b2e Replace custom merge operator with arrow-rs implementation
(#19424)
add ea2e22c743 Implement nested recursive CTEs (#18956)
add e586ff5328 fix: implement custom nullability for spark abs function
(#19395)
add 058bcb0014 fix: custom nullability for format_string (#19173) (#19190)
add 62740802f6 Update `to_unixtime` udf function to support a consistent
set of argument types (#19442)
add ed7af0b12a Add: PI upper/lower bound f16 constants to ScalarValue
(#19497)
add 8532731570 chore: enforce clippy::allow_attributes for datafusion-ffi
crate (#19480)
add ae35177df5 Add CI check to ensure examples are documented in README
(#19371)
add e5ca510dcf perf: Improve performance of `to_hex` (> 2x) (#19503)
add d20c5d68f7 fix : snapshot to the modern multiline format (#19517)
add 5b90ceef1c perf: improve performance of string repeat (#19502)
add 134be4ce51 chore(deps): bump taiki-e/install-action from 2.65.2 to
2.65.3 (#19499)
add d825e5f394 docs : clarify unused test utility (#19508)
add bb4e0eca22 perf: Optimize `starts_with` and `ends_with` for scalar
arguments (#19516)
add 85c696df43 Date / time / interval arithmetic improvements (#19460)
add 8246631bfa fix: Implement `reset_state` for `LazyMemoryExec` (#19362)
add 6ac7b898e7 Preserve ORDER BY in Unparser for projection -> order by
pattern (#19483)
add 9eddf473fa fix: CteWorkTable: properly apply TableProvider::scan
projection argument (#18993)
add 4960284541 fix: Median() integer overflow (#19509)
add 10db6b3712 Redesign the try_reverse_output to support more cases
(#19446)
add 51c39513ec chore(deps): bump the proto group with 3 updates
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (fccd0b936f)
\
N -- N -- N refs/heads/dependabot/cargo/main/proto-c40a7389eb
(51c39513ec)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/audit.yml | 2 +-
.github/workflows/rust.yml | 21 +-
Cargo.lock | 6 +-
Cargo.toml | 2 +-
ci/scripts/check_examples_docs.sh | 64 ++
datafusion-examples/README.md | 12 +-
.../examples/sql_ops/custom_sql_parser.rs | 420 ++++++++++
datafusion-examples/examples/sql_ops/dialect.rs | 135 ----
datafusion-examples/examples/sql_ops/main.rs | 12 +-
datafusion/catalog/src/cte_worktable.rs | 38 +-
datafusion/common/src/scalar/consts.rs | 12 +
datafusion/common/src/scalar/mod.rs | 231 +++---
datafusion/core/src/datasource/file_format/csv.rs | 28 +
datafusion/core/tests/dataframe/mod.rs | 2 +-
datafusion/core/tests/execution/coop.rs | 13 +-
.../physical_optimizer/enforce_distribution.rs | 48 +-
.../tests/physical_optimizer/enforce_sorting.rs | 28 +-
.../core/tests/physical_optimizer/pushdown_sort.rs | 380 ++++++++-
.../tests/physical_optimizer/sanity_checker.rs | 6 +-
.../core/tests/physical_optimizer/test_utils.rs | 207 ++++-
datafusion/core/tests/sql/mod.rs | 1 +
datafusion/core/tests/sql/unparser.rs | 462 +++++++++++
datafusion/datasource-csv/src/file_format.rs | 50 +-
datafusion/datasource-parquet/src/source.rs | 87 +-
datafusion/datasource/src/file.rs | 57 +-
datafusion/datasource/src/file_scan_config.rs | 19 +-
datafusion/expr-common/src/type_coercion/binary.rs | 103 ++-
.../src/type_coercion/binary/tests/arithmetic.rs | 8 +-
.../src/type_coercion/binary/tests/comparison.rs | 58 +-
datafusion/ffi/Cargo.toml | 15 +-
datafusion/ffi/src/arrow_wrappers.rs | 10 +-
datafusion/ffi/src/catalog_provider.rs | 1 -
datafusion/ffi/src/catalog_provider_list.rs | 1 -
datafusion/ffi/src/execution/task_ctx.rs | 1 -
datafusion/ffi/src/execution/task_ctx_provider.rs | 1 -
datafusion/ffi/src/execution_plan.rs | 38 +-
datafusion/ffi/src/expr/columnar_value.rs | 1 -
datafusion/ffi/src/expr/distribution.rs | 11 +-
datafusion/ffi/src/expr/expr_properties.rs | 3 -
datafusion/ffi/src/expr/interval.rs | 4 +-
datafusion/ffi/src/insert_op.rs | 3 +-
datafusion/ffi/src/lib.rs | 1 +
datafusion/ffi/src/physical_expr/mod.rs | 69 +-
datafusion/ffi/src/physical_expr/partitioning.rs | 7 +-
datafusion/ffi/src/physical_expr/sort.rs | 7 +-
datafusion/ffi/src/plan_properties.rs | 3 -
.../ffi/src/proto/logical_extension_codec.rs | 1 -
.../ffi/src/proto/physical_extension_codec.rs | 1 -
datafusion/ffi/src/record_batch_stream.rs | 43 +-
datafusion/ffi/src/schema_provider.rs | 1 -
datafusion/ffi/src/session/config.rs | 1 -
datafusion/ffi/src/session/mod.rs | 4 +-
datafusion/ffi/src/table_provider.rs | 1 -
datafusion/ffi/src/table_source.rs | 7 +-
datafusion/ffi/src/tests/async_provider.rs | 57 +-
datafusion/ffi/src/tests/catalog.rs | 30 +-
datafusion/ffi/src/tests/mod.rs | 38 +-
datafusion/ffi/src/tests/sync_provider.rs | 3 +-
datafusion/ffi/src/tests/udf_udaf_udwf.rs | 36 +-
datafusion/ffi/src/tests/utils.rs | 8 +-
datafusion/ffi/src/udaf/accumulator.rs | 40 +-
datafusion/ffi/src/udaf/accumulator_args.rs | 27 +-
datafusion/ffi/src/udaf/groups_accumulator.rs | 47 +-
datafusion/ffi/src/udaf/mod.rs | 65 +-
datafusion/ffi/src/udf/mod.rs | 54 +-
datafusion/ffi/src/udf/return_type_args.rs | 16 +-
datafusion/ffi/src/udtf.rs | 1 -
datafusion/ffi/src/udwf/mod.rs | 15 +-
datafusion/ffi/src/udwf/partition_evaluator.rs | 31 +-
.../ffi/src/udwf/partition_evaluator_args.rs | 14 +-
datafusion/ffi/src/udwf/range.rs | 1 -
datafusion/ffi/src/volatility.rs | 3 +-
datafusion/ffi/tests/ffi_catalog.rs | 3 +-
datafusion/ffi/tests/ffi_integration.rs | 3 +-
datafusion/ffi/tests/ffi_udf.rs | 4 +-
datafusion/ffi/tests/ffi_udtf.rs | 1 -
datafusion/ffi/tests/ffi_udwf.rs | 3 +-
datafusion/ffi/tests/utils/mod.rs | 9 +-
datafusion/functions-aggregate/src/median.rs | 22 +-
datafusion/functions-nested/src/planner.rs | 3 +
datafusion/functions-table/src/generate_series.rs | 47 ++
datafusion/functions/Cargo.toml | 10 +
datafusion/functions/benches/ends_with.rs | 185 +++++
datafusion/functions/benches/starts_with.rs | 185 +++++
datafusion/functions/benches/to_hex.rs | 120 ++-
datafusion/functions/src/core/arrow_metadata.rs | 148 ++++
datafusion/functions/src/core/getfield.rs | 645 ++++++++++-----
datafusion/functions/src/core/mod.rs | 14 +
datafusion/functions/src/datetime/date_bin.rs | 314 +++++++-
datafusion/functions/src/datetime/mod.rs | 2 +-
datafusion/functions/src/datetime/to_unixtime.rs | 38 +-
datafusion/functions/src/math/log.rs | 38 +-
datafusion/functions/src/math/power.rs | 69 +-
datafusion/functions/src/math/round.rs | 367 ++++++---
datafusion/functions/src/string/ends_with.rs | 298 ++++++-
datafusion/functions/src/string/repeat.rs | 33 +-
datafusion/functions/src/string/starts_with.rs | 269 ++++++-
datafusion/functions/src/string/to_hex.rs | 148 +++-
datafusion/functions/src/utils.rs | 18 +-
datafusion/optimizer/src/analyzer/type_coercion.rs | 166 +++-
datafusion/physical-expr/benches/in_list.rs | 77 ++
datafusion/physical-expr/src/expressions/case.rs | 270 +------
.../physical-expr/src/expressions/in_list.rs | 302 ++++++-
.../group_values/multi_group_by/bytes_view.rs | 38 +-
datafusion/physical-plan/src/coop.rs | 24 +-
.../src/joins/sort_merge_join/exec.rs | 3 +-
datafusion/physical-plan/src/memory.rs | 54 ++
datafusion/physical-plan/src/projection.rs | 72 +-
datafusion/physical-plan/src/recursive_query.rs | 4 +-
datafusion/physical-plan/src/work_table.rs | 103 ++-
datafusion/spark/src/function/hash/crc32.rs | 16 +-
datafusion/spark/src/function/hash/sha1.rs | 17 +-
datafusion/spark/src/function/math/abs.rs | 78 +-
.../spark/src/function/string/format_string.rs | 63 +-
datafusion/spark/src/function/string/like.rs | 92 ++-
datafusion/sql/src/expr/value.rs | 130 +--
datafusion/sql/src/unparser/ast.rs | 46 +-
datafusion/sql/src/unparser/dialect.rs | 45 +-
datafusion/sql/src/unparser/expr.rs | 44 +-
datafusion/sql/src/unparser/plan.rs | 35 +-
datafusion/sql/tests/cases/plan_to_sql.rs | 80 +-
datafusion/sql/tests/sql_integration.rs | 5 +-
datafusion/sqllogictest/src/test_context.rs | 56 +-
datafusion/sqllogictest/test_files/aggregate.slt | 56 ++
.../test_files/aggregate_skip_partial.slt | 17 +-
datafusion/sqllogictest/test_files/cte.slt | 69 +-
.../test_files/datetime/arith_date_date.slt | 16 +
.../test_files/datetime/arith_date_integer.slt | 89 +++
.../test_files/datetime/arith_date_interval.slt | 37 +
.../test_files/datetime/arith_date_time.slt | 116 +++
.../test_files/datetime/arith_interval_double.slt | 41 +
.../datetime/arith_interval_interval.slt | 27 +
.../test_files/datetime/arith_negate_interval.slt | 13 +
.../test_files/datetime/arith_time_interval.slt | 70 ++
.../test_files/datetime/arith_time_time.slt | 47 ++
.../datetime/arith_timestamp_duration.slt | 147 ++++
.../datetime/arith_timestamp_interval.slt | 36 +
.../datetime/arith_timestamp_timestamp.slt | 13 +
.../{ => datetime}/current_date_timezone.slt | 0
.../{ => datetime}/current_time_timezone.slt | 0
.../test_files/{expr => datetime}/date_part.slt | 0
.../test_files/{ => datetime}/dates.slt | 0
.../test_files/{ => datetime}/interval.slt | 0
.../test_files/{ => datetime}/interval_mysql.slt | 0
.../test_files/{ => datetime}/timestamps.slt | 133 ++++
datafusion/sqllogictest/test_files/decimal.slt | 71 ++
.../test_files/dynamic_filter_pushdown_config.slt | 326 --------
datafusion/sqllogictest/test_files/joins.slt | 12 +-
datafusion/sqllogictest/test_files/metadata.slt | 16 +-
datafusion/sqllogictest/test_files/scalar.slt | 34 +-
.../sqllogictest/test_files/sort_merge_join.slt | 2 +-
.../sqllogictest/test_files/sort_pushdown.slt | 886 +++++++++++++++++++++
datafusion/sqllogictest/test_files/struct.slt | 171 ++++
.../sqllogictest/test_files/table_functions.slt | 24 +
datafusion/substrait/src/serializer.rs | 1 +
docs/requirements.txt | 2 +-
docs/source/user-guide/sql/format_options.md | 38 +-
docs/source/user-guide/sql/scalar_functions.md | 103 ++-
158 files changed, 8303 insertions(+), 2359 deletions(-)
create mode 100755 ci/scripts/check_examples_docs.sh
create mode 100644 datafusion-examples/examples/sql_ops/custom_sql_parser.rs
delete mode 100644 datafusion-examples/examples/sql_ops/dialect.rs
create mode 100644 datafusion/core/tests/sql/unparser.rs
create mode 100644 datafusion/functions/benches/ends_with.rs
create mode 100644 datafusion/functions/benches/starts_with.rs
create mode 100644 datafusion/functions/src/core/arrow_metadata.rs
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_date_date.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_date_integer.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_date_interval.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_date_time.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_interval_double.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_interval_interval.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_negate_interval.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_time_interval.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_time_time.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_timestamp_duration.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_timestamp_interval.slt
create mode 100644
datafusion/sqllogictest/test_files/datetime/arith_timestamp_timestamp.slt
rename datafusion/sqllogictest/test_files/{ =>
datetime}/current_date_timezone.slt (100%)
rename datafusion/sqllogictest/test_files/{ =>
datetime}/current_time_timezone.slt (100%)
rename datafusion/sqllogictest/test_files/{expr => datetime}/date_part.slt
(100%)
rename datafusion/sqllogictest/test_files/{ => datetime}/dates.slt (100%)
rename datafusion/sqllogictest/test_files/{ => datetime}/interval.slt (100%)
rename datafusion/sqllogictest/test_files/{ => datetime}/interval_mysql.slt
(100%)
rename datafusion/sqllogictest/test_files/{ => datetime}/timestamps.slt (97%)
create mode 100644 datafusion/sqllogictest/test_files/sort_pushdown.slt
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
