This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-4.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 34bab824bfa [regression-test](point query) remove test_point_query
nonconcurrent (#52004)
add 2e8df95ecdc [opt](nereids) print more friendly message when cannot
find compatible data type (#55669)
add a5a1d28831f [fix](virtual slot) adjust virtual column expression
nullable (#55694)
add 8445855cf25 [fix](cloud) Fix schema change stats id and cumulative
point (#55703)
add 8bf671d34ad [enhancement](filecache) fix read_cache_file_directly
(#54503)
add ec31ac2e674 [Improvement](expr) opt for vliteral execute (#55665)
add 2ac0f861abd [Opt](mow) Opt mow load performance and CPU usage (#55073)
add db41a84deeb [refactor](nereids) agg strategy refactor (#54079)
add 22eb6803a8f [feat](unique function) add project for unique function
(#48449)
add 71c5f35aee5 [opt](catalog) remove old properties (#55625)
add 627309341be [enchement](tvf)support tvf topn lazy materialize. (#54842)
add 3b2acd2f5be [Fix](case) Comment some case to avoid p0 stuck (#55733)
add 9097e0550a9 [chore](pipeline) enable ssd storage type for fdb (#55722)
add b08e82ee8dc [fix](table) Move drop editlog in table lock (#55705)
add a1f35a04d18 [fix](cloud) Avoid creating another txn during read
versioned keys (#55653)
add 80147f86d26 [fix](backup) Support backup meta/job info exceeds 2GB
(#55608)
add 371ab3647fb [bugfix](compaction) the avg segment size should always be
less than input rows (#55713)
add b6686b06783 [chore](cloud) Fix txn_lazy_commit_test ut not stable
(#55717)
add efd3746f907 [feat](csv reader) support empty field as null (#55041)
add ab70b9f49ec [fix](iceberg) Add missing iceberg-aws dependency to
metadata scanner (#55741)
add b68bb92c1ba [fix](maxcompute)Fix the NereidsException caused by
non-existent table columns when pushing down mc predicates. (#55635)
add 6f9eed180e0 [fix](iceberg)fix read parquet page index core when read
iceberg with equal delete. (#55190)
add e33275e79cf [fix](meta) make OP_CERATE_DB compatible with 3.1 (#55149)
add 8192bbfa384 [Feature](agg) Support bool agg functions (#55643)
add 968594cce64 [Improvement](column) fully support only_null (#55676)
add 90bae169c05 [Chore](nereids) remove LoadStmt (#55538)
add 28c537c3313 [opt](hive) set hive.recursive_directories default to true
(#55737)
add 03a5c321608 [fix](unique function) fix virtual slot with unique
function (#55716)
add d18b5ba798a [feat](hdfs)Add HDFS HA Configuration Validation (#55675)
add bb1420b3fe7 [fix](scheduler) Fix coredump due to different queue size
(#55736)
add 14e572397fa [test] add regression test for cloud build index (#55685)
add 21993a2418f [fix](case) fix some cases (#55739)
add a56419bf898 [feat](cloud) Recycle operation logs according the
snapshot keys (#55678)
add 4781c24bc91 [fix](profile) Add parser time to total time of summary
profile (#55506)
add 60c47654435 [fix](struct)fix fe struct functions (#54978)
add 18ac29c4c4d [opt](docker) Make hive components more robust (#55734)
add 4215d30ede5 [fix](sc) fix check_table_size_correctness failed after
schema change when enable skip_writing_empty_rowset_metadata (#55742)
add 627c855aa50 [Chore](function) remove DefaultExecutable (#55724)
add e9e1cafe6e3 [fix](restore) Clear restored table/partition/resource to
reduce overhead (#55757)
add d594b8dd79a [fix](constant fold)Do not do BE constant fold when
float/double is NaN (#55425)
add 7b1fcaec279 [fix](constant fold)Fmod should return null when second
argument is 0. (#55773)
add 6fa6f458358 [feat](nereids) support virtual column for StatsDerive
(#55727)
add c2b684876b3 [Bench](tools) Add coffee-bench tools for Doris (#55730)
add 7bd1949537d [fix](cases) fix case test_hudi_snapshot fail (#55761)
add d23a87d316e [fix](test) fix some nereids test cause by merge pr order
(#55770)
add 7a59633edd8 [fix](mysql protocol)Set more stmt exists flag correctly
when forward to master. (#55711)
add f0a10634ebd [Enhancement](cast) Support colon as delimater between
date and time (#55785)
add c41660810be [improve](nereids) Adjust the conditions for confirming
hot values (#55472)
add 5b06a3f1c89 [fix](cast)Forbid datetime to tiny/small int cast (#55787)
add 7eeb09fe8d6 [Chore](FE) Add comment to AnyDataType and rename improper
function name (#55735)
add 6d9490714cd [improve](zonemap) support zonemap for float/double type
(#55633)
add bbd21ee23fe [chore](ci) disable bad case (#55800)
add 47e1b90a2f5 [bugfix](memtracker) memory not consumed by memtracker
(#55796)
add f7594415762 [opt](json) Provide a vectorized interface for cast from
JSON (#55686)
add 2a30eb60a91 [Refactor](function) Refactor date arithmetic function
signatures (#55693)
add 9d79ab8548e [Feature](function) Support uniform function (#55789)
add a7e4570d08b [opt](nereids) variant sub path pruning check circular
reference (#55287)
add 97eded58bfb [Feature](func) Support function soundex (#55731)
add ff7b5dcded2 [test]fix test_follower_consistent_auth failed (#55777)
add 2b605f87e88 Revert "[fix](inverted index) fix wrong read data for
primary key (#47841) (#55723)
add 688192b25b2 [fix](mv case) waiting mv task should just care the
lastest one (#55802)
add f46ee1834b0 [Feature](k8s)script support tls (#55824)
add b8ad0af6efb [fix](ci) skip beut case (#55818)
add 18254467265 [fix](case) fix some failure cases (#55811)
add aeea67db113 [Fix](regression) fix wrong regression result of bool_agg
(#55794)
add a9d5c1750f3 [fix](array functions) Restrict the input types of the
array function (#54439)
add 4bc88975277 [fix](function) The constant parameter of
json_parse_error_to_value caused a crash (#55816)
add a6d0e586a21 [Enhancement](Log) change some logs from info to debug
(#55808)
add 270c7ddc90a [opt](be) Use a custom allocator to allocate memory in
order to avoid untracked memory usage (#55749)
add a2e250bf766 [fix](case) fix case bug (#55836)
add 1fe3e32e6fc [fix](test) fix agg strategy regression cases (#55806)
add b53a1000ecb [fix](case) fix ingestion load and broker load cases
(#55361) (#55826)
add bd795155916 [fix](compaction) fix compaction core dump when enable
skip_writing_empty_rowset_metadata (#55837)
add 294b37393ac [enhance](nereids) EliminateGroupByKeyByUniform support
rewrite in cte (#55680)
add 57d9d484c45 [regression-test](point query) fix unstable cases (#55832)
add 3414d72e503 [fix](mtmv) Fix set disable join reorder fail when table
row count is -1 when init join order (#55681)
add ca17ed1bbbc [fix](test) Modify regression test to make stable and
change expected log level (#55169)
add f7d874650fc [opt](load) add some metrics for flush memtable (#55852)
add f5b4399403c [fix](case) fix ssb_unique_load_zstd ddl bug (#55844)
add 829a8148894 [fix](connection)Fix kill connection will make current
connection killed (#55809)
add a993ed33719 [feat](txn) Support get_versionstamp func (#55776)
add 56dc78f71f2 [feat](recycler) Compatibility between deleted instance
recycling and cluster snapshots. (#55765)
add 87ec82713f8 [opt](function) Optimize the performance of the
json_extract function and remove some unnecessary code (#55779)
add a71e750b213 [fix](paimon) Fix Paimon DLF catalog caching issue by
adding dlf.catalog.id to cache key (#55875)
add 1eaa1c9bee8 [fix](http stream) http stream should throw exception if
parse sql failed (#55863)
add b7b461aa334 [fix](show txn)Optimize the NPE error when using an
invalid label in the show txn command. (#55880)
add 5965476ade7 [fix](github) add stale issue action (#55838)
add 718baa63eb2 [Fix](regression) fix wrong regression exception in
ai_test (#55873)
add b09dc605d1a [fix](implicit cast)Support json to numeric implicit cast.
(#55775)
add 94c6c811aa6 [Enhancement](sql-dialect) Support retrying original sql
after error (#55566)
add 9ca45359d1d [Improvement](expr) refactor of casewhen (#55677)
add ac54104b21c [refactor](credential) Refactor vended credentials system
with unified architecture (#55760)
add 48cfe0da7a6 [fix](cloud) Fix recycle compaction & schema change
operation logs (#55879)
add b806bce3611 [feat](map) remove duplicated keys in ColumnMap (#54068)
add 20332111c5a [opt](hive) remove some unused code (#55889)
add d1e858d70df [opt](outfile) change suffix of compressed file (#55803)
add d479e2b7753 [fix](inverted index) enable custom analyzer support for
match without index (#55858)
add 6501c79a5a0 [Enhancement](external) Support downloading dependency
packages from the cloud (#54304)
add 9ea5400b504 [fix](function) fix some functions make core problem by
wrong parameters (#54972)
add d48e123d5a3 [Feature](json_functions) support json-remove (#55575)
add d9730eb9348 [Feat](Snapshot) Implement begin_snapshot interface for
snapshot (#55637)
add a15c88ce4aa [opt](agg) remove experimental functions approx_top_k and
approx_top_sum (#55845)
add 82069515eb5 [Chore](compile) add atomic_shared_ptr under libcpp
(#55860)
add 2a5a1099f8a [fix](wal) replay wal abort txn failed when execute failed
(#55881)
add f121725b127 [feature](inverted index) add boolean query (#55721)
add 8f69f145bc3 [Chore](column) some refactor of column dict (#55774)
add 61eed5bb16d [fix](paimon) Fix paimon native reader don't use late
materialization. (#55894)
add 73d4cd9508d [fix](function) fix function sec_to_time max error (#55900)
add 2864924bdce [feat](compaction) Make base compaction output rowset
write filecache more adaptive (#54694)
add cd14249caab [refactor](load): improve clarity of csv_reader error
messages (#55864)
add feaf0e27dcc [fix](cast)Check cast overflow for complex type cast.
(#55434)
add 6068f23008d [fix](cases)fix show create not in variant type (#55766)
add 074d88b2783 [fix](nested-type) fix cases from s3 (#55896)
add a85d86c3fb4 [fix](topn)Fix query result errors caused by lazy
materialization of external tables (#55865)
add 265b20913bc [fix](case)fix external tvf topn lazy mat case. (#55843)
add a6263e64296 [fix](mow) change delete bitmap file name (#55910)
add 865a5269359 [chore](recycler) Improve recycler metrics (#55650)
add b665c0ab695 [fix](schema change) tablet columns is not rebuild after
enable light schema change (#55909)
add 114226e946a [Enhancement](ai) move AI function to block scheduler
(#55886)
add 64cb56f44a5 [Exec](pipeline) Do refactor to change materalization
operator to hyper schduler (#55870)
add d090ba2bda7 [fix](virtual slot) Fix complex type and lambda function
(#55869)
add c2b48d08764 [feat](checker) Add txn key consistency checking for
checker (#54620)
add cd3840dd18a [Chore](scan) set enable_task_executor_in_internal_table
to false (#55935)
add 8634c1d3659 [refine](math function) Clarify the behavior of certain
mathematical functions for invalid inputs. (#55822)
add 5c8d1fad2a3 [feature](function) support json_valid input json value
without cast (#55759)
add 68c75df299a [fix](regression) fix unstable case initial_join_order
(#55828)
No new revisions were added by this update.
Summary of changes:
.github/workflows/stale.yml | 11 +
be/src/cloud/cloud_base_compaction.cpp | 11 +-
be/src/cloud/cloud_cumulative_compaction.cpp | 2 +
be/src/cloud/cloud_full_compaction.cpp | 1 +
be/src/cloud/delete_bitmap_file_reader.cpp | 2 +-
be/src/cloud/delete_bitmap_file_writer.cpp | 2 +-
be/src/common/atomic_shared_ptr.h | 62 +
be/src/common/compare.h | 26 +
be/src/common/config.cpp | 8 +-
be/src/common/config.h | 6 +
be/src/common/daemon.cpp | 2 +-
be/src/exec/olap_common.cpp | 12 +
be/src/exec/olap_common.h | 100 +-
be/src/exec/rowid_fetcher.cpp | 23 +-
be/src/exec/rowid_fetcher.h | 5 +
be/src/exprs/hybrid_set.h | 56 +-
be/src/http/action/delete_bitmap_action.cpp | 26 +
be/src/http/action/delete_bitmap_action.h | 3 +-
be/src/http/action/stream_load.cpp | 6 +
be/src/http/http_common.h | 1 +
be/src/io/cache/block_file_cache.cpp | 81 +-
be/src/io/cache/block_file_cache.h | 83 +-
be/src/io/cache/block_file_cache_factory.cpp | 24 +-
be/src/io/cache/block_file_cache_factory.h | 1 +
be/src/io/cache/cached_remote_file_reader.cpp | 53 +-
be/src/io/cache/file_block.h | 8 +
be/src/io/fs/broker_file_system.cpp | 6 +-
be/src/io/fs/buffered_reader.cpp | 4 +-
be/src/io/fs/buffered_reader.h | 3 +-
be/src/io/fs/file_writer.h | 6 +
be/src/io/fs/s3_file_writer.cpp | 16 +-
be/src/io/fs/stream_load_pipe.cpp | 9 +-
be/src/io/fs/stream_load_pipe.h | 16 +-
be/src/olap/base_tablet.cpp | 27 +-
be/src/olap/base_tablet.h | 3 +
be/src/olap/collection_statistics.h | 1 +
be/src/olap/compaction.cpp | 108 +-
be/src/olap/compaction.h | 7 +
be/src/olap/comparison_predicate.h | 21 +-
be/src/olap/full_compaction.cpp | 2 +
be/src/olap/in_list_predicate.h | 19 +-
be/src/olap/lru_cache.cpp | 16 +
be/src/olap/lru_cache.h | 5 +
be/src/olap/memtable_writer.cpp | 9 +-
be/src/olap/rowset/beta_rowset_writer.cpp | 12 +
be/src/olap/rowset/rowset.cpp | 31 +
be/src/olap/rowset/rowset.h | 4 +
be/src/olap/rowset/segment_creator.cpp | 62 +-
be/src/olap/rowset/segment_v2/column_reader.cpp | 66 +-
be/src/olap/rowset/segment_v2/column_reader.h | 8 +-
.../inverted_index/query_v2/boolean_query.cpp | 91 --
.../inverted_index/query_v2/boolean_query.h | 56 -
.../query_v2/boolean_query/boolean_query.h | 71 +
.../query_v2/boolean_query/boolean_weight.h | 63 +
.../query_v2/buffered_union_scorer.cpp | 258 ++++
.../query_v2/buffered_union_scorer.h | 65 +
.../inverted_index/query_v2/conjunction_op.cpp | 94 --
.../inverted_index/query_v2/disjunction_op.cpp | 86 --
.../inverted_index/query_v2/disjunction_op.h | 59 -
.../segment_v2/inverted_index/query_v2/doc_set.h | 55 +
.../inverted_index/query_v2/factory.inline.h | 47 -
.../query_v2/intersection_scorer.cpp | 158 ++
.../{conjunction_op.h => intersection_scorer.h} | 37 +-
.../segment_v2/inverted_index/query_v2/node.h | 128 --
.../segment_v2/inverted_index/query_v2/operator.h | 27 +-
.../inverted_index/query_v2/phrase_query.h | 38 -
.../segment_v2/inverted_index/query_v2/query.h | 31 +-
.../inverted_index/query_v2/roaring_query.cpp | 25 -
.../inverted_index/query_v2/roaring_query.h | 62 -
.../inverted_index/query_v2/score_combiner.h | 70 +
.../query_v2/{term_query.h => scorer.h} | 34 +-
.../inverted_index/query_v2/segment_postings.h | 107 ++
.../inverted_index/query_v2/term_query.cpp | 36 -
.../query_v2/term_query/term_query.h | 52 +
.../query_v2/term_query/term_scorer.h | 52 +
.../query_v2/term_query/term_weight.h | 73 +
.../query_v2/{factory.h => weight.h} | 25 +-
.../inverted_index/similarity/bm25_similarity.cpp | 29 +-
.../inverted_index/similarity/bm25_similarity.h | 3 +
.../inverted_index/similarity/similarity.h | 4 +-
.../segment_v2/inverted_index/util/term_iterator.h | 21 +-
.../inverted_index/util/term_position_iterator.h | 9 +-
.../segment_v2/inverted_index/util/tiny_set.h | 59 +
.../olap/rowset/segment_v2/inverted_index_common.h | 29 +-
be/src/olap/rowset/segment_v2/segment.cpp | 41 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 25 +-
be/src/olap/rowset/segment_v2/zone_map_index.cpp | 57 +-
be/src/olap/rowset/segment_v2/zone_map_index.h | 12 +
be/src/olap/storage_policy.cpp | 4 +-
be/src/olap/tablet.cpp | 3 +-
be/src/olap/tablet.h | 5 +-
be/src/olap/tablet_meta.cpp | 133 +-
be/src/olap/tablet_meta.h | 6 +-
be/src/olap/wal/wal_table.cpp | 4 +
be/src/olap/wrapper_field.h | 1 +
be/src/pipeline/dependency.cpp | 224 ---
be/src/pipeline/dependency.h | 39 -
be/src/pipeline/exec/aggregation_sink_operator.cpp | 9 +
be/src/pipeline/exec/aggregation_sink_operator.h | 1 +
.../distinct_streaming_aggregation_operator.cpp | 1 +
be/src/pipeline/exec/materialization_opertor.cpp | 362 +++++
be/src/pipeline/exec/materialization_opertor.h | 125 ++
.../exec/materialization_sink_operator.cpp | 155 --
.../pipeline/exec/materialization_sink_operator.h | 70 -
.../exec/materialization_source_operator.cpp | 72 -
.../exec/materialization_source_operator.h | 72 -
be/src/pipeline/exec/mock_scan_operator.h | 3 +
be/src/pipeline/exec/operator.cpp | 12 +-
be/src/pipeline/exec/operator.h | 5 +-
be/src/pipeline/exec/scan_operator.cpp | 14 +-
be/src/pipeline/exec/scan_operator.h | 6 +-
.../exec/streaming_aggregation_operator.cpp | 1 +
be/src/pipeline/pipeline_fragment_context.cpp | 21 +-
be/src/pipeline/pipeline_task.cpp | 21 +
be/src/pipeline/pipeline_task.h | 20 +-
be/src/pipeline/pipeline_tracing.cpp | 4 +-
be/src/pipeline/pipeline_tracing.h | 3 +-
be/src/pipeline/task_queue.cpp | 10 +-
be/src/pipeline/task_scheduler.cpp | 11 +-
be/src/pipeline/task_scheduler.h | 8 +-
be/src/runtime/memory/lru_cache_policy.h | 4 +
be/src/runtime/plugin/cloud_plugin_downloader.cpp | 149 ++
be/src/runtime/plugin/cloud_plugin_downloader.h | 67 +
be/src/runtime/user_function_cache.cpp | 45 +-
be/src/runtime/user_function_cache.h | 3 +-
be/src/service/http_service.cpp | 10 +
be/src/service/internal_service.cpp | 4 +
be/src/util/debug_points.cpp | 9 +-
be/src/util/debug_points.h | 3 +-
be/src/util/disk_info_mac.cpp | 2 +-
be/src/util/faststring.cc | 6 +-
be/src/util/jsonb_document.cpp | 3 +-
be/src/util/jsonb_document_cast.h | 20 +
be/src/util/jsonb_writer.h | 17 +-
be/src/util/mem_info.h | 2 +-
be/src/util/slice.h | 2 +-
be/src/util/string_parser.hpp | 2 +-
.../vec/aggregate_functions/aggregate_function.h | 2 +
.../aggregate_function_ai_agg.h | 2 +
.../aggregate_function_approx_top.h | 116 --
.../aggregate_function_approx_top_k.cpp | 42 -
.../aggregate_function_approx_top_k.h | 232 ---
.../aggregate_function_approx_top_sum.cpp | 69 -
.../aggregate_function_approx_top_sum.h | 248 ----
.../aggregate_function_bool_union.cpp | 44 +
.../aggregate_function_bool_union.h | 111 ++
.../aggregate_functions/aggregate_function_null.h | 2 +
.../aggregate_function_simple_factory.cpp | 6 +-
be/src/vec/columns/column.h | 9 +-
be/src/vec/columns/column_array.cpp | 4 +
be/src/vec/columns/column_array.h | 3 +
be/src/vec/columns/column_const.cpp | 50 +-
be/src/vec/columns/column_const.h | 17 +-
be/src/vec/columns/column_dictionary.h | 51 +-
be/src/vec/columns/column_map.cpp | 107 +-
be/src/vec/columns/column_map.h | 17 +
be/src/vec/columns/column_nullable.cpp | 4 +
be/src/vec/columns/column_nullable.h | 34 +-
be/src/vec/columns/column_struct.cpp | 6 +
be/src/vec/columns/column_struct.h | 1 +
be/src/vec/columns/column_vector.cpp | 21 +
be/src/vec/columns/column_vector.h | 2 +
be/src/vec/common/allocator.cpp | 2 +-
be/src/vec/common/allocator.h | 2 +-
be/src/vec/common/custom_allocator.h | 74 +
be/src/vec/common/hash_table/phmap_fwd_decl.h | 5 +-
be/src/vec/core/block.cpp | 22 +-
be/src/vec/core/column_with_type_and_name.cpp | 8 +-
be/src/vec/data_types/data_type.cpp | 1 -
.../data_types/serde/data_type_decimal_serde.cpp | 44 +-
.../vec/data_types/serde/data_type_decimal_serde.h | 4 +
.../data_types/serde/data_type_number_serde.cpp | 54 +-
.../vec/data_types/serde/data_type_number_serde.h | 4 +
be/src/vec/data_types/serde/data_type_serde.cpp | 30 +
be/src/vec/data_types/serde/data_type_serde.h | 29 +
.../data_types/serde/data_type_string_serde.cpp | 37 +
.../vec/data_types/serde/data_type_string_serde.h | 4 +
be/src/vec/exec/format/csv/csv_reader.cpp | 45 +-
be/src/vec/exec/format/csv/csv_reader.h | 1 +
.../file_reader/new_plain_binary_line_reader.h | 3 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 14 +-
be/src/vec/exec/format/json/new_json_reader.h | 7 +-
be/src/vec/exec/format/orc/orc_file_reader.cpp | 3 +-
be/src/vec/exec/format/orc/orc_file_reader.h | 3 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 6 +-
.../format/parquet/byte_array_dict_decoder.cpp | 2 +-
.../exec/format/parquet/byte_array_dict_decoder.h | 3 +-
be/src/vec/exec/format/parquet/decoder.h | 6 +-
.../format/parquet/fix_length_dict_decoder.hpp | 3 +-
.../vec/exec/format/parquet/parquet_thrift_util.h | 5 +-
.../parquet/vparquet_column_chunk_reader.cpp | 6 +-
.../format/parquet/vparquet_column_chunk_reader.h | 2 +-
.../exec/format/parquet/vparquet_column_reader.cpp | 1 +
.../exec/format/parquet/vparquet_group_reader.cpp | 9 +-
.../exec/format/parquet/vparquet_group_reader.h | 3 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 9 +-
be/src/vec/exec/format/table/iceberg_reader.cpp | 3 +-
be/src/vec/exec/jni_connector.cpp | 5 +-
be/src/vec/exec/jni_connector.h | 4 +-
be/src/vec/exec/scan/file_scanner.cpp | 5 +-
be/src/vec/exec/vjdbc_connector.cpp | 46 +-
be/src/vec/exec/vjdbc_connector.h | 4 +-
be/src/vec/exprs/vcase_expr.cpp | 66 +-
be/src/vec/exprs/vcase_expr.h | 226 ++-
be/src/vec/exprs/vectorized_agg_fn.cpp | 6 +
be/src/vec/exprs/vectorized_agg_fn.h | 2 +
be/src/vec/exprs/vectorized_fn_call.cpp | 2 +-
be/src/vec/exprs/vectorized_fn_call.h | 5 +
be/src/vec/exprs/vexpr.h | 25 +-
be/src/vec/exprs/vexpr_context.cpp | 20 +-
be/src/vec/functions/ai/ai_functions.h | 2 +
.../vec/functions/array/function_array_range.cpp | 6 +-
be/src/vec/functions/array/function_array_remove.h | 226 ++-
.../vec/functions/array/function_arrays_overlap.h | 84 +-
be/src/vec/functions/cast/cast_to_jsonb.h | 34 +-
be/src/vec/functions/cast/cast_to_map.h | 6 +-
be/src/vec/functions/function.h | 56 +-
be/src/vec/functions/function_case.h | 458 ------
.../function_date_or_datetime_computation.cpp | 68 -
.../function_date_or_datetime_computation.h | 179 +--
.../function_date_or_datetime_computation_v2.cpp | 12 -
be/src/vec/functions/function_json.cpp | 61 +-
be/src/vec/functions/function_jsonb.cpp | 416 +++++-
be/src/vec/functions/function_map.cpp | 12 +-
.../functions/function_math_unary_alway_nullable.h | 10 +-
be/src/vec/functions/function_soundex.cpp | 131 ++
be/src/vec/functions/match.cpp | 11 +-
be/src/vec/functions/simple_function_factory.h | 6 +-
be/src/vec/functions/uniform.cpp | 187 +++
be/src/vec/olap/olap_data_convertor.h | 34 +-
be/src/vec/runtime/time_value.h | 4 +-
be/src/vec/sink/vtablet_block_convertor.cpp | 5 +-
be/src/vec/sink/writer/vfile_result_writer.cpp | 4 +-
be/test/cloud/cloud_compaction_test.cpp | 235 ++-
be/test/exprs/bloom_filter_func_test.cpp | 2 +-
be/test/io/cache/block_file_cache_test.cpp | 177 +++
.../io/cache/block_file_cache_test_lru_dump.cpp | 99 ++
be/test/olap/base_compaction_test.cpp | 34 +-
be/test/olap/block_column_predicate_test.cpp | 916 ++++++++++++
be/test/olap/collection_statistics_test.cpp | 37 +
.../inverted_index/query_v2/boolean_query_test.cpp | 316 ++++
.../inverted_index/query_v2/doc_set_test.cpp | 86 ++
.../inverted_index/query_v2/query_test.cpp | 183 ---
.../query_v2/score_combiner_test.cpp | 103 ++
.../query_v2/segment_postings_test.cpp | 165 +++
.../olap/rowset/segment_v2/zone_map_index_test.cpp | 202 +++
.../operator/materialization_shared_state_test.cpp | 66 +-
.../operator/scan_normalize_predicate_test.cpp | 474 ++++++
.../plugin/cloud_plugin_downloader_test.cpp | 241 +++
be/test/runtime/user_function_cache_test.cpp | 159 +-
.../aggregate_functions/agg_bool_union_test.cpp | 74 +
be/test/vec/columns/column_array_test.cpp | 5 -
be/test/vec/columns/column_const_test.cpp | 36 +-
be/test/vec/columns/column_dictionary_test.cpp | 15 +-
be/test/vec/columns/common_column_test.h | 16 -
be/test/vec/common/custom_allocator_test.cpp | 90 ++
be/test/vec/core/column_map_test.cpp | 250 ++++
.../parquet/byte_array_dict_decoder_test.cpp | 11 +-
.../parquet/fix_length_dict_decoder_test.cpp | 11 +-
.../exec/format/parquet/parquet_reader_test.cpp | 1 -
be/test/vec/exec/orc/orc_reader_fill_data_test.cpp | 19 +-
be/test/vec/exec/vjdbc_connector_test.cpp | 272 ++++
be/test/vec/function/cast/cast_to_date_test.cpp | 2 +
.../vec/function/cast/cast_to_datetime_test.cpp | 1 +
.../vec/function/function_arrays_overlap_test.cpp | 13 +-
be/test/vec/function/function_string_test.cpp | 69 +
be/test/vec/function/function_time_test.cpp | 327 +----
cloud/src/common/bvars.cpp | 11 +-
cloud/src/common/bvars.h | 9 +-
cloud/src/common/config.h | 1 +
cloud/src/meta-service/meta_service.cpp | 10 +-
cloud/src/meta-service/meta_service_job.cpp | 121 +-
cloud/src/meta-service/meta_service_resource.cpp | 2 +-
cloud/src/meta-service/meta_service_snapshot.cpp | 142 +-
.../src/meta-service/meta_service_tablet_stats.cpp | 2 +-
cloud/src/meta-service/txn_lazy_committer.cpp | 7 +-
cloud/src/meta-store/keys.cpp | 51 +-
cloud/src/meta-store/keys.h | 7 +
cloud/src/meta-store/mem_txn_kv.cpp | 32 +
cloud/src/meta-store/mem_txn_kv.h | 13 +
cloud/src/meta-store/meta_reader.cpp | 54 +
cloud/src/meta-store/meta_reader.h | 7 +
cloud/src/meta-store/txn_kv.cpp | 51 +
cloud/src/meta-store/txn_kv.h | 24 +
cloud/src/recycler/checker.cpp | 261 +++-
cloud/src/recycler/checker.h | 9 +
cloud/src/recycler/recycler.cpp | 120 +-
cloud/src/recycler/recycler.h | 31 +-
cloud/src/recycler/recycler_operation_log.cpp | 548 +++----
cloud/src/recycler/util.h | 2 +-
cloud/test/CMakeLists.txt | 4 +-
cloud/test/keys_test.cpp | 109 ++
cloud/test/mem_txn_kv_test.cpp | 85 ++
cloud/test/meta_reader_test.cpp | 55 +
cloud/test/meta_service_job_test.cpp | 9 +-
cloud/test/meta_service_snapshot_test.cpp | 272 ++++
cloud/test/recycle_versioned_keys_test.cpp | 1392 ++++++++++++++++++
cloud/test/recycler_operation_log_test.cpp | 259 +++-
cloud/test/recycler_test.cpp | 423 +++++-
cloud/test/txn_kv_test.cpp | 68 +
cloud/test/txn_lazy_commit_test.cpp | 9 +-
docker/runtime/be/Dockerfile | 2 +-
.../be/resource/be_disaggregated_entrypoint.sh | 209 ++-
.../runtime/be/resource/be_disaggregated_probe.sh | 69 +-
docker/runtime/doris-compose/cluster.py | 4 +-
docker/runtime/fe/Dockerfile | 2 +-
.../fe/resource/fe_disaggregated_entrypoint.sh | 136 +-
.../runtime/fe/resource/fe_disaggregated_probe.sh | 57 +-
docker/runtime/ms/Dockerfile | 2 +-
docker/thirdparties/custom_settings.env | 4 +-
.../docker-compose/hive/hadoop-hive.env.tpl | 7 +
.../hive/scripts/data/default/account_fund/run.sh | 3 +-
.../hive/scripts/data/default/hive01/run.sh | 3 +-
.../hive/scripts/data/default/sale_table/run.sh | 3 +-
.../hive/scripts/data/default/string_table/run.sh | 3 +-
.../hive/scripts/data/default/student/run.sh | 3 +-
.../hive/scripts/data/default/test1/run.sh | 3 +-
.../hive/scripts/data/default/test2/run.sh | 3 +-
.../scripts/data/default/test_hive_doris/run.sh | 3 +-
.../scripts/data/multi_catalog/datev2_csv/run.sh | 3 +-
.../scripts/data/multi_catalog/datev2_orc/run.sh | 3 +-
.../data/multi_catalog/datev2_parquet/run.sh | 3 +-
.../multi_catalog/hive_text_complex_type/run.sh | 3 +-
.../multi_catalog/hive_text_complex_type2/run.sh | 3 +-
.../multi_catalog/hive_text_complex_type3/run.sh | 3 +-
.../hive_text_complex_type_delimiter/run.sh | 3 +-
.../hive_text_complex_type_delimiter2/run.sh | 3 +-
.../hive_text_complex_type_delimiter3/run.sh | 3 +-
.../hive_textfile_array_all_types/run.sh | 3 +-
.../hive_textfile_array_delimiter/run.sh | 3 +-
.../multi_catalog/hive_textfile_nestedarray/run.sh | 3 +-
.../data/multi_catalog/hive_upper_case_orc/run.sh | 3 +-
.../multi_catalog/hive_upper_case_parquet/run.sh | 3 +-
.../data/multi_catalog/logs1_parquet/run.sh | 10 -
.../data/multi_catalog/one_partition/run.sh | 3 +-
.../data/multi_catalog/orc_nested_types/run.sh | 3 +-
.../multi_catalog/orc_partitioned_columns/run.sh | 3 +-
.../orc_partitioned_one_column/run.sh | 3 +-
.../multi_catalog/par_fields_in_file_orc/run.sh | 3 +-
.../par_fields_in_file_parquet/run.sh | 3 +-
.../parquet_alter_column_to_bigint/run.sh | 3 +-
.../parquet_alter_column_to_boolean/run.sh | 3 +-
.../parquet_alter_column_to_char/run.sh | 3 +-
.../parquet_alter_column_to_date/run.sh | 3 +-
.../parquet_alter_column_to_decimal/run.sh | 3 +-
.../parquet_alter_column_to_double/run.sh | 3 +-
.../parquet_alter_column_to_float/run.sh | 3 +-
.../parquet_alter_column_to_int/run.sh | 3 +-
.../parquet_alter_column_to_smallint/run.sh | 3 +-
.../parquet_alter_column_to_string/run.sh | 3 +-
.../parquet_alter_column_to_timestamp/run.sh | 3 +-
.../parquet_alter_column_to_tinyint/run.sh | 3 +-
.../parquet_alter_column_to_varchar/run.sh | 3 +-
.../multi_catalog/parquet_lz4_compression/run.sh | 3 +-
.../multi_catalog/parquet_lzo_compression/run.sh | 3 +-
.../data/multi_catalog/parquet_nested_types/run.sh | 3 +-
.../parquet_partitioned_columns/run.sh | 3 +-
.../parquet_partitioned_one_column/run.sh | 3 +-
.../multi_catalog/parquet_predicate_table/run.sh | 3 +-
.../data/multi_catalog/partition_location_1/run.sh | 3 +-
.../data/multi_catalog/partition_location_2/run.sh | 3 +-
.../multi_catalog/partition_manual_remove/run.sh | 3 +-
.../data/multi_catalog/test_chinese_orc/run.sh | 3 +-
.../data/multi_catalog/test_chinese_parquet/run.sh | 3 +-
.../data/multi_catalog/test_chinese_text/run.sh | 3 +-
.../data/multi_catalog/test_complex_types/run.sh | 10 -
.../multi_catalog/test_compress_partitioned/run.sh | 10 -
.../multi_catalog/test_csv_format_error/run.sh | 3 +-
.../test_date_string_partition/run.sh | 3 +-
.../test_hive_same_db_table_name/run.sh | 3 +-
.../test_hive_special_char_partition/run.sh | 3 +-
.../test_mixed_par_locations_orc/run.sh | 3 +-
.../test_mixed_par_locations_parquet/run.sh | 3 +-
.../data/multi_catalog/test_multi_langs_orc/run.sh | 3 +-
.../multi_catalog/test_multi_langs_parquet/run.sh | 3 +-
.../multi_catalog/test_multi_langs_text/run.sh | 3 +-
.../multi_catalog/test_special_orc_formats/run.sh | 3 +-
.../run.sh | 3 +-
.../run.sh | 3 +-
.../run.sh | 3 +-
.../data/multi_catalog/test_wide_table/run.sh | 10 -
.../multi_catalog/text_partitioned_columns/run.sh | 3 +-
.../text_partitioned_one_column/run.sh | 3 +-
.../multi_catalog/timestamp_with_time_zone/run.sh | 3 +-
.../data/multi_catalog/two_partition/run.sh | 3 +-
.../data/multi_catalog/type_change_orc/run.sh | 3 +-
.../data/multi_catalog/type_change_origin/run.sh | 3 +-
.../data/multi_catalog/type_change_parquet/run.sh | 3 +-
.../data/partition_type/bigint_partition/run.sh | 3 +-
.../data/partition_type/char_partition/run.sh | 3 +-
.../data/partition_type/date_partition/run.sh | 3 +-
.../data/partition_type/decimal_partition/run.sh | 3 +-
.../data/partition_type/double_partition/run.sh | 3 +-
.../data/partition_type/float_partition/run.sh | 3 +-
.../data/partition_type/int_partition/run.sh | 3 +-
.../data/partition_type/smallint_partition/run.sh | 3 +-
.../data/partition_type/string_partition/run.sh | 3 +-
.../data/partition_type/tinyint_partition/run.sh | 3 +-
.../data/partition_type/varchar_partition/run.sh | 3 +-
.../hive/scripts/data/regression/crdmm_data/run.sh | 3 +-
.../hive/scripts/data/statistics/statistics/run.sh | 3 +-
.../hive/scripts/data/statistics/stats/run.sh | 3 +-
.../hive/scripts/data/test/hive_test/run.sh | 3 +-
.../scripts/data/tpch_1000_parquet/part/run.sh | 2 +-
.../data/tvf/test_hdfs_tvf_compression/run.sh | 10 -
.../hive/scripts/data/tvf/test_tvf/run.sh | 10 -
.../docker-compose/hive/scripts/hive-metastore.sh | 95 +-
.../hive/scripts/prepare-hive-data.sh | 148 ++
docker/thirdparties/run-thirdparties-docker.sh | 49 +-
.../iceberg-metadata-scanner/pom.xml | 5 +
.../java/org/apache/doris/catalog/ScalarType.java | 3 +-
.../java/org/apache/doris/catalog/VariantType.java | 8 +-
.../java/org/apache/doris/common/GZIPUtils.java | 21 +
.../doris/alter/AlterLightSchChangeHelper.java | 1 +
.../apache/doris/analysis/CopyIntoProperties.java | 3 +-
.../org/apache/doris/analysis/CopyProperties.java | 21 +-
.../java/org/apache/doris/analysis/LoadStmt.java | 647 --------
.../org/apache/doris/analysis/SlotDescriptor.java | 1 +
.../org/apache/doris/backup/BackupHandler.java | 11 +-
.../java/org/apache/doris/backup/BackupJob.java | 16 +-
.../org/apache/doris/backup/BackupJobInfo.java | 8 +
.../java/org/apache/doris/backup/BackupMeta.java | 2 +-
.../java/org/apache/doris/backup/RestoreJob.java | 4 +
.../java/org/apache/doris/backup/Snapshot.java | 62 +-
.../doris/catalog/BuiltinAggregateFunctions.java | 10 +-
.../doris/catalog/BuiltinScalarFunctions.java | 8 +-
.../java/org/apache/doris/catalog/Database.java | 12 +
.../org/apache/doris/catalog/FunctionRegistry.java | 2 +-
.../java/org/apache/doris/catalog/HMSResource.java | 8 +-
.../java/org/apache/doris/catalog/HiveTable.java | 17 +-
.../org/apache/doris/catalog/JdbcResource.java | 25 +-
.../org/apache/doris/catalog/S3StorageVault.java | 3 +-
.../apache/doris/cloud/load/CloudLoadManager.java | 9 -
.../doris/common/plugin/CloudPluginDownloader.java | 164 +++
.../doris/common/profile/SummaryProfile.java | 2 +
.../org/apache/doris/common/util/PrintableMap.java | 27 +-
.../apache/doris/datasource/CatalogProperty.java | 27 +-
.../apache/doris/datasource/InternalCatalog.java | 4 +-
.../AbstractVendedCredentialsProvider.java | 103 ++
.../credentials/CredentialExtractor.java | 41 -
.../datasource/credentials/CredentialUtils.java | 68 +-
.../credentials/VendedCredentialsFactory.java | 72 +
.../doris/datasource/hive/HMSExternalCatalog.java | 52 +-
.../doris/datasource/hive/HMSExternalTable.java | 3 +-
.../doris/datasource/hive/HiveMetaStoreCache.java | 14 +-
.../doris/datasource/hive/HiveMetadataOps.java | 10 +-
.../datasource/hive/ThriftHMSCachedClient.java | 8 +-
.../iceberg/IcebergDLFExternalCatalog.java | 4 +-
.../datasource/iceberg/IcebergExternalCatalog.java | 14 +-
.../iceberg/IcebergS3CredentialExtractor.java | 53 -
.../doris/datasource/iceberg/IcebergUtils.java | 4 +-
.../iceberg/IcebergVendedCredentialsProvider.java | 80 +-
.../datasource/iceberg/source/IcebergScanNode.java | 27 +-
.../lakesoul/source/LakeSoulScanNode.java | 3 +-
.../maxcompute/source/MaxComputeScanNode.java | 17 +-
.../datasource/paimon/PaimonExternalCatalog.java | 20 +-
.../paimon/PaimonOssCredentialExtractor.java | 68 -
.../paimon/PaimonVendedCredentialsProvider.java | 87 +-
.../datasource/paimon/source/PaimonScanNode.java | 30 +-
.../datasource/paimon/source/PaimonSource.java | 3 +-
.../datasource/property/PropertyConverter.java | 356 -----
.../datasource/property/S3ClientBEProperties.java | 109 --
.../property/constants/BaseProperties.java | 6 -
.../property/constants/BosProperties.java | 86 --
.../property/constants/CosProperties.java | 41 -
.../property/constants/GCSProperties.java | 40 -
.../property/constants/GlueProperties.java | 57 -
.../property/constants/HMSProperties.java | 33 -
.../property/constants/MCProperties.java | 1 -
.../property/constants/MinioProperties.java | 40 -
.../property/constants/ObsProperties.java | 46 -
.../property/constants/OssProperties.java | 43 -
.../property/constants/PaimonProperties.java | 56 -
.../property/constants/S3Properties.java | 86 +-
.../constants/TrinoConnectorProperties.java | 22 -
.../fileformat/CsvFileFormatProperties.java | 11 +
.../metastore/AWSGlueMetaStoreBaseProperties.java | 1 +
.../metastore/AbstractPaimonProperties.java | 2 +-
.../property/metastore/HMSBaseProperties.java | 7 +-
.../PaimonAliyunDLFMetaStoreProperties.java | 1 +
.../property/storage/AzureProperties.java | 1 +
.../property/storage/BrokerProperties.java | 18 +-
.../datasource/property/storage/COSProperties.java | 1 +
.../datasource/property/storage/GCSProperties.java | 1 +
.../property/storage/HdfsProperties.java | 1 +
.../property/storage/HdfsPropertiesUtils.java | 80 +-
.../property/storage/MinioProperties.java | 2 +
.../datasource/property/storage/OBSProperties.java | 1 +
.../property/storage/OSSHdfsProperties.java | 1 +
.../datasource/property/storage/OSSProperties.java | 11 +-
.../datasource/property/storage/S3Properties.java | 17 +-
.../property/storage/S3PropertyUtils.java | 13 +
.../TrinoConnectorExternalCatalog.java | 4 +-
.../doris/job/extensions/insert/InsertJob.java | 10 +-
.../org/apache/doris/load/GroupCommitManager.java | 20 +-
.../org/apache/doris/load/loadv2/BulkLoadJob.java | 32 -
.../java/org/apache/doris/load/loadv2/LoadJob.java | 69 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 53 -
.../apache/doris/load/loadv2/MysqlLoadManager.java | 48 +-
.../doris/load/routineload/RoutineLoadJob.java | 37 +-
.../doris/mtmv/MTMVPartitionExprDateTrunc.java | 4 +-
...MTMVRelatedPartitionDescSyncLimitGenerator.java | 27 +-
.../org/apache/doris/nereids/cost/CostModel.java | 7 +-
.../glue/translator/PhysicalPlanTranslator.java | 53 +-
.../nereids/jobs/cascades/CostAndEnforcerJob.java | 3 +-
.../doris/nereids/jobs/executor/Rewriter.java | 17 +-
.../doris/nereids/load/NereidsBrokerLoadTask.java | 5 +
.../doris/nereids/load/NereidsDataDescription.java | 2 +
.../doris/nereids/load/NereidsLoadTaskInfo.java | 2 +
.../nereids/load/NereidsRoutineLoadTaskInfo.java | 17 +-
.../doris/nereids/load/NereidsStreamLoadTask.java | 14 +
.../java/org/apache/doris/nereids/memo/Memo.java | 2 -
.../doris/nereids/parser/LogicalPlanBuilder.java | 9 +-
.../post/materialize/LazyMaterializeTopN.java | 49 +-
.../post/materialize/LazySlotPruning.java | 22 +-
.../post/materialize/MaterializeProbeVisitor.java | 32 +
.../post/materialize/MaterializeSource.java | 6 +-
.../properties/ChildrenPropertiesRegulator.java | 199 ++-
.../nereids/properties/RequestPropertyDeriver.java | 91 +-
.../properties/RequirePropertiesSupplier.java | 65 -
.../org/apache/doris/nereids/rules/RuleSet.java | 6 +
.../org/apache/doris/nereids/rules/RuleType.java | 21 +-
.../nereids/rules/analysis/BindExpression.java | 12 +-
.../doris/nereids/rules/analysis/BindRelation.java | 2 +-
.../mv/PreMaterializedViewRewriter.java | 4 +-
.../rules/expression/ExpressionRuleType.java | 1 +
.../expression/rules/FoldConstantRuleOnBE.java | 61 +-
.../expression/rules/JsonFunctionRewrite.java | 26 +-
.../rules/implementation/AggregateStrategies.java | 1540 --------------------
.../LogicalTVFRelationToPhysicalTVFRelation.java | 2 +-
.../rules/implementation/SplitAggBaseRule.java | 202 +++
.../rules/implementation/SplitAggMultiPhase.java | 374 +++++
.../SplitAggMultiPhaseWithoutGbyKey.java | 232 +++
.../implementation/SplitAggWithoutDistinct.java | 171 +++
.../rules/rewrite/AddProjectForUniqueFunction.java | 299 ++++
.../nereids/rules/rewrite/AdjustNullable.java | 20 +
.../rules/rewrite/DistinctAggStrategySelector.java | 177 +++
.../rules/rewrite/DistinctAggregateRewriter.java | 216 +++
.../rewrite/EliminateGroupByKeyByUniform.java | 7 +-
.../doris/nereids/rules/rewrite/InitJoinOrder.java | 7 +-
.../rewrite/MergeOneRowRelationIntoUnion.java | 11 +-
.../rewrite/MultiDistinctFunctionStrategy.java | 44 +
.../rules/rewrite/OperativeColumnDerive.java | 12 +
.../PushDownVirtualColumnsIntoOlapScan.java | 70 +-
...stinct.java => SplitMultiDistinctStrategy.java} | 154 +-
.../rules/rewrite/VariantSubPathPruning.java | 34 +
.../doris/nereids/stats/FilterEstimation.java | 14 +-
.../doris/nereids/stats/StatsCalculator.java | 32 +-
.../doris/nereids/trees/expressions/Between.java | 17 +-
.../expressions/functions/ComputeSignature.java | 2 +-
.../ComputeSignatureForDateArithmetic.java | 16 +-
.../functions/ComputeSignatureHelper.java | 22 +-
.../expressions/functions/agg/AggregateParam.java | 14 +-
.../expressions/functions/agg/ApproxTopK.java | 99 --
.../expressions/functions/agg/ApproxTopSum.java | 99 --
.../ArrayReverseSort.java => agg/BoolAnd.java} | 54 +-
.../ArrayReverseSort.java => agg/BoolOr.java} | 56 +-
.../ArrayReverseSort.java => agg/BoolXor.java} | 50 +-
.../trees/expressions/functions/agg/MapAgg.java | 4 +-
.../trees/expressions/functions/agg/MapAggV2.java | 4 +-
.../functions/executable/DateTimeAcquire.java | 6 +-
.../functions/executable/DateTimeArithmetic.java | 219 +--
.../functions/executable/NumericArithmetic.java | 43 +
.../functions/executable/StringArithmetic.java | 55 +
.../functions/scalar/AesCryptoFunction.java | 5 +
.../trees/expressions/functions/scalar/Array.java | 12 +
.../expressions/functions/scalar/ArrayRemove.java | 20 +-
.../functions/scalar/ArrayReverseSort.java | 8 +-
.../expressions/functions/scalar/ArraySort.java | 8 +-
.../expressions/functions/scalar/ArraySortBy.java | 11 +
.../expressions/functions/scalar/ArraySum.java | 8 +-
.../expressions/functions/scalar/ArrayUnion.java | 12 +
.../expressions/functions/scalar/ArrayZip.java | 2 +-
.../functions/scalar/ArraysOverlap.java | 12 +
.../expressions/functions/scalar/CountEqual.java | 12 +
.../expressions/functions/scalar/CreateMap.java | 5 +
.../functions/scalar/CreateNamedStruct.java | 9 +-
.../expressions/functions/scalar/CreateStruct.java | 14 +
.../expressions/functions/scalar/CurrentDate.java | 4 +-
.../expressions/functions/scalar/DaysAdd.java | 29 +-
.../expressions/functions/scalar/DaysSub.java | 29 +-
.../expressions/functions/scalar/HoursAdd.java | 17 +-
.../expressions/functions/scalar/HoursSub.java | 17 +-
.../scalar/{JsonbValid.java => JsonRemove.java} | 49 +-
.../expressions/functions/scalar/JsonbValid.java | 5 +-
.../trees/expressions/functions/scalar/Mask.java | 30 +-
.../functions/scalar/MicroSecondsAdd.java | 12 +-
.../functions/scalar/MicroSecondsSub.java | 12 +-
.../functions/scalar/MilliSecondsAdd.java | 12 +-
.../functions/scalar/MilliSecondsSub.java | 12 +-
.../expressions/functions/scalar/MinutesAdd.java | 19 +-
.../expressions/functions/scalar/MinutesSub.java | 19 +-
.../expressions/functions/scalar/MonthsAdd.java | 28 +-
.../expressions/functions/scalar/MonthsSub.java | 28 +-
.../expressions/functions/scalar/QuartersAdd.java | 5 +-
.../expressions/functions/scalar/QuartersSub.java | 5 +-
.../expressions/functions/scalar/SecondsAdd.java | 19 +-
.../expressions/functions/scalar/SecondsSub.java | 19 +-
.../scalar/{JsonbValid.java => Soundex.java} | 29 +-
.../functions/scalar/StructElement.java | 14 +-
.../expressions/functions/scalar/Uniform.java | 117 ++
.../expressions/functions/scalar/WeeksAdd.java | 28 +-
.../expressions/functions/scalar/WeeksSub.java | 28 +-
.../expressions/functions/scalar/YearsAdd.java | 28 +-
.../expressions/functions/scalar/YearsSub.java | 28 +-
.../trees/expressions/literal/ArrayLiteral.java | 2 +-
.../trees/expressions/literal/DateLiteral.java | 2 +
.../trees/expressions/literal/DateTimeLiteral.java | 2 +
.../expressions/literal/DateTimeV2Literal.java | 8 +-
.../trees/expressions/literal/Interval.java | 2 +-
.../nereids/trees/expressions/literal/Literal.java | 23 +-
.../trees/expressions/literal/MapLiteral.java | 69 +-
.../expressions/literal/StringLikeLiteral.java | 2 +-
.../trees/expressions/literal/StructLiteral.java | 2 +-
.../visitor/AggregateFunctionVisitor.java | 25 +-
.../expressions/visitor/ScalarFunctionVisitor.java | 15 +
.../doris/nereids/trees/plans/AbstractPlan.java | 1 +
.../apache/doris/nereids/trees/plans/AggMode.java | 13 +-
.../org/apache/doris/nereids/trees/plans/Plan.java | 5 +
.../nereids/trees/plans/algebra/Aggregate.java | 27 +
.../plans/commands/AlterRoutineLoadCommand.java | 8 +
.../plans/commands/CreateFunctionCommand.java | 57 +-
.../plans/commands/CreateStorageVaultCommand.java | 10 +-
.../trees/plans/commands/ExportCommand.java | 7 +-
.../nereids/trees/plans/commands/LoadCommand.java | 3 +-
.../trees/plans/commands/RestoreCommand.java | 14 +-
.../plans/commands/ShowTransactionCommand.java | 5 +-
.../trees/plans/commands/info/BulkStorageDesc.java | 102 --
.../trees/plans/commands/info/CopyIntoInfo.java | 8 +-
.../plans/commands/info/CreateRoutineLoadInfo.java | 1 +
.../trees/plans/logical/LogicalSetOperation.java | 8 +-
.../trees/plans/logical/LogicalTVFRelation.java | 29 +-
.../plans/physical/PhysicalHashAggregate.java | 79 +-
.../plans/physical/PhysicalLazyMaterialize.java | 31 +-
.../physical/PhysicalLazyMaterializeTVFScan.java | 108 ++
.../trees/plans/physical/PhysicalOlapScan.java | 19 +-
.../trees/plans/physical/PhysicalTVFRelation.java | 27 +-
.../trees/plans/physical/PhysicalWindow.java | 15 +-
.../plans/visitor/ExpressionLineageReplacer.java | 4 +-
.../nereids/trees/plans/visitor/PlanVisitor.java | 5 +
.../apache/doris/nereids/types/StructField.java | 2 +
.../org/apache/doris/nereids/types/StructType.java | 24 +-
.../apache/doris/nereids/types/VariantType.java | 10 +-
.../doris/nereids/types/coercion/AnyDataType.java | 6 +
.../types/coercion/FollowToAnyDataType.java | 5 +
.../apache/doris/nereids/util/AggregateUtils.java | 137 ++
.../apache/doris/nereids/util/ExpressionUtils.java | 14 +
.../doris/nereids/util/TypeCoercionUtils.java | 57 +-
.../java/org/apache/doris/persist/EditLog.java | 11 +-
.../org/apache/doris/planner/IcebergTableSink.java | 26 +-
.../java/org/apache/doris/qe/ConnectContext.java | 31 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 83 +-
.../java/org/apache/doris/qe/FEOpExecutor.java | 5 +
.../java/org/apache/doris/qe/SessionVariable.java | 93 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 34 +-
.../apache/doris/service/FrontendServiceImpl.java | 57 +-
.../sessions/FlightSqlConnectContext.java | 8 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 8 +-
.../org/apache/doris/statistics/ColStatsData.java | 5 +-
.../apache/doris/statistics/ColumnStatistic.java | 24 +-
.../apache/doris/statistics/HMSAnalysisTask.java | 2 +
.../apache/doris/statistics/OlapAnalysisTask.java | 2 +
.../doris/statistics/StatisticsRepository.java | 15 +-
.../doris/statistics/util/StatisticsUtil.java | 6 +-
.../hadoop/hive/metastore/HiveMetaStoreClient.java | 6 +-
.../org/apache/doris/catalog/HiveTableTest.java | 6 +-
.../org/apache/doris/common/CacheFactoryTest.java | 32 +
.../common/plugin/CloudPluginDownloaderTest.java | 173 +++
.../apache/doris/common/util/LocationPathTest.java | 20 +-
.../AbstractVendedCredentialsProviderTest.java | 297 ++++
.../credentials/CredentialUtilsTest.java | 246 ++++
.../credentials/VendedCredentialsFactoryTest.java | 213 +++
.../IcebergVendedCredentialsProviderTest.java | 361 ++---
.../PaimonVendedCredentialsProviderTest.java | 456 +++---
.../paimon/source/PaimonScanNodeTest.java | 12 +-
.../datasource/property/PropertyConverterTest.java | 653 ---------
.../property/storage/HdfsPropertiesTest.java | 6 +
.../property/storage/HdfsPropertiesUtilsTest.java | 70 +
.../external/iceberg/IcebergHadoopCatalogTest.java | 4 +-
.../org/apache/doris/fs/obj/S3FileSystemTest.java | 4 +-
.../doris/load/loadv2/BrokerLoadJobTest.java | 123 --
.../org/apache/doris/load/loadv2/LoadJobTest.java | 12 +-
...RelatedPartitionDescSyncLimitGeneratorTest.java | 4 +-
.../properties/ChildOutputPropertyDeriverTest.java | 3 -
.../properties/RequestPropertyDeriverTest.java | 3 -
.../nereids/rules/expression/FoldConstantTest.java | 243 +--
.../expression/SimplifyArithmeticRuleTest.java | 1 -
.../rules/expression/SimplifyRangeTest.java | 12 +-
.../rewrite/AddProjectForUniqueFunctionTest.java | 143 ++
.../rules/rewrite/AggregateStrategiesTest.java | 37 +-
.../rewrite/DistinctAggregateRewriterTest.java | 164 +++
.../PushDownVirtualColumnsIntoOlapScanTest.java | 357 ++++-
.../rules/rewrite/SplitMultiDistinctTest.java | 14 +-
.../doris/nereids/stats/FilterEstimationTest.java | 11 +-
.../doris/nereids/stats/StatsCalculatorTest.java | 52 +-
.../apache/doris/nereids/stats/StatsTestUtil.java | 2 +-
.../doris/nereids/trees/expressions/UdfTest.java | 23 +-
.../functions/ComputeSignatureHelperTest.java | 67 +-
.../trees/expressions/literal/DateLiteralTest.java | 3 +
.../expressions/literal/DateTimeLiteralTest.java | 5 +
.../expressions/literal/IntegerLiteralTest.java | 22 +-
.../expressions/literal/LargeIntLiteralTest.java | 50 +
.../doris/nereids/trees/plans/PlanEqualsTest.java | 8 +-
.../org/apache/doris/nereids/util/PlanChecker.java | 80 +-
.../doris/nereids/util/TypeCoercionUtilsTest.java | 42 +
.../apache/doris/persist/LoadJobV2PersistTest.java | 4 +-
.../doris/planner/QueryCacheNormalizerTest.java | 141 +-
.../apache/doris/qe/ConnectProcessorRetryTest.java | 181 +++
.../doris/statistics/OlapAnalysisTaskTest.java | 8 +-
.../doris/statistics/util/StatisticsUtilTest.java | 22 +-
gensrc/proto/segment_v2.proto | 6 +
gensrc/thrift/FrontendService.thrift | 2 +
gensrc/thrift/PlanNodes.thrift | 1 +
.../test_compaction_with_empty_rowset.out | Bin 0 -> 349 bytes
.../data/correctness/test_time_function.out | Bin 447 -> 502 bytes
.../data/datatype_p0/datetimev2/test_exprs.out | Bin 2316 -> 2496 bytes
.../float/test_float_special_values.out | Bin 11870 -> 66663 bytes
.../one_level_nestedtypes_with_s3data.out | Bin 3604422 -> 3598328
bytes
.../nested_types/query/sql/nested_with_join.out | Bin 1020 -> 1024 bytes
.../test_nestedtypes_csv_insert_into_with_s3.out | Bin 436103 -> 412376
bytes
.../test_nestedtypes_json_insert_into_with_s3.out | Bin 733470 -> 705865
bytes
.../data/doc/sql-manual/StructNullsafe.out | Bin 0 -> 379 bytes
.../sql-function/test_array_function.out | Bin 0 -> 7755 bytes
.../data/empty_relation/eliminate_empty.out | Bin 3681 -> 3685 bytes
.../outfile/csv/test_outfile_csv_complex_type.out | Bin 8605 -> 8561 bytes
.../outfile/csv/test_outfile_csv_map_type.out | Bin 14057 -> 13059 bytes
.../csv/test_outfile_csv_one_nested_type.out | Bin 9348 -> 9244 bytes
.../orc/test_outfile_orc_one_nested_type.out | Bin 9323 -> 9219 bytes
.../parquet/test_outfile_parquet_complex_type.out | Bin 8574 -> 8522 bytes
.../parquet/test_outfile_parquet_map_type.out | Bin 13740 -> 12302 bytes
.../test_outfile_parquet_one_nested_type.out | Bin 9323 -> 9219 bytes
.../export_p0/test_outfile_orc_complex_type.out | Bin 8549 -> 8505 bytes
.../data/export_p0/test_outfile_orc_map_type.out | Bin 14304 -> 13292 bytes
.../orc/test_hive_read_orc_complex_type.out | Bin 20515 -> 20471 bytes
.../external_table_p0/hive/hive_config_test.out | Bin 399 -> 464 bytes
.../hive/test_hive_topn_lazy_mat.out | Bin 19465 -> 79711 bytes
.../paimon/test_paimon_catalog.out | Bin 791619 -> 788923
bytes
.../tvf/test_tvf_topn_lazy_mat.out | Bin 0 -> 6877 bytes
.../external_table_p2/hudi/test_hudi_snapshot.out | Bin 696105 -> 696473
bytes
.../iceberg/test_iceberg_equal_delete.out | Bin 0 -> 217 bytes
.../test_external_catalog_maxcompute.out | Bin 4745 -> 6428 bytes
.../data/function_p0/test_array_agg.out | Bin 344 -> 311 bytes
.../data/function_p0/test_math_function.out | Bin 0 -> 449 bytes
.../analyzer/test_custom_analyzer.out | Bin 1217 -> 1277 bytes
.../test_cloud_build_index_basic.out | Bin 0 -> 551 bytes
.../test_cloud_build_index_update.out | Bin 0 -> 605 bytes
.../test_array_contains_with_inverted_index.out | Bin 44492 -> 56354 bytes
.../inverted_index_p0/test_index_approx_top_k.out | Bin 9037 -> 0 bytes
.../test_index_approx_top_sum.out | Bin 9145 -> 0 bytes
.../data/json_p0/test_json_load_and_function.out | Bin 261057 -> 261045
bytes
.../data/jsonb_p0/test_jsonb_load_and_function.out | Bin 189130 -> 189123
bytes
.../data/load_p0/broker_load/test_array_load.out | Bin 7679 -> 11903 bytes
...st_broker_load.out => test_broker_load_seq.out} | Bin
.../test_bulk_load_empty_field_as_null.out | Bin 0 -> 196 bytes
.../test_routine_load_empty_field_as_null.out | Bin 0 -> 305 bytes
.../load_p0/stream_load/empty_field_as_null.csv | 2 +
.../test_stream_load_empty_field_as_null.out | Bin 0 -> 305 bytes
.../load_p0/tvf/test_tvf_empty_field_as_null.out | Bin 0 -> 199 bytes
.../cast_function/test_cast_map_function.out | Bin 784 -> 745 bytes
.../nereids_function_p0/scalar_function/Array.out | Bin 770399 -> 771727
bytes
.../nereids_function_p0/scalar_function/Array1.out | Bin 33267319 -> 34343181
bytes
.../data/nereids_function_p0/scalar_function/J.out | Bin 160542 -> 160535
bytes
.../nereids_function_p0/scalar_function/Map.out | Bin 28228 -> 28192 bytes
.../data/nereids_p0/datatype/test_map.out | Bin 746 -> 1322 bytes
.../fold_constant/fe_constant_cast_to_date.out | Bin 2083 -> 2109 bytes
.../fold_constant/fe_constant_cast_to_datetime.out | Bin 2927 -> 2966 bytes
.../data/nereids_p0/hint/fix_leading.out | Bin 3718 -> 3687 bytes
.../data/nereids_p0/hint/multi_leading.out | Bin 9157 -> 9063 bytes
.../string_functions/test_string_function.out | Bin 3233 -> 4097 bytes
.../adjust_nullable/test_adjust_nullable.out | Bin 489 -> 1121 bytes
.../adjust_nullable/test_agg_nullable.out | Bin 297 -> 274 bytes
.../adjust_nullable/test_subquery_nullable.out | Bin 6391 -> 6393 bytes
.../agg_skew_rewrite/agg_skew_rewrite.out | Bin 7894 -> 8320 bytes
.../nereids_rules_p0/agg_strategy/agg_strategy.out | Bin 0 -> 21517 bytes
.../agg_strategy/distinct_agg_rewriter.out | Bin 0 -> 1213 bytes
.../distinct_agg_strategy_selector.out | Bin 0 -> 4760 bytes
.../agg_strategy/physical_agg_regulator.out | Bin 0 -> 2895 bytes
.../agg_strategy/test_variables.out | Bin 0 -> 6275 bytes
.../constant_propagation/constant_propagation.out | Bin 21556 -> 21658 bytes
.../distinct_split/disitinct_split.out | Bin 9553 -> 13518 bytes
.../nereids_rules_p0/eager_aggregate/basic.out | Bin 3106 -> 3111 bytes
.../eager_aggregate/basic_one_side.out | Bin 3126 -> 3131 bytes
.../push_down_count_through_join.out | Bin 29586 -> 29470 bytes
.../push_down_count_through_join_one_side.out | Bin 34877 -> 33756 bytes
.../eager_aggregate/push_down_max_through_join.out | Bin 17588 -> 16989 bytes
.../eager_aggregate/push_down_min_through_join.out | Bin 17602 -> 17003 bytes
.../eager_aggregate/push_down_sum_through_join.out | Bin 16199 -> 16141 bytes
.../push_down_sum_through_join_one_side.out | Bin 18663 -> 18035 bytes
.../eliminate_aggregate_casewhen.out | Bin 3909 -> 3917 bytes
.../eliminate_aggregate_constant.out | Bin 15813 -> 15861 bytes
.../eliminate_not_null/eliminate_not_null.out | Bin 1446 -> 1447 bytes
.../eliminate_outer_join/eliminate_outer_join.out | Bin 9803 -> 9805 bytes
.../filter_push_down/push_filter_through.out | Bin 9968 -> 9740 bytes
.../infer_set_operator_distinct.out | Bin 39049 -> 39095 bytes
.../limit_push_down/order_push_down.out | Bin 21201 -> 21207 bytes
.../max_min_filter_push_down.out | Bin 5992 -> 5969 bytes
.../merge_aggregate/merge_aggregate.out | Bin 7948 -> 7977 bytes
.../agg_optimize_when_uniform.out | Bin 1814 -> 1815 bytes
.../mv/date_trunc/mv_with_date_trunc.out | Bin 4435 -> 4420 bytes
.../data/nereids_rules_p0/pkfk/eliminate_inner.out | Bin 6965 -> 6967 bytes
.../predicate_infer/infer_predicate.out | Bin 12821 -> 12827 bytes
.../pull_up_join_from_union.out | Bin 5760 -> 5762 bytes
.../push_count_into_union_all.out | Bin 6803 -> 6806 bytes
.../push_down_distinct_through_join.out | Bin 821 -> 824 bytes
.../push_down_limit_distinct_through_join.out | Bin 442 -> 444 bytes
.../push_down_top_n_distinct_through_join.out | Bin 1047 -> 1049 bytes
.../push_down_top_n_distinct_through_union.out | Bin 5838 -> 5856 bytes
.../simplify_window_expression.out | Bin 3908 -> 3909 bytes
.../data/nereids_rules_p0/sumRewrite.out | Bin 17085 -> 16815 bytes
.../data/nereids_rules_p0/test_load/test1.out | Bin 0 -> 274 bytes
.../data/nereids_rules_p0/test_load/test2.out | Bin 0 -> 274 bytes
.../transposeJoin/transposeSemiJoinAgg.out | Bin 2884 -> 2890 bytes
.../add_project_for_unique_function.out | Bin 0 -> 13215 bytes
.../unique_function/agg_with_unique_function.out | Bin 13615 -> 13561 bytes
...own_filter_through_agg_with_unique_function.out | Bin 342 -> 343 bytes
.../data/nereids_syntax_p0/agg_4_phase.out | Bin 243 -> 245 bytes
.../nereids_syntax_p0/aggregate_strategies.out | Bin 2354 -> 2313 bytes
.../nereids_syntax_p0/mv/newMv/single_slot.out | Bin 186 -> 176 bytes
.../data/point_query_p0/test_point_query.out | Bin 9949 -> 9954 bytes
regression-test/data/query_p0/cast/test_cast.out | Bin 1214 -> 1412 bytes
.../test_aggregate_all_functions2.out | Bin 8671 -> 9232 bytes
.../array_functions/test_array_functions.out | Bin 28349 -> 29126 bytes
.../test_array_functions_by_literal.out | Bin 29801 -> 30224 bytes
.../array_functions/test_array_with_scale_type.out | Bin 7941 -> 8143 bytes
.../cast_function/test_cast_map_function.out | Bin 784 -> 745 bytes
.../conditional_functions/test_json_parse.out | Bin 768 -> 1066 bytes
.../json_functions/test_json_function.out | Bin 2071 -> 2996 bytes
.../string_functions/test_str_to_map.out | Bin 17405 -> 8142 bytes
.../adjust_virtual_slot_nullable.out | Bin 0 -> 626 bytes
.../fix_array_type_and_lambda_func.out | Bin 0 -> 232 bytes
.../data/shape_check/clickbench/query10.out | Bin 415 -> 467 bytes
.../data/shape_check/clickbench/query11.out | Bin 472 -> 508 bytes
.../data/shape_check/clickbench/query12.out | Bin 472 -> 508 bytes
.../data/shape_check/clickbench/query14.out | Bin 468 -> 504 bytes
.../data/shape_check/clickbench/query16.out | Bin 328 -> 329 bytes
.../data/shape_check/clickbench/query17.out | Bin 328 -> 329 bytes
.../data/shape_check/clickbench/query18.out | Bin 328 -> 329 bytes
.../data/shape_check/clickbench/query19.out | Bin 328 -> 329 bytes
.../data/shape_check/clickbench/query23.out | Bin 531 -> 567 bytes
.../data/shape_check/clickbench/query5.out | Bin 356 -> 282 bytes
.../data/shape_check/clickbench/query9.out | Bin 414 -> 448 bytes
.../tpcds_sf100/noStatsRfPrune/query11.out | Bin 3423 -> 3391 bytes
.../tpcds_sf100/noStatsRfPrune/query12.out | Bin 1459 -> 1374 bytes
.../tpcds_sf100/noStatsRfPrune/query20.out | Bin 1472 -> 1387 bytes
.../tpcds_sf100/noStatsRfPrune/query28.out | Bin 4361 -> 5501 bytes
.../tpcds_sf100/noStatsRfPrune/query34.out | Bin 2376 -> 2380 bytes
.../tpcds_sf100/noStatsRfPrune/query38.out | Bin 3269 -> 3281 bytes
.../tpcds_sf100/noStatsRfPrune/query4.out | Bin 5313 -> 5217 bytes
.../tpcds_sf100/noStatsRfPrune/query46.out | Bin 2606 -> 2783 bytes
.../tpcds_sf100/noStatsRfPrune/query47.out | Bin 3450 -> 3357 bytes
.../tpcds_sf100/noStatsRfPrune/query51.out | Bin 2641 -> 2463 bytes
.../tpcds_sf100/noStatsRfPrune/query53.out | Bin 2880 -> 2783 bytes
.../tpcds_sf100/noStatsRfPrune/query54.out | Bin 5479 -> 5481 bytes
.../tpcds_sf100/noStatsRfPrune/query57.out | Bin 3260 -> 3167 bytes
.../tpcds_sf100/noStatsRfPrune/query63.out | Bin 2874 -> 2777 bytes
.../tpcds_sf100/noStatsRfPrune/query64.out | Bin 9232 -> 9224 bytes
.../tpcds_sf100/noStatsRfPrune/query65.out | Bin 2916 -> 2774 bytes
.../tpcds_sf100/noStatsRfPrune/query68.out | Bin 3016 -> 3201 bytes
.../tpcds_sf100/noStatsRfPrune/query73.out | Bin 2249 -> 2253 bytes
.../tpcds_sf100/noStatsRfPrune/query74.out | Bin 3355 -> 3323 bytes
.../tpcds_sf100/noStatsRfPrune/query79.out | Bin 2061 -> 2065 bytes
.../tpcds_sf100/noStatsRfPrune/query87.out | Bin 2955 -> 2967 bytes
.../tpcds_sf100/noStatsRfPrune/query89.out | Bin 2448 -> 2349 bytes
.../tpcds_sf100/noStatsRfPrune/query98.out | Bin 1477 -> 1392 bytes
.../tpcds_sf100/no_stats_shape/query11.out | Bin 3497 -> 3465 bytes
.../tpcds_sf100/no_stats_shape/query12.out | Bin 1459 -> 1374 bytes
.../tpcds_sf100/no_stats_shape/query20.out | Bin 1472 -> 1387 bytes
.../tpcds_sf100/no_stats_shape/query28.out | Bin 4361 -> 5501 bytes
.../tpcds_sf100/no_stats_shape/query34.out | Bin 2426 -> 2430 bytes
.../tpcds_sf100/no_stats_shape/query38.out | Bin 3429 -> 3441 bytes
.../tpcds_sf100/no_stats_shape/query4.out | Bin 5411 -> 5315 bytes
.../tpcds_sf100/no_stats_shape/query46.out | Bin 2766 -> 2943 bytes
.../tpcds_sf100/no_stats_shape/query47.out | Bin 3536 -> 3443 bytes
.../tpcds_sf100/no_stats_shape/query51.out | Bin 2641 -> 2463 bytes
.../tpcds_sf100/no_stats_shape/query53.out | Bin 2924 -> 2827 bytes
.../tpcds_sf100/no_stats_shape/query54.out | Bin 5748 -> 5750 bytes
.../tpcds_sf100/no_stats_shape/query57.out | Bin 3359 -> 3266 bytes
.../tpcds_sf100/no_stats_shape/query63.out | Bin 2918 -> 2821 bytes
.../tpcds_sf100/no_stats_shape/query64.out | Bin 10105 -> 10097 bytes
.../tpcds_sf100/no_stats_shape/query65.out | Bin 3002 -> 2860 bytes
.../tpcds_sf100/no_stats_shape/query68.out | Bin 3176 -> 3361 bytes
.../tpcds_sf100/no_stats_shape/query73.out | Bin 2299 -> 2303 bytes
.../tpcds_sf100/no_stats_shape/query74.out | Bin 3429 -> 3397 bytes
.../tpcds_sf100/no_stats_shape/query79.out | Bin 2111 -> 2115 bytes
.../tpcds_sf100/no_stats_shape/query87.out | Bin 3115 -> 3127 bytes
.../tpcds_sf100/no_stats_shape/query89.out | Bin 2492 -> 2393 bytes
.../tpcds_sf100/no_stats_shape/query98.out | Bin 1477 -> 1392 bytes
.../shape_check/tpcds_sf100/rf_prune/query28.out | Bin 4361 -> 5501 bytes
.../shape_check/tpcds_sf100/rf_prune/query34.out | Bin 2435 -> 2441 bytes
.../shape_check/tpcds_sf100/rf_prune/query38.out | Bin 3265 -> 3281 bytes
.../shape_check/tpcds_sf100/rf_prune/query4.out | Bin 5167 -> 5215 bytes
.../shape_check/tpcds_sf100/rf_prune/query46.out | Bin 2606 -> 2607 bytes
.../shape_check/tpcds_sf100/rf_prune/query47.out | Bin 3266 -> 3173 bytes
.../shape_check/tpcds_sf100/rf_prune/query51.out | Bin 2641 -> 2463 bytes
.../shape_check/tpcds_sf100/rf_prune/query57.out | Bin 3131 -> 3038 bytes
.../shape_check/tpcds_sf100/rf_prune/query65.out | Bin 2912 -> 2916 bytes
.../shape_check/tpcds_sf100/rf_prune/query68.out | Bin 3208 -> 3209 bytes
.../shape_check/tpcds_sf100/rf_prune/query75.out | Bin 5611 -> 5321 bytes
.../shape_check/tpcds_sf100/rf_prune/query79.out | Bin 2059 -> 2065 bytes
.../shape_check/tpcds_sf100/rf_prune/query8.out | Bin 10064 -> 10064 bytes
.../shape_check/tpcds_sf100/rf_prune/query87.out | Bin 3037 -> 3053 bytes
.../shape_check/tpcds_sf100/rf_prune/query89.out | Bin 2448 -> 2349 bytes
.../data/shape_check/tpcds_sf100/shape/query28.out | Bin 4361 -> 5501 bytes
.../data/shape_check/tpcds_sf100/shape/query34.out | Bin 2435 -> 2441 bytes
.../data/shape_check/tpcds_sf100/shape/query38.out | Bin 3425 -> 3441 bytes
.../data/shape_check/tpcds_sf100/shape/query4.out | Bin 5265 -> 5313 bytes
.../data/shape_check/tpcds_sf100/shape/query46.out | Bin 2766 -> 2767 bytes
.../data/shape_check/tpcds_sf100/shape/query47.out | Bin 3624 -> 3531 bytes
.../data/shape_check/tpcds_sf100/shape/query51.out | Bin 2641 -> 2463 bytes
.../data/shape_check/tpcds_sf100/shape/query57.out | Bin 3421 -> 3328 bytes
.../data/shape_check/tpcds_sf100/shape/query65.out | Bin 2998 -> 3002 bytes
.../data/shape_check/tpcds_sf100/shape/query68.out | Bin 3208 -> 3209 bytes
.../data/shape_check/tpcds_sf100/shape/query75.out | Bin 5611 -> 5321 bytes
.../data/shape_check/tpcds_sf100/shape/query79.out | Bin 2109 -> 2115 bytes
.../data/shape_check/tpcds_sf100/shape/query8.out | Bin 10108 -> 10108 bytes
.../data/shape_check/tpcds_sf100/shape/query87.out | Bin 3197 -> 3213 bytes
.../data/shape_check/tpcds_sf100/shape/query89.out | Bin 2492 -> 2393 bytes
.../tpcds_sf1000/bs_downgrade_shape/query68.out | Bin 3197 -> 3198 bytes
.../tpcds_sf1000/bs_downgrade_shape/query8.out | Bin 10108 -> 10108 bytes
.../data/shape_check/tpcds_sf1000/hint/query28.out | Bin 4351 -> 5491 bytes
.../data/shape_check/tpcds_sf1000/hint/query38.out | Bin 3341 -> 3355 bytes
.../data/shape_check/tpcds_sf1000/hint/query46.out | Bin 2868 -> 2869 bytes
.../data/shape_check/tpcds_sf1000/hint/query47.out | Bin 3732 -> 3639 bytes
.../data/shape_check/tpcds_sf1000/hint/query51.out | Bin 2759 -> 2581 bytes
.../data/shape_check/tpcds_sf1000/hint/query57.out | Bin 3537 -> 3444 bytes
.../data/shape_check/tpcds_sf1000/hint/query65.out | Bin 3236 -> 3240 bytes
.../data/shape_check/tpcds_sf1000/hint/query68.out | Bin 3355 -> 3356 bytes
.../data/shape_check/tpcds_sf1000/hint/query75.out | Bin 5617 -> 5327 bytes
.../data/shape_check/tpcds_sf1000/hint/query79.out | Bin 2232 -> 2236 bytes
.../data/shape_check/tpcds_sf1000/hint/query8.out | Bin 10311 -> 10311 bytes
.../data/shape_check/tpcds_sf1000/hint/query87.out | Bin 3113 -> 3127 bytes
.../data/shape_check/tpcds_sf1000/hint/query89.out | Bin 2558 -> 2459 bytes
.../shape_check/tpcds_sf1000/shape/query28.out | Bin 4351 -> 5491 bytes
.../shape_check/tpcds_sf1000/shape/query38.out | Bin 3341 -> 3355 bytes
.../data/shape_check/tpcds_sf1000/shape/query4.out | Bin 5265 -> 5313 bytes
.../shape_check/tpcds_sf1000/shape/query46.out | Bin 2752 -> 2753 bytes
.../shape_check/tpcds_sf1000/shape/query47.out | Bin 3624 -> 3531 bytes
.../shape_check/tpcds_sf1000/shape/query51.out | Bin 2641 -> 2463 bytes
.../shape_check/tpcds_sf1000/shape/query57.out | Bin 3421 -> 3328 bytes
.../shape_check/tpcds_sf1000/shape/query65.out | Bin 2998 -> 3002 bytes
.../shape_check/tpcds_sf1000/shape/query68.out | Bin 3197 -> 3198 bytes
.../shape_check/tpcds_sf1000/shape/query75.out | Bin 5617 -> 5327 bytes
.../shape_check/tpcds_sf1000/shape/query79.out | Bin 2112 -> 2116 bytes
.../data/shape_check/tpcds_sf1000/shape/query8.out | Bin 10108 -> 10108 bytes
.../shape_check/tpcds_sf1000/shape/query87.out | Bin 3113 -> 3127 bytes
.../shape_check/tpcds_sf1000/shape/query89.out | Bin 2478 -> 2379 bytes
.../shape_check/tpcds_sf10t_orc/shape/query11.out | Bin 3781 -> 3749 bytes
.../shape_check/tpcds_sf10t_orc/shape/query12.out | Bin 1466 -> 1381 bytes
.../shape_check/tpcds_sf10t_orc/shape/query20.out | Bin 1481 -> 1396 bytes
.../shape_check/tpcds_sf10t_orc/shape/query23.out | Bin 5271 -> 5273 bytes
.../shape_check/tpcds_sf10t_orc/shape/query28.out | Bin 4357 -> 5497 bytes
.../shape_check/tpcds_sf10t_orc/shape/query34.out | Bin 2422 -> 2428 bytes
.../shape_check/tpcds_sf10t_orc/shape/query39.out | Bin 1850 -> 1983 bytes
.../shape_check/tpcds_sf10t_orc/shape/query4.out | Bin 5963 -> 5863 bytes
.../shape_check/tpcds_sf10t_orc/shape/query46.out | Bin 2761 -> 2762 bytes
.../shape_check/tpcds_sf10t_orc/shape/query47.out | Bin 3536 -> 3443 bytes
.../shape_check/tpcds_sf10t_orc/shape/query51.out | Bin 2641 -> 2463 bytes
.../shape_check/tpcds_sf10t_orc/shape/query53.out | Bin 2920 -> 2823 bytes
.../shape_check/tpcds_sf10t_orc/shape/query54.out | Bin 6072 -> 6073 bytes
.../shape_check/tpcds_sf10t_orc/shape/query57.out | Bin 3359 -> 3266 bytes
.../shape_check/tpcds_sf10t_orc/shape/query63.out | Bin 2914 -> 2817 bytes
.../shape_check/tpcds_sf10t_orc/shape/query65.out | Bin 3002 -> 2860 bytes
.../shape_check/tpcds_sf10t_orc/shape/query68.out | Bin 3166 -> 3167 bytes
.../shape_check/tpcds_sf10t_orc/shape/query73.out | Bin 2294 -> 2300 bytes
.../shape_check/tpcds_sf10t_orc/shape/query74.out | Bin 3769 -> 3737 bytes
.../shape_check/tpcds_sf10t_orc/shape/query79.out | Bin 2109 -> 2115 bytes
.../shape_check/tpcds_sf10t_orc/shape/query89.out | Bin 2484 -> 2385 bytes
.../shape_check/tpcds_sf10t_orc/shape/query98.out | Bin 1474 -> 1389 bytes
.../data/shape_check/tpch_sf1000/hint/q11.out | Bin 2073 -> 2074 bytes
.../data/shape_check/tpch_sf1000/hint/q13.out | Bin 897 -> 898 bytes
.../data/shape_check/tpch_sf1000/hint/q3.out | Bin 1069 -> 1070 bytes
.../tpch_sf1000/nostats_rf_prune/q11.out | Bin 2167 -> 2168 bytes
.../tpch_sf1000/nostats_rf_prune/q13.out | Bin 825 -> 826 bytes
.../tpch_sf1000/nostats_rf_prune/q16.out | Bin 1148 -> 1200 bytes
.../tpch_sf1000/nostats_rf_prune/q18.out | Bin 1258 -> 1260 bytes
.../tpch_sf1000/nostats_rf_prune/q3.out | Bin 1090 -> 1091 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q10.out | Bin 1329 -> 1330 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q11.out | Bin 2175 -> 2176 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q13.out | Bin 825 -> 826 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q16.out | Bin 1142 -> 1194 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q18.out | Bin 1258 -> 1260 bytes
.../data/shape_check/tpch_sf1000/rf_prune/q3.out | Bin 1088 -> 1089 bytes
.../runtime_filter/test_pushdown_setop.out | Bin 1976 -> 1978 bytes
.../data/shape_check/tpch_sf1000/shape/q10.out | Bin 1374 -> 1375 bytes
.../data/shape_check/tpch_sf1000/shape/q11.out | Bin 2175 -> 2176 bytes
.../data/shape_check/tpch_sf1000/shape/q13.out | Bin 877 -> 878 bytes
.../data/shape_check/tpch_sf1000/shape/q16.out | Bin 1142 -> 1194 bytes
.../data/shape_check/tpch_sf1000/shape/q18.out | Bin 1299 -> 1301 bytes
.../data/shape_check/tpch_sf1000/shape/q3.out | Bin 1088 -> 1089 bytes
.../shape_check/tpch_sf1000/shape_no_stats/q11.out | Bin 2167 -> 2168 bytes
.../shape_check/tpch_sf1000/shape_no_stats/q13.out | Bin 877 -> 878 bytes
.../shape_check/tpch_sf1000/shape_no_stats/q16.out | Bin 1148 -> 1200 bytes
.../shape_check/tpch_sf1000/shape_no_stats/q18.out | Bin 1299 -> 1301 bytes
.../shape_check/tpch_sf1000/shape_no_stats/q3.out | Bin 1090 -> 1091 bytes
.../data/variant_p0/test_array_function.out | Bin 374 -> 355 bytes
.../test_array_contains_with_inverted_index.out | Bin 46962 -> 56604 bytes
.../doris/regression/action/HttpCliAction.groovy | 7 +-
.../org/apache/doris/regression/suite/Suite.groovy | 68 +-
.../doris/regression/util/OutputUtils.groovy | 46 +
.../pipeline/cloud_p0/conf/be_custom.conf | 2 +
.../cloud_p0/conf/regression-conf-custom.groovy | 1 +
.../pipeline/cloud_p1/conf/be_custom.conf | 1 +
regression-test/pipeline/common/doris-utils.sh | 2 +-
regression-test/pipeline/p0/conf/be.conf | 1 +
.../pipeline/p0/conf/regression-conf.groovy | 1 +
regression-test/pipeline/p1/conf/be.conf | 2 +
regression-test/plugins/plugin_index_change.groovy | 92 +-
.../suites/ai_p0/test_ai_functions.groovy | 12 +-
.../auth_call/test_assistant_command_auth.groovy | 4 +-
.../suites/auth_call/test_ddl_catalog_auth.groovy | 12 +-
.../test_master_slave_consistency_auth.groovy | 2 +-
.../compaction/test_compaction_score_action.groovy | 1 +
.../test_compaction_uniq_keys_row_store.groovy | 2 +-
.../test_compaction_with_empty_rowset.groovy | 101 ++
.../test_config_prune_delete_sign.groovy | 12 +-
.../test_filecache_with_base_compaction.groovy | 8 +-
...ilecache_with_base_compaction_thresthold.groovy | 740 ++++++++++
.../suites/correctness/test_time_function.groovy | 7 +
.../correctness_p0/test_mask_function.groovy | 23 +
.../datetimev1/test_datetimev1_calc.groovy | 74 -
.../datatype_p0/datetimev2/test_exprs.groovy | 70 +-
.../datatype_p0/datev1/test_datev1_calc.groovy | 80 -
.../float/test_float_special_values.groovy | 476 ++++++
.../one_level_nestedtypes_with_s3data.groovy | 4 +-
.../suites/doc/sql-manual/StructNullsafe.groovy | 53 +
.../sql-function/test_array_function.groovy | 534 +++++++
.../suites/export/test_array_export.groovy | 7 +-
.../parquet/test_outfile_parquet_map_type.groovy | 19 +-
.../external_table_p0/hive/hive_config_test.groovy | 10 +-
.../hive/test_hive_topn_lazy_mat.groovy | 18 +
.../tvf/test_hdfs_parquet_group6.groovy | 1 -
.../tvf/test_tvf_topn_lazy_mat.groovy | 213 +++
.../iceberg_rest_s3_storage_vended_test.groovy | 329 +++++
.../iceberg/test_iceberg_equal_delete.groovy | 50 +
.../test_external_catalog_maxcompute.groovy | 9 +
..._writer_v2_back_pressure_fault_injection.groovy | 29 +-
.../suites/function_p0/test_array_agg.groovy | 2 -
.../suites/function_p0/test_math_function.groovy | 39 +
.../test_group_commit_replay_wal.groovy | 16 +
.../analyzer/test_custom_analyzer.groovy | 23 +
.../test_cloud_build_index_basic.groovy | 138 ++
.../test_cloud_build_index_error.groovy | 163 +++
.../test_cloud_build_index_update.groovy | 156 ++
.../index_change/test_add_drop_index.groovy | 78 +-
.../test_add_drop_index_ignore_case_column.groovy | 22 +-
.../test_add_drop_index_on_table_with_mv.groovy | 23 +-
.../test_add_drop_index_repeatly.groovy | 19 +-
.../test_add_drop_index_with_data.groovy | 46 +-
.../test_add_drop_index_with_delete_data.groovy | 26 +-
.../index_change/test_index_change_1.groovy | 34 +-
.../index_change/test_index_change_2.groovy | 34 +-
.../index_change/test_index_change_3.groovy | 63 +-
.../index_change/test_index_change_4.groovy | 34 +-
.../index_change/test_index_change_5.groovy | 31 +-
.../index_change/test_index_change_6.groovy | 45 +-
.../test_index_change_on_new_column.groovy | 29 +-
.../test_index_change_on_renamed_column.groovy | 23 +-
..._index_change_with_cumulative_compaction.groovy | 32 +-
.../test_index_change_with_full_compaction.groovy | 35 +-
.../index_change/test_pk_uk_index_change.groovy | 28 +-
.../inverted_index_p0/test_create_index_2.groovy | 28 +-
.../test_index_approx_top_k.groovy | 153 --
.../test_index_approx_top_sum.groovy | 153 --
.../test_pk_no_need_read_data.groovy | 13 +-
.../load_p0/broker_load/test_array_load.groovy | 22 +-
.../broker_load/test_broker_load_seq.groovy | 11 +-
.../broker_load/test_broker_load_with_merge.groovy | 4 +-
.../test_broker_load_with_partition.groovy | 27 +-
.../test_broker_load_with_properties.groovy | 7 +-
.../broker_load/test_broker_load_with_where.groovy | 15 +-
.../test_broker_load_without_filepath.groovy | 18 +-
.../test_bulk_load_empty_field_as_null.groovy | 82 ++
.../load_p0/http_stream/test_http_stream.groovy | 19 +
.../ingestion_load/test_ingestion_load.groovy | 18 +-
.../test_ingestion_load_alter_column.groovy | 22 +-
.../test_ingestion_load_alter_partition.groovy | 38 +-
.../test_ingestion_load_drop_table.groovy | 18 +-
.../test_ingestion_load_multi_table.groovy | 18 +-
.../test_ingestion_load_with_inverted_index.groovy | 14 +-
.../test_ingestion_load_with_partition.groovy | 18 +-
.../test_routine_load_empty_field_as_null.groovy | 173 +++
.../test_csv_with_none_utf8_data.groovy | 2 +-
.../load_p0/stream_load/test_json_load.groovy | 2 +-
.../test_stream_load_empty_field_as_null.groovy | 63 +
.../test_stream_load_err_log_limit.groovy | 4 +-
.../stream_load/test_stream_load_error_url.groovy | 4 +-
.../tvf/test_tvf_empty_field_as_null.groovy | 52 +
.../metrics_p0/test_delete_bitmap_metrics.groovy | 31 +
.../suites/mv_p0/k1ap2spa/k1ap2spa.groovy | 1 -
.../testCountDistinctToBitmap.groovy | 1 +
.../nereids_function_p0/agg_function/agg.groovy | 960 ++++++------
.../nereids_function_p0/scalar_function/U.groovy | 47 +
.../suites/nereids_p0/aggregate/aggregate.groovy | 1 -
.../nereids_p0/datatype/test_compatible.groovy | 24 +-
.../suites/nereids_p0/datatype/test_map.groovy | 14 +-
.../suites/nereids_p0/delta_row/delta_row.groovy | 4 +-
.../fold_constant/fe_constant_cast_to_date.groovy | 2 +
.../fe_constant_cast_to_datetime.groovy | 2 +
.../fold_constant/fold_constant_by_be.groovy | 23 +
.../fold_constant_numeric_arithmatic.groovy | 1 +
.../fold_constant_string_arithmatic.groovy | 43 +
.../initial_join_order/initial_join_order.groovy | 2 +-
.../suites/nereids_p0/join/test_join_14.groovy | 24 +-
.../test_encryption_function.groovy | 12 +
.../string_functions/test_string_function.groovy | 53 +
.../nereids_p0/stats/partitionRowCount.groovy | 2 +-
.../suites/nereids_p0/stats/virtual_column.groovy | 40 +
.../adjust_nullable/test_adjust_nullable.groovy | 1 +
.../agg_strategy/agg_strategy.groovy | 142 ++
.../agg_strategy/distinct_agg_rewriter.groovy} | 34 +-
.../distinct_agg_strategy_selector.groovy | 43 +
.../nereids_rules_p0/agg_strategy/load.groovy | 126 ++
.../agg_strategy/physical_agg_regulator.groovy | 50 +
.../agg_strategy/test_variables.groovy | 130 ++
.../distinct_split/disitinct_split.groovy | 80 +-
...aggr_distinct_through_join_one_side_cust.groovy | 2 +-
.../push_down_count_through_join.groovy | 1 -
.../push_down_count_through_join_one_side.groovy | 1 -
.../push_down_max_through_join.groovy | 1 -
.../push_down_min_through_join.groovy | 1 -
.../push_down_sum_through_join.groovy | 1 -
.../push_down_sum_through_join_one_side.groovy | 1 -
.../merge_aggregate/merge_aggregate.groovy | 1 +
.../agg_optimize_when_uniform.groovy | 1 +
.../agg_with_roll_up/aggregate_with_roll_up.groovy | 1 +
.../aggregate_without_roll_up.groovy | 1 +
.../mv/date_trunc/mv_with_date_trunc.groovy | 42 +-
.../mv/dimension/dimension_1.groovy | 1 +
.../mv/dimension/dimension_2_3.groovy | 1 +
.../mv/dimension/dimension_self_conn.groovy | 1 +
.../mv/grouping_sets/grouping_sets.groovy | 1 +
.../mv/pre_rewrite/strategy/dp_hyper.groovy | 1 +
.../mv/pre_rewrite/strategy/strategy.groovy | 1 +
.../mv/same_name/sync_async_same_name.groovy | 1 -
.../nereids_rules_p0/mv/tpch/mv_tpch_test.groovy | 1 +
.../mv/with_auth/with_select_table_auth.groovy | 1 +
.../nereids_rules_p0/skew_join/skew_join.groovy | 2 +-
.../add_project_for_unique_function.groovy | 137 ++
.../nereids_rules_p0/unique_function/load.groovy | 13 +
.../nereids_syntax_p0/adjust_nullable.groovy | 2 +-
.../suites/nereids_syntax_p0/agg_4_phase.groovy | 20 +-
.../nereids_syntax_p0/aggregate_strategies.groovy | 29 -
.../suites/nereids_syntax_p0/analyze_agg.groovy | 6 +-
.../distribute/colocate_agg_join.groovy | 1 -
.../nereids_syntax_p0/distribute/shuffle.groovy | 2 +-
.../suites/nereids_syntax_p0/mask_function.groovy | 2 +-
.../nereids_syntax_p0/mv/newMv/single_slot.groovy | 9 +-
.../nereids_syntax_p2/aggregate_strategies.groovy | 25 -
.../nereids_tpch_p0/tpch/push_topn_to_agg.groovy | 2 +-
.../test_cloud_plugin_auto_download.groovy | 121 ++
.../suites/point_query_p0/test_point_query.groovy | 2 +-
.../suites/query_p0/cast/test_cast.groovy | 20 +
.../suites/query_p0/join/test_join.groovy | 24 +-
.../operative_slots/operative_slots.groovy | 32 +-
.../test_aggregate_all_functions2.groovy | 21 +
.../conditional_functions/test_json_parse.groovy | 2 +
.../json_functions/test_json_function.groovy | 124 +-
.../suites/query_p0/test_multiple_stmt.groovy | 38 +-
.../adjust_virtual_slot_nullable.groovy | 63 +
.../fix_array_type_and_lambda_func.groovy | 57 +
.../rollup_p0/test_create_mv_and_mtmv.groovy | 1 +
.../suites/shape_check/clickbench/query5.groovy | 1 +
.../suites/show_p0/test_show_data_warehouse.groovy | 10 +-
.../suites/show_p0/test_show_txn_error_msg.groovy | 38 +
.../suites/statistics/test_hot_value.groovy | 59 +-
.../ssb_unique_load_zstd/ddl/customer_create.sql | 3 +-
.../ssb_unique_load_zstd/ddl/date_create.sql | 3 +-
.../ssb_unique_load_zstd/ddl/lineorder_create.sql | 3 +-
.../ssb_unique_load_zstd/ddl/part_create.sql | 3 +-
.../ssb_unique_load_zstd/ddl/supplier_create.sql | 3 +-
.../ddl/supplier_sequence_create.sql | 3 +-
.../suites/variant_p0/test_array_function.groovy | 2 -
.../suites/variant_p0/with_index/load.groovy | 31 +-
tools/coffeebench-tools/README.md | 42 +
tools/coffeebench-tools/bin/create-tables.sh | 100 ++
tools/coffeebench-tools/bin/load-data.sh | 159 ++
tools/coffeebench-tools/bin/run-queries.sh | 180 +++
.../coffeebench-tools/conf/doris-cluster.conf | 22 +-
tools/coffeebench-tools/ddl/create-tables.sql | 144 ++
tools/coffeebench-tools/queries/q1.sql | 18 +
tools/coffeebench-tools/queries/q10.sql | 25 +
tools/coffeebench-tools/queries/q11.sql | 26 +
tools/coffeebench-tools/queries/q12.sql | 30 +
tools/coffeebench-tools/queries/q13.sql | 30 +
tools/coffeebench-tools/queries/q14.sql | 29 +
tools/coffeebench-tools/queries/q15.sql | 61 +
tools/coffeebench-tools/queries/q16.sql | 27 +
tools/coffeebench-tools/queries/q17.sql | 66 +
tools/coffeebench-tools/queries/q2.sql | 17 +
tools/coffeebench-tools/queries/q3.sql | 31 +
tools/coffeebench-tools/queries/q4.sql | 20 +
tools/coffeebench-tools/queries/q5.sql | 23 +
tools/coffeebench-tools/queries/q6.sql | 19 +
tools/coffeebench-tools/queries/q7.sql | 30 +
tools/coffeebench-tools/queries/q8.sql | 25 +
tools/coffeebench-tools/queries/q9.sql | 23 +
1196 files changed, 29171 insertions(+), 14346 deletions(-)
create mode 100644 be/src/common/atomic_shared_ptr.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query.cpp
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/boolean_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query/boolean_weight.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/buffered_union_scorer.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/buffered_union_scorer.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/conjunction_op.cpp
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/disjunction_op.cpp
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/disjunction_op.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/doc_set.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/factory.inline.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/intersection_scorer.cpp
rename be/src/olap/rowset/segment_v2/inverted_index/query_v2/{conjunction_op.h
=> intersection_scorer.h} (52%)
delete mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query_v2/node.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/phrase_query.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/roaring_query.cpp
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/roaring_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/score_combiner.h
rename be/src/olap/rowset/segment_v2/inverted_index/query_v2/{term_query.h =>
scorer.h} (53%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/segment_postings.h
delete mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/term_query.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/term_query/term_query.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/term_query/term_scorer.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/query_v2/term_query/term_weight.h
rename be/src/olap/rowset/segment_v2/inverted_index/query_v2/{factory.h =>
weight.h} (63%)
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/tiny_set.h
create mode 100644 be/src/pipeline/exec/materialization_opertor.cpp
create mode 100644 be/src/pipeline/exec/materialization_opertor.h
delete mode 100644 be/src/pipeline/exec/materialization_sink_operator.cpp
delete mode 100644 be/src/pipeline/exec/materialization_sink_operator.h
delete mode 100644 be/src/pipeline/exec/materialization_source_operator.cpp
delete mode 100644 be/src/pipeline/exec/materialization_source_operator.h
create mode 100644 be/src/runtime/plugin/cloud_plugin_downloader.cpp
create mode 100644 be/src/runtime/plugin/cloud_plugin_downloader.h
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top.h
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_k.cpp
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_k.h
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_sum.cpp
delete mode 100644
be/src/vec/aggregate_functions/aggregate_function_approx_top_sum.h
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_bool_union.cpp
create mode 100644
be/src/vec/aggregate_functions/aggregate_function_bool_union.h
delete mode 100644 be/src/vec/functions/function_case.h
create mode 100644 be/src/vec/functions/function_soundex.cpp
create mode 100644 be/src/vec/functions/uniform.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/boolean_query_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/doc_set_test.cpp
delete mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/query_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/score_combiner_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/query_v2/segment_postings_test.cpp
create mode 100644 be/test/runtime/plugin/cloud_plugin_downloader_test.cpp
create mode 100644 be/test/vec/aggregate_functions/agg_bool_union_test.cpp
create mode 100644 be/test/vec/common/custom_allocator_test.cpp
create mode 100644 be/test/vec/exec/vjdbc_connector_test.cpp
create mode 100644 cloud/test/meta_service_snapshot_test.cpp
create mode 100644 cloud/test/recycle_versioned_keys_test.cpp
create mode 100644
docker/thirdparties/docker-compose/hive/scripts/prepare-hive-data.sh
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/analysis/LoadStmt.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/common/plugin/CloudPluginDownloader.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/credentials/AbstractVendedCredentialsProvider.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/credentials/CredentialExtractor.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/credentials/VendedCredentialsFactory.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/iceberg/IcebergS3CredentialExtractor.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonOssCredentialExtractor.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/PropertyConverter.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/S3ClientBEProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/BosProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/CosProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/GCSProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/GlueProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/HMSProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/MinioProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/ObsProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/OssProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/PaimonProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/property/constants/TrinoConnectorProperties.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/properties/RequirePropertiesSupplier.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/SplitAggBaseRule.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/SplitAggMultiPhase.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/SplitAggMultiPhaseWithoutGbyKey.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/SplitAggWithoutDistinct.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/AddProjectForUniqueFunction.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/DistinctAggStrategySelector.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/DistinctAggregateRewriter.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/MultiDistinctFunctionStrategy.java
rename
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/{SplitMultiDistinct.java
=> SplitMultiDistinctStrategy.java} (64%)
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/ApproxTopK.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/agg/ApproxTopSum.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/ArrayReverseSort.java
=> agg/BoolAnd.java} (59%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/ArrayReverseSort.java
=> agg/BoolOr.java} (61%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/ArrayReverseSort.java
=> agg/BoolXor.java} (61%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbValid.java
=> JsonRemove.java} (52%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/{JsonbValid.java
=> Soundex.java} (68%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/Uniform.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/BulkStorageDesc.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/PhysicalLazyMaterializeTVFScan.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/util/AggregateUtils.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/plugin/CloudPluginDownloaderTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/credentials/AbstractVendedCredentialsProviderTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/credentials/CredentialUtilsTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/credentials/VendedCredentialsFactoryTest.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/datasource/property/PropertyConverterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/AddProjectForUniqueFunctionTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/DistinctAggregateRewriterTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/literal/LargeIntLiteralTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/qe/ConnectProcessorRetryTest.java
create mode 100644
regression-test/data/compaction/test_compaction_with_empty_rowset.out
create mode 100644 regression-test/data/doc/sql-manual/StructNullsafe.out
create mode 100644
regression-test/data/doc/sql-manual/sql-function/test_array_function.out
create mode 100644
regression-test/data/external_table_p0/tvf/test_tvf_topn_lazy_mat.out
create mode 100644
regression-test/data/external_table_p2/iceberg/test_iceberg_equal_delete.out
create mode 100644 regression-test/data/function_p0/test_math_function.out
create mode 100644
regression-test/data/inverted_index_p0/cloud_build_index/test_cloud_build_index_basic.out
create mode 100644
regression-test/data/inverted_index_p0/cloud_build_index/test_cloud_build_index_update.out
delete mode 100644
regression-test/data/inverted_index_p0/test_index_approx_top_k.out
delete mode 100644
regression-test/data/inverted_index_p0/test_index_approx_top_sum.out
copy regression-test/data/load_p0/broker_load/{test_broker_load.out =>
test_broker_load_seq.out} (100%)
create mode 100644
regression-test/data/load_p0/broker_load/test_bulk_load_empty_field_as_null.out
create mode 100644
regression-test/data/load_p0/routine_load/test_routine_load_empty_field_as_null.out
create mode 100644
regression-test/data/load_p0/stream_load/empty_field_as_null.csv
create mode 100644
regression-test/data/load_p0/stream_load/test_stream_load_empty_field_as_null.out
create mode 100644
regression-test/data/load_p0/tvf/test_tvf_empty_field_as_null.out
create mode 100644
regression-test/data/nereids_rules_p0/agg_strategy/agg_strategy.out
create mode 100644
regression-test/data/nereids_rules_p0/agg_strategy/distinct_agg_rewriter.out
create mode 100644
regression-test/data/nereids_rules_p0/agg_strategy/distinct_agg_strategy_selector.out
create mode 100644
regression-test/data/nereids_rules_p0/agg_strategy/physical_agg_regulator.out
create mode 100644
regression-test/data/nereids_rules_p0/agg_strategy/test_variables.out
create mode 100644 regression-test/data/nereids_rules_p0/test_load/test1.out
create mode 100644 regression-test/data/nereids_rules_p0/test_load/test2.out
create mode 100644
regression-test/data/nereids_rules_p0/unique_function/add_project_for_unique_function.out
create mode 100644
regression-test/data/query_p0/virtual_slot_ref/adjust_virtual_slot_nullable.out
create mode 100644
regression-test/data/query_p0/virtual_slot_ref/fix_array_type_and_lambda_func.out
create mode 100644
regression-test/suites/compaction/test_compaction_with_empty_rowset.groovy
create mode 100644
regression-test/suites/compaction/test_filecache_with_base_compaction_thresthold.groovy
delete mode 100644
regression-test/suites/datatype_p0/datetimev1/test_datetimev1_calc.groovy
delete mode 100644
regression-test/suites/datatype_p0/datev1/test_datev1_calc.groovy
create mode 100644 regression-test/suites/doc/sql-manual/StructNullsafe.groovy
create mode 100644
regression-test/suites/doc/sql-manual/sql-function/test_array_function.groovy
create mode 100644
regression-test/suites/external_table_p0/tvf/test_tvf_topn_lazy_mat.groovy
create mode 100644
regression-test/suites/external_table_p2/iceberg/iceberg_rest_s3_storage_vended_test.groovy
create mode 100644
regression-test/suites/external_table_p2/iceberg/test_iceberg_equal_delete.groovy
create mode 100644 regression-test/suites/function_p0/test_math_function.groovy
create mode 100644
regression-test/suites/inverted_index_p0/cloud_build_index/test_cloud_build_index_basic.groovy
create mode 100644
regression-test/suites/inverted_index_p0/cloud_build_index/test_cloud_build_index_error.groovy
create mode 100644
regression-test/suites/inverted_index_p0/cloud_build_index/test_cloud_build_index_update.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/test_index_approx_top_k.groovy
delete mode 100644
regression-test/suites/inverted_index_p0/test_index_approx_top_sum.groovy
create mode 100644
regression-test/suites/load_p0/broker_load/test_bulk_load_empty_field_as_null.groovy
create mode 100644
regression-test/suites/load_p0/routine_load/test_routine_load_empty_field_as_null.groovy
create mode 100644
regression-test/suites/load_p0/stream_load/test_stream_load_empty_field_as_null.groovy
create mode 100644
regression-test/suites/load_p0/tvf/test_tvf_empty_field_as_null.groovy
rename be/src/vec/functions/function_case.cpp =>
regression-test/suites/nereids_p0/datatype/test_compatible.groovy (67%)
create mode 100644
regression-test/suites/nereids_p0/stats/virtual_column.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/agg_strategy/agg_strategy.groovy
copy regression-test/suites/{nereids_syntax_p0/distribute/shuffle.groovy =>
nereids_rules_p0/agg_strategy/distinct_agg_rewriter.groovy} (54%)
create mode 100644
regression-test/suites/nereids_rules_p0/agg_strategy/distinct_agg_strategy_selector.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/agg_strategy/load.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/agg_strategy/physical_agg_regulator.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/agg_strategy/test_variables.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/unique_function/add_project_for_unique_function.groovy
create mode 100644
regression-test/suites/plugin_p1/test_cloud_plugin_auto_download.groovy
rename be/src/olap/rowset/segment_v2/inverted_index/query_v2/factory.cpp =>
regression-test/suites/query_p0/test_multiple_stmt.groovy (53%)
create mode 100644
regression-test/suites/query_p0/virtual_slot_ref/adjust_virtual_slot_nullable.groovy
create mode 100644
regression-test/suites/query_p0/virtual_slot_ref/fix_array_type_and_lambda_func.groovy
create mode 100644
regression-test/suites/show_p0/test_show_txn_error_msg.groovy
create mode 100644 tools/coffeebench-tools/README.md
create mode 100755 tools/coffeebench-tools/bin/create-tables.sh
create mode 100755 tools/coffeebench-tools/bin/load-data.sh
create mode 100755 tools/coffeebench-tools/bin/run-queries.sh
copy docker/thirdparties/custom_settings.env =>
tools/coffeebench-tools/conf/doris-cluster.conf (70%)
create mode 100644 tools/coffeebench-tools/ddl/create-tables.sql
create mode 100644 tools/coffeebench-tools/queries/q1.sql
create mode 100644 tools/coffeebench-tools/queries/q10.sql
create mode 100644 tools/coffeebench-tools/queries/q11.sql
create mode 100644 tools/coffeebench-tools/queries/q12.sql
create mode 100644 tools/coffeebench-tools/queries/q13.sql
create mode 100644 tools/coffeebench-tools/queries/q14.sql
create mode 100644 tools/coffeebench-tools/queries/q15.sql
create mode 100644 tools/coffeebench-tools/queries/q16.sql
create mode 100644 tools/coffeebench-tools/queries/q17.sql
create mode 100644 tools/coffeebench-tools/queries/q2.sql
create mode 100644 tools/coffeebench-tools/queries/q3.sql
create mode 100644 tools/coffeebench-tools/queries/q4.sql
create mode 100644 tools/coffeebench-tools/queries/q5.sql
create mode 100644 tools/coffeebench-tools/queries/q6.sql
create mode 100644 tools/coffeebench-tools/queries/q7.sql
create mode 100644 tools/coffeebench-tools/queries/q8.sql
create mode 100644 tools/coffeebench-tools/queries/q9.sql
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]