This is an automated email from the ASF dual-hosted git repository.
panxiaolei pushed a change to branch refactor_rf
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 9fb4944c72e [refactor](runtime filter) Refine consumer (#48198)
omit a0097924026 [refactor](runtime filter) Simplify producer / slots
(#48145)
omit e00d67aa0d8 update
omit e6b2773e7a4 update
omit f2beb8257b0 update
omit 36fe3f26b28 update
omit 82773984831 refactor of RuntimeFilterSlots
add 3a3c4b9b9dc [fix](function) Fix the issue where using convert_tz and
ifnull together causes an error. (#48029)
add c9344ef3438 [fix](mv) Fix sync mv add default select limit wrongly
(#47717)
add cba955c4acc [fix](Nereids) change numeric arithmatic function boundary
behavior to match with be execution behavior (#47966)
add 8ede4c62903 [fix](nereids) fix push down non-foldable filter through
project (#47989)
add b88c850b8df [opt](nereids) forbid topn-two-phase reading for some
patterns (#47975)
add 2a76ef9f7f3 [fix](nereids) fix prune partitions wrong (#48034)
add e555cbd88b9 [opt](nereids) optimize not found function error message
(#47919)
add 33375c4ca5c [Fix](merge-on-write) should calculate delete bitmaps
between segments before skip if tablet is in `NOT_READY` state in flush phase
(#48056)
add e11f0d44ce4 [enhance](nereids)rewrite aggregate to limit when all
group by key is uniform and not null, and there is no aggregate functions
(#46223)
add 3688fdb85be [Feature](nereids) support encrypt sql for audit log
(#47595)
add a043679ec8f [fix](nereids)check if correlated filter exists before
converting apply to join (#47985)
add 718e85c45dc [Fix]Add expcetion handling for reopen connection (#48072)
add 21bed4d01ea [fix](serde)fix arrow serde with no value into column
(#48053)
add 95a4968e216 [upgrade](paimon) upgrade paimon 1.0.1 (#47768)
add cb5b057d704 [fix](iceberg) Don't prematurely erase DeleteRows in
reading iceberg table with position delete (#47977)
add 075ca702de7 [fix](test) fix unstable test (#48058)
add a3824d657bc [fix](table stat) Fix show data size of single replica
result incorrect (#39751)
add e4af923f62a [refactor](sort merger) Refine sort merger (#48075)
add 1f17551fb04 [improve](function) support collect_list with nested types
param (#47965)
add d422116d650 [BugFix](PreparedStatement) fix stmtId overflow (#47950)
add f26b7e38ac6 [InvertedIndex](Variant) supoort inverted index for array
type in variant (#47688)
add 48ea35b464f [opt](paimon)Use the API instead of reading from the meta
table (#47544)
add 6d067966e6d [regression](storage vault) test minio as storage vault
using Virtual Host Style (#47992)
add cb975c4d99e [Opt](case) add a case for cloud mow (#47868)
add c1f9a1b0737 [Opt](partial update) Add some cases for partial update
(#47900)
add 4d26d8a01b9 [case](mtmv)The impact of validating the base table and
materialized view alter on transparent rewriting (#47310)
add b472df9030a [fix](case)fix range_datetime_part_up_rewrite case failed
(#47302)
add 1e875e4ecb9 [fix](test) fix regression test eliminate_order_by_key and
eliminate_group_by_key_by_uniform (#48119)
add e17a96bf59c [fix](exchange) Fix mismatch columns in merging-exchange
node (#48107)
add 0a6f7f6b7dd [test](case) Some array-related cases are missing array
sort. (#48133)
add c24bd4b9fac [Refactor](join) Remove the unless join code in nereids
(#48135)
add f7b60b26d81 [Fix](case) regression test database should not be dropped
manually (#48098)
add 0349841069d [refactor](scheduler) Simplify TaskScheduler (#48118)
add 3b18d72b871 [opt](Inverted index)Avoid repeated calculations of suffix
paths (#48137)
add 6a3e3970c4c [fix](restore) Remove dynamic_partition.storage_policy
property (#48134)
add 74d5ef2c3b2 [Feat](Nereids) support analyze database/table command
(#48031)
add e7ad6f57350 [fix](regression) Spark reads Doris data error (#48150)
add b98f27a4892 [opt](inverted index) Refactor ICU tokenizer code location
for better organization and maintainability. (#48079)
add 198f5329f8d [feature](inverted index) Add profile statistics for each
condition in inverted index filters (#47504)
add 164d05e3d9b Revert "[debug](auto-partition) debug auto&dynamic
partition creation" (#48005)
add b7c973eff67 [fix](scheduler) Fix invalid access after freed (#48168)
add 91853370a7f [test](beut) add data-queue beut (#48136)
add e4af142e9b7 [fix](inverted index) fix wrong read data for primary key
(#47841)
add eb90763a797 [opt](resource) Add `WorkloadSchedPolicyTest` (#48154)
add 56f459d6a07 [Feat](Nereids) support alter system add/drop broker
command (#48108)
add 81f28d7d42e [test](case) fix unstable test case (#48141)
add 4c7c5608129 Revert "[fix](column) Math default value showed
incorrectly" (#48178)
add 0e36f1a1015 [fix](cloud-mow)Add more calculate delete bitmap fail case
(#46766)
add 6c1778f0d17 [improve](cloud-mow) Make mow stream load retry times more
reasonable (#47666)
add 5a7454e8ab0 [fix](Nerieds) using join bugs (#48030)
add 2dd96898ebd [fix](nereids) fix LogicalRepeat compute equalset (#47737)
add 56b744afe25 [fix](statistics)Show table stats need to forward to
master use FORWARD_NO_SYNC (#48189)
add c6643c6cc05 [Feat](Nereids) support alter system drop all broker
command (#48208)
add 2b010530801 [fix](Outfile) Set `retryTime` to one while executing
`outfile` statement. (#48095)
add fc404d73662 [fix](group commit) group commit failed if enable global
enable_unique_key_partial_update (#48120)
add 9119d2180c3 [fix](mv) Fix sync mv def sql parse not set the db when
create (#48162)
new 9c5d9626859 refactor of RuntimeFilterSlots
new a5e804f5918 update
new 14d85abda1c update
new dfa2679fb4a update
new 55f31dba0e5 update
new 0d67e252f48 [refactor](runtime filter) Simplify producer / slots
(#48145)
new a66d420f222 [refactor](runtime filter) Refine consumer (#48198)
new 15cc99d33a3 update filters refactor
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (9fb4944c72e)
\
N -- N -- N refs/heads/refactor_rf (15cc99d33a3)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/CMakeLists.txt | 26 +-
be/cmake/thirdparty.cmake | 4 +
be/dict/icu/uax29/Default.txt | 152 ++++++
be/dict/icu/uax29/MyanmarSyllable.txt | 35 ++
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 3 +-
be/src/cloud/cloud_meta_mgr.cpp | 5 +
be/src/cloud/cloud_stream_load_executor.cpp | 4 +-
be/src/cloud/config.cpp | 2 +-
be/src/clucene | 2 +-
be/src/exec/olap_common.h | 26 +-
be/src/exprs/bitmapfilter_predicate.h | 2 +-
be/src/exprs/bloom_filter_func.h | 429 ++-------------
be/src/exprs/bloom_filter_func_adaptor.h | 267 ++++++++++
be/src/exprs/bloom_filter_func_impl.h | 127 +++++
.../src/exprs/filter_base.h | 22 +-
be/src/exprs/hybrid_map.h | 57 --
be/src/exprs/hybrid_set.h | 30 +-
be/src/exprs/minmax_predicate.h | 103 ++--
be/src/olap/base_tablet.cpp | 2 +
be/src/olap/bitmap_filter_predicate.h | 1 -
be/src/olap/bloom_filter_predicate.h | 16 +-
be/src/olap/column_predicate.h | 35 +-
.../src/olap/filter_olap_param.h | 30 +-
be/src/olap/in_list_predicate.h | 9 +-
be/src/olap/inverted_index_profile.h | 57 ++
.../src/olap/inverted_index_stats.h | 21 +-
be/src/olap/olap_common.h | 2 +
.../inverted_index/analyzer/analyzer.cpp | 4 +-
.../analyzer/icu/BreakIteratorWrapper.cpp | 107 ++++
.../analyzer/icu/BreakIteratorWrapper.h | 54 ++
.../analyzer/icu/CompositeBreakIterator.cpp | 83 +++
.../analyzer/icu/CompositeBreakIterator.h | 58 +++
.../analyzer/icu/DefaultICUTokenizerConfig.cpp | 128 +++++
.../analyzer/icu/DefaultICUTokenizerConfig.h | 44 ++
.../inverted_index/analyzer/icu/ICUAnalyzer.h | 61 +++
.../inverted_index/analyzer/icu/ICUCommon.h | 40 +-
.../inverted_index/analyzer/icu/ICUTokenizer.cpp | 81 +++
.../inverted_index/analyzer/icu/ICUTokenizer.h | 48 +-
.../analyzer/icu/ICUTokenizerConfig.h | 24 +-
.../inverted_index/analyzer/icu/ScriptIterator.cpp | 121 +++++
.../inverted_index/analyzer/icu/ScriptIterator.h | 64 +++
.../rowset/segment_v2/inverted_index_reader.cpp | 20 +-
.../rowset/segment_v2/inverted_index_writer.cpp | 8 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 23 +-
be/src/olap/rowset_builder.cpp | 15 +-
be/src/olap/tablet_reader.cpp | 45 +-
be/src/olap/tablet_reader.h | 9 +-
be/src/olap/tablet_schema.cpp | 4 +-
be/src/pipeline/dependency.cpp | 2 +-
be/src/pipeline/exec/data_queue.cpp | 30 +-
be/src/pipeline/exec/data_queue.h | 11 -
be/src/pipeline/exec/datagen_operator.cpp | 2 +-
.../exec/group_commit_block_sink_operator.h | 1 +
be/src/pipeline/exec/hashjoin_build_sink.cpp | 23 +-
be/src/pipeline/exec/hashjoin_build_sink.h | 4 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 1 -
.../exec/multi_cast_data_stream_source.cpp | 6 +-
.../pipeline/exec/multi_cast_data_stream_source.h | 4 +-
.../exec/nested_loop_join_build_operator.cpp | 10 +-
.../exec/nested_loop_join_build_operator.h | 4 +-
be/src/pipeline/exec/olap_scan_operator.cpp | 14 +-
be/src/pipeline/exec/olap_scan_operator.h | 3 +-
be/src/pipeline/exec/scan_operator.cpp | 47 +-
be/src/pipeline/exec/scan_operator.h | 11 +-
be/src/pipeline/local_exchange/local_exchanger.cpp | 4 +-
be/src/pipeline/pipeline_fragment_context.cpp | 2 +-
be/src/pipeline/pipeline_fragment_context.h | 2 +-
be/src/pipeline/task_scheduler.cpp | 88 ++--
be/src/runtime/descriptors.cpp | 2 +-
be/src/runtime/fragment_mgr.cpp | 2 +-
be/src/runtime/group_commit_mgr.cpp | 1 +
be/src/runtime/runtime_query_statistics_mgr.cpp | 51 +-
be/src/runtime/runtime_state.cpp | 2 +-
.../runtime/workload_management/memory_context.h | 3 +-
.../runtime/workload_management/task_controller.h | 10 +-
.../workload_management/workload_sched_policy.cpp | 25 +-
.../runtime_filter/{role => }/runtime_filter.cpp | 4 +-
be/src/runtime_filter/{role => }/runtime_filter.h | 0
.../consumer.cpp => runtime_filter_consumer.cpp} | 30 +-
.../{role/consumer.h => runtime_filter_consumer.h} | 18 +-
...lper.cpp => runtime_filter_consumer_helper.cpp} | 52 +-
...r_helper.h => runtime_filter_consumer_helper.h} | 30 +-
be/src/runtime_filter/runtime_filter_definitions.h | 20 +-
.../{role/merger.h => runtime_filter_merger.h} | 46 +-
be/src/runtime_filter/runtime_filter_mgr.cpp | 16 +-
be/src/runtime_filter/runtime_filter_mgr.h | 6 +-
.../producer.cpp => runtime_filter_producer.cpp} | 24 +-
.../{role/producer.h => runtime_filter_producer.h} | 21 +-
...lots.cpp => runtime_filter_producer_helper.cpp} | 77 ++-
...er_slots.h => runtime_filter_producer_helper.h} | 32 +-
...ss.h => runtime_filter_producer_helper_cross.h} | 12 +-
be/src/runtime_filter/runtime_filter_wrapper.cpp | 90 ++--
be/src/runtime_filter/runtime_filter_wrapper.h | 11 +-
.../aggregate_function_collect.cpp | 8 +
.../aggregate_function_collect.h | 70 ++-
.../aggregate_function_group_array_intersect.h | 36 +-
be/src/vec/core/sort_cursor.h | 23 +-
.../data_types/serde/data_type_date64_serde.cpp | 14 +-
be/src/vec/exec/format/table/iceberg_reader.cpp | 6 -
be/src/vec/exec/scan/new_olap_scanner.cpp | 9 +-
be/src/vec/exec/scan/new_olap_scanner.h | 2 +-
be/src/vec/exprs/vbloom_predicate.cpp | 1 -
be/src/vec/exprs/vbloom_predicate.h | 1 -
be/src/vec/exprs/vexpr.cpp | 4 +-
be/src/vec/exprs/vruntimefilter_wrapper.cpp | 6 +-
be/src/vec/exprs/vruntimefilter_wrapper.h | 5 +-
be/src/vec/functions/function_convert_tz.h | 42 +-
be/src/vec/functions/function_ifnull.h | 5 +-
be/src/vec/runtime/vsorted_run_merger.cpp | 82 ++-
be/src/vec/runtime/vsorted_run_merger.h | 6 +-
be/test/common/schema_util_test.cpp | 12 +
be/test/olap/inverted_index_profile_test.cpp | 44 ++
.../inverted_index/analyzer/icu_anzlyzer_test.cpp | 575 +++++++++++++++++++++
be/test/pipeline/exec/data_queue_test.cpp | 115 +++++
be/test/pipeline/pipeline_test.cpp | 30 +-
be/test/runtime/workload_sched_policy_test.cpp | 286 ++++++++++
be/test/vec/function/function_convert_tz_test.cpp | 59 +++
be/test/vec/runtime/sort_merger_test.cpp | 192 ++++++-
.../minio/minio-RELEASE.2024-11-07.yaml.tpl | 1 +
.../main/java/org/apache/doris/common/Config.java | 5 +
fe/fe-core/pom.xml | 6 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 34 +-
.../apache/doris/analysis/ModifyBrokerClause.java | 9 +
.../apache/doris/analysis/ShowTableStatsStmt.java | 5 +
.../main/java/org/apache/doris/catalog/Column.java | 5 +-
.../doris/catalog/DynamicPartitionProperty.java | 4 +
.../main/java/org/apache/doris/catalog/Env.java | 5 +
.../org/apache/doris/catalog/FunctionRegistry.java | 24 +-
.../main/java/org/apache/doris/catalog/MTMV.java | 12 +-
.../doris/catalog/MaterializedIndexMeta.java | 4 +
.../java/org/apache/doris/catalog/OlapTable.java | 8 +-
.../main/java/org/apache/doris/catalog/Table.java | 4 +
.../org/apache/doris/catalog/TableProperty.java | 2 +
.../transaction/CloudGlobalTransactionMgr.java | 45 +-
.../apache/doris/datasource/InternalCatalog.java | 2 +-
.../datasource/paimon/PaimonExternalCatalog.java | 19 +
.../datasource/paimon/PaimonExternalTable.java | 42 +-
.../datasource/paimon/PaimonMetadataCache.java | 46 +-
.../datasource/paimon/PaimonPartitionInfo.java | 11 +-
.../doris/datasource/paimon/PaimonSnapshot.java | 11 +-
.../apache/doris/datasource/paimon/PaimonUtil.java | 106 +---
.../datasource/paimon/source/PaimonScanNode.java | 5 +
.../main/java/org/apache/doris/mtmv/MTMVCache.java | 77 +--
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 27 +-
.../org/apache/doris/nereids/analyzer/Scope.java | 40 +-
.../doris/nereids/analyzer/UnboundResultSink.java | 8 +-
.../doris/nereids/parser/LogicalPlanBuilder.java | 124 ++++-
.../parser/LogicalPlanBuilderForEncryption.java | 138 +++++
.../apache/doris/nereids/parser/NereidsParser.java | 8 +
.../post/PushDownFilterThroughProject.java | 13 +-
.../doris/nereids/processor/post/Validator.java | 8 -
.../apache/doris/nereids/properties/DataTrait.java | 4 +
.../nereids/properties/LogicalProperties.java | 37 +-
.../nereids/rules/analysis/BindExpression.java | 44 +-
.../nereids/rules/analysis/ExpressionAnalyzer.java | 10 +-
.../nereids/rules/analysis/SubExprAnalyzer.java | 3 +-
.../mv/InitMaterializationContextHook.java | 7 +-
.../exploration/mv/MaterializedViewUtils.java | 48 --
.../rules/OneRangePartitionEvaluator.java | 55 +-
.../rules/rewrite/DeferMaterializeTopNResult.java | 4 +
.../rewrite/EliminateGroupByKeyByUniform.java | 10 +
.../nereids/rules/rewrite/ExistsApplyToJoin.java | 5 +-
.../doris/nereids/rules/rewrite/InApplyToJoin.java | 6 +-
.../rewrite/PushDownFilterThroughProject.java | 64 +--
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 5 +-
.../functions/AggCombinerFunctionBuilder.java | 5 +
.../functions/BuiltinFunctionBuilder.java | 16 +
.../expressions/functions/FunctionBuilder.java | 5 +
.../functions/executable/NumericArithmetic.java | 69 ++-
.../expressions/functions/udf/AliasUdfBuilder.java | 7 +
.../expressions/functions/udf/JavaUdafBuilder.java | 15 +
.../expressions/functions/udf/JavaUdfBuilder.java | 15 +
.../expressions/functions/udf/JavaUdtfBuilder.java | 15 +
.../doris/nereids/trees/plans/AbstractPlan.java | 9 +-
.../trees/plans/DiffOutputInAsterisk.java} | 39 +-
.../apache/doris/nereids/trees/plans/FakePlan.java | 2 +-
.../org/apache/doris/nereids/trees/plans/Plan.java | 8 +
.../apache/doris/nereids/trees/plans/PlanType.java | 2 +
.../trees/plans/commands/AlterSystemCommand.java | 8 +-
.../trees/plans/commands/AnalyzeCommand.java | 147 ++++++
.../plans/commands/AnalyzeDatabaseCommand.java | 77 +++
.../trees/plans/commands/AnalyzeTableCommand.java | 321 ++++++++++++
.../trees/plans/commands/CreateCatalogCommand.java | 19 -
.../trees/plans/commands/CreateTableCommand.java | 8 +-
.../trees/plans/commands/ExportCommand.java | 7 +-
.../nereids/trees/plans/commands/LoadCommand.java | 7 +-
.../trees/plans/commands/NeedAuditEncryption.java | 21 +-
.../trees/plans/commands/PrepareCommand.java | 2 +-
.../trees/plans/commands/SetOptionsCommand.java | 15 -
.../trees/plans/commands/info/AddBrokerOp.java} | 26 +-
.../trees/plans/commands/info/BrokerOp.java} | 52 +-
.../trees/plans/commands/info/CreateTableInfo.java | 8 +
.../plans/commands/info/DropAllBrokerOp.java} | 26 +-
.../trees/plans/commands/info/DropBrokerOp.java} | 26 +-
.../commands/insert/InsertIntoTableCommand.java | 9 +-
.../insert/InsertOverwriteTableCommand.java | 9 +-
.../trees/plans/logical/LogicalAssertNumRows.java | 9 +-
.../trees/plans/logical/LogicalFileSink.java | 8 +-
.../nereids/trees/plans/logical/LogicalFilter.java | 9 +-
.../trees/plans/logical/LogicalGenerate.java | 12 +-
.../nereids/trees/plans/logical/LogicalJoin.java | 111 ++--
.../nereids/trees/plans/logical/LogicalRepeat.java | 11 +
.../trees/plans/logical/LogicalSelectHint.java | 8 +-
.../trees/plans/logical/LogicalSubQueryAlias.java | 15 +-
.../trees/plans/logical/LogicalUsingJoin.java | 149 ++++++
.../nereids/trees/plans/logical/UsingJoin.java | 217 --------
.../trees/plans/physical/PhysicalSqlCache.java | 2 +-
.../org/apache/doris/nereids/util/JoinUtils.java | 36 +-
.../org/apache/doris/nereids/util/PlanUtils.java | 24 +
.../java/org/apache/doris/qe/AuditLogHelper.java | 21 +-
.../java/org/apache/doris/qe/ConnectContext.java | 13 +-
.../org/apache/doris/qe/MysqlConnectProcessor.java | 4 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 10 +-
.../apache/doris/service/FrontendServiceImpl.java | 12 +-
.../apache/doris/statistics/AnalysisManager.java | 193 +++++++
.../java/org/apache/doris/mtmv/PaimonUtilTest.java | 71 ---
.../doris/nereids/parser/EncryptSQLTest.java | 267 ++++++++++
.../PushDownFilterThroughProjectTest.java | 41 ++
.../rules/analysis/BindSlotReferenceTest.java | 19 +-
.../nereids/rules/expression/FoldConstantTest.java | 87 ++--
.../rewrite/EliminateGroupByKeyByUniformTest.java | 8 +-
.../rules/rewrite/EliminateGroupByKeyTest.java | 15 +
.../rewrite/PushDowFilterThroughProjectTest.java | 48 +-
.../plans/commands/ShowCreateTableCommandTest.java | 60 ---
fe/pom.xml | 4 +-
gensrc/thrift/PaloInternalService.thrift | 2 +-
regression-test/conf/regression-conf.groovy | 1 +
.../spark_connector/spark_connector_read_type.out | Bin 670 -> 670 bytes
.../data/correctness_p0/test_default_double.out | Bin 0 -> 296 bytes
.../data/datatype_p0/double/test_double_nan.out | Bin 110 -> 133 bytes
.../data/datatype_p0/float/test_float_nan.out | Bin 110 -> 133 bytes
.../cloud/test_cloud_mow_lock_expired.out | Bin 0 -> 388 bytes
...test_cloud_mow_stream_load_with_commit_fail.out | Bin 134 -> 446 bytes
.../fault_injection_p0/cloud/test_stream_load0.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load1.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load2.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load3.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load4.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load5.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load6.csv | 2 +
.../fault_injection_p0/cloud/test_stream_load7.csv | 2 +
.../test_partial_update_publish_seq.out | Bin 0 -> 1714 bytes
.../test_skip_calc_between_segments.out} | Bin 127 -> 175 bytes
.../data/function_p0/test_agg_foreach.out | Bin 1865 -> 1164 bytes
.../data/function_p0/test_agg_foreach_notnull.out | Bin 1865 -> 1164 bytes
.../query_in_different_db.out} | Bin 133 -> 172 bytes
.../sql_default_limit/sql_default_limit.out} | Bin 127 -> 137 bytes
.../mv_p0/sum_divede_count/sum_devide_count.out | Bin 326 -> 418 bytes
.../test_dup_mv_repeat/test_dup_mv_repeat.out | Bin 133 -> 134 bytes
.../mv_p0/test_insert_multi/test_insert_multi.out | Bin 179 -> 255 bytes
.../testAggQueryOnAggMV1/testAggQueryOnAggMV1.out | Bin 355 -> 482 bytes
.../data/nereids_p0/join/test_join2.out | Bin 1907 -> 1697 bytes
.../data/nereids_p0/join/test_join3.out | Bin 408 -> 351 bytes
.../window_functions/test_window_function.out | Bin 11741 -> 11741 bytes
.../eliminate_gby_key/eliminate_gby_key.out | Bin 128 -> 204 bytes
.../eliminate_group_by_key_by_uniform.out | Bin 3568 -> 4446 bytes
.../eliminate_order_by_key.out | Bin 6764 -> 6771 bytes
.../filter_push_down/push_filter_through.out | Bin 10078 -> 10014 bytes
.../limit_push_down/limit_push_down.out | Bin 21517 -> 21029 bytes
.../limit_push_down/order_push_down.out | Bin 19725 -> 19605 bytes
.../partition_prune/prune_or.out} | Bin 110 -> 174 bytes
.../mv/newMv/sum_devide_count.out | Bin 326 -> 490 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV1.out | Bin 229 -> 355 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV10.out | Bin 264 -> 328 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV11.out | Bin 229 -> 292 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV2.out | Bin 235 -> 342 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV3.out | Bin 245 -> 309 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV5.out | Bin 217 -> 280 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV6.out | Bin 217 -> 280 bytes
.../data/nereids_syntax_p0/mv/ut/aggOnAggMV7.out | Bin 217 -> 280 bytes
.../data/nereids_syntax_p0/test_join3.out | Bin 408 -> 351 bytes
.../data/nereids_syntax_p0/using_join.out | Bin 127 -> 2193 bytes
.../data/prepared_stmt_p0/prepared_stmt.out | Bin 5124 -> 5355 bytes
.../data/query_p0/aggregate/array_agg.out | Bin 8132 -> 37278 bytes
regression-test/data/query_p0/join/test_join2.out | Bin 1907 -> 1697 bytes
regression-test/data/query_p0/join/test_join3.out | Bin 408 -> 351 bytes
.../array_functions/test_array_functions.out | Bin 28026 -> 28026 bytes
.../window_functions/test_column_boundary.out | Bin 144 -> 151 bytes
.../window_functions/test_window_function.out | Bin 11741 -> 11741 bytes
.../data/shape_check/clickbench/query25.out | Bin 418 -> 378 bytes
.../data/shape_check/clickbench/query26.out | Bin 388 -> 348 bytes
.../data/shape_check/clickbench/query27.out | Bin 418 -> 378 bytes
.../test_partial_update_default_value.out | Bin 259 -> 1003 bytes
.../test_partial_update_lookup_row_key.out | Bin 0 -> 779 bytes
.../test_partial_update_row_store.out | Bin 0 -> 847 bytes
.../data/variant_github_events_new_p2/load.out | Bin 152 -> 222 bytes
.../test_array_contains_with_inverted_index.out | Bin 0 -> 45214 bytes
.../test_array_inverted_index_profile.out | Bin 0 -> 2004 bytes
.../vault_p0/create/test_minio_storage_vault.out | Bin 136 -> 179 bytes
.../vault_p0/conf/regression-conf-custom.groovy | 1 +
.../correctness_p0/test_default_double.groovy | 48 ++
.../datatype_p0/double/test_double_nan.groovy | 10 +-
.../suites/datatype_p0/float/test_float_nan.groovy | 10 +-
.../external_table_p0/hive/hive_config_test.groovy | 3 +-
.../cloud/test_cloud_mow_lock_expired.groovy | 126 +++++
...t_cloud_mow_stream_load_with_commit_fail.groovy | 340 +++++++++++-
.../test_partial_update_publish_seq.groovy | 180 +++++++
.../test_skip_calc_between_segments.groovy | 173 +++++++
.../suites/function_p0/not_found_function.groovy | 21 +-
.../suites/function_p0/test_agg_foreach.groovy | 28 -
.../function_p0/test_agg_foreach_notnull.groovy | 28 -
.../test_group_commit_replay_wal.groovy | 4 +-
...nsert_group_commit_into_unique_sync_mode.groovy | 5 +
.../test_arrayInvertedIdx_profile.groovy | 1 -
.../test_array_contains_with_inverted_index.groovy | 1 -
.../test_pk_no_need_read_data.groovy | 13 +-
.../suites/mtmv_p0/test_base_mtmv.groovy | 24 +-
.../suites/mtmv_p0/test_build_mtmv.groovy | 15 +-
.../suites/mtmv_p0/test_replace_mtmv.groovy | 14 +-
.../query_in_different_db.groovy | 69 +++
.../sql_default_limit/sql_default_limit.groovy | 61 +++
.../mv_p0/sum_divede_count/sum_devide_count.groovy | 12 +-
.../test_dup_mv_repeat/test_dup_mv_repeat.groovy | 12 +-
.../test_insert_multi/test_insert_multi.groovy | 12 +-
.../testAggQueryOnAggMV1.groovy | 8 +-
.../nereids_function_p0/scalar_function/A.groovy | 5 +-
.../fold_constant_numeric_arithmatic.groovy | 60 ++-
.../suites/nereids_p0/join/test_join2.groovy | 20 +-
.../window_functions/test_window_function.groovy | 8 +-
.../subquery/test_correlated_filter_removed.groovy | 54 ++
.../eliminate_gby_key/eliminate_gby_key.groovy | 2 +
.../eliminate_group_by_key_by_uniform.groovy | 16 +
.../eliminate_order_by_key.groovy | 1 +
.../create_commit_mtmv_many_task.groovy | 2 -
.../range_datetime_part_up_rewrite.groovy | 41 +-
.../partition_prune/prune_or.groovy | 79 +++
.../mv/newMv/sum_devide_count.groovy | 18 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV1.groovy | 8 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV10.groovy | 5 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV11.groovy | 5 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV2.groovy | 7 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV3.groovy | 5 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV5.groovy | 5 +
.../nereids_syntax_p0/mv/ut/aggOnAggMV6.groovy | 5 +-
.../nereids_syntax_p0/mv/ut/aggOnAggMV7.groovy | 5 +-
.../nereids_syntax_p0/mv/ut/onlyGroupBy.groovy | 8 +-
.../suites/nereids_syntax_p0/using_join.groovy | 150 ++++--
.../suites/prepared_stmt_p0/prepared_stmt.groovy | 46 ++
.../suites/query_p0/aggregate/array_agg.groovy | 16 +
.../array_functions/test_array_functions.groovy | 12 +-
.../window_functions/test_column_boundary.groovy | 15 +-
.../window_functions/test_window_function.groovy | 8 +-
.../suites/trino_p0/constant_group_key.groovy | 2 +-
.../test_partial_update_default_value.groovy | 25 +-
.../test_partial_update_lookup_row_key.groovy | 81 +++
.../test_partial_update_row_store.groovy | 103 ++++
.../variant_github_events_new_p2/load.groovy | 63 ++-
.../test_array_contains_with_inverted_index.groovy | 94 ++--
.../with_index/test_array_index_write.groovy | 93 ++++
.../test_array_inverted_index_profile.groovy | 157 ++++++
.../create/test_minio_storage_vault.groovy | 52 +-
351 files changed, 8485 insertions(+), 2665 deletions(-)
create mode 100644 be/dict/icu/uax29/Default.txt
create mode 100644 be/dict/icu/uax29/MyanmarSyllable.txt
create mode 100644 be/src/exprs/bloom_filter_func_adaptor.h
create mode 100644 be/src/exprs/bloom_filter_func_impl.h
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/NeedAuditEncryption.java
=> be/src/exprs/filter_base.h (69%)
delete mode 100644 be/src/exprs/hybrid_map.h
copy
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonSnapshot.java
=> be/src/olap/filter_olap_param.h (66%)
create mode 100644 be/src/olap/inverted_index_profile.h
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/NeedAuditEncryption.java
=> be/src/olap/inverted_index_stats.h (74%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/BreakIteratorWrapper.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/BreakIteratorWrapper.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/CompositeBreakIterator.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/CompositeBreakIterator.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/DefaultICUTokenizerConfig.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/DefaultICUTokenizerConfig.h
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ICUAnalyzer.h
copy
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonSnapshot.java
=> be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ICUCommon.h (55%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ICUTokenizer.cpp
copy
fe/fe-core/src/main/java/org/apache/doris/datasource/paimon/PaimonSchema.java
=> be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ICUTokenizer.h
(51%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/NeedAuditEncryption.java
=>
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ICUTokenizerConfig.h
(61%)
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ScriptIterator.cpp
create mode 100644
be/src/olap/rowset/segment_v2/inverted_index/analyzer/icu/ScriptIterator.h
rename be/src/runtime_filter/{role => }/runtime_filter.cpp (97%)
rename be/src/runtime_filter/{role => }/runtime_filter.h (100%)
rename be/src/runtime_filter/{role/consumer.cpp =>
runtime_filter_consumer.cpp} (93%)
rename be/src/runtime_filter/{role/consumer.h => runtime_filter_consumer.h}
(88%)
rename be/src/runtime_filter/{runtime_filter_helper.cpp =>
runtime_filter_consumer_helper.cpp} (73%)
rename be/src/runtime_filter/{runtime_filter_helper.h =>
runtime_filter_consumer_helper.h} (77%)
rename be/src/runtime_filter/{role/merger.h => runtime_filter_merger.h} (63%)
rename be/src/runtime_filter/{role/producer.cpp =>
runtime_filter_producer.cpp} (94%)
rename be/src/runtime_filter/{role/producer.h => runtime_filter_producer.h}
(81%)
rename be/src/runtime_filter/{runtime_filter_slots.cpp =>
runtime_filter_producer_helper.cpp} (55%)
rename be/src/runtime_filter/{runtime_filter_slots.h =>
runtime_filter_producer_helper.h} (76%)
rename be/src/runtime_filter/{runtime_filter_slots_cross.h =>
runtime_filter_producer_helper_cross.h} (83%)
create mode 100644 be/test/olap/inverted_index_profile_test.cpp
create mode 100644
be/test/olap/rowset/segment_v2/inverted_index/analyzer/icu_anzlyzer_test.cpp
create mode 100644 be/test/pipeline/exec/data_queue_test.cpp
create mode 100644 be/test/runtime/workload_sched_policy_test.cpp
create mode 100644 be/test/vec/function/function_convert_tz_test.cpp
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilderForEncryption.java
rename
fe/fe-core/src/main/java/org/apache/doris/{datasource/paimon/PaimonSchema.java
=> nereids/trees/plans/DiffOutputInAsterisk.java} (55%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AnalyzeCommand.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AnalyzeDatabaseCommand.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AnalyzeTableCommand.java
copy
fe/fe-core/src/main/java/org/apache/doris/{datasource/paimon/PaimonSnapshot.java
=> nereids/trees/plans/commands/info/AddBrokerOp.java} (58%)
copy
fe/fe-core/src/main/java/org/apache/doris/{analysis/ModifyBrokerClause.java =>
nereids/trees/plans/commands/info/BrokerOp.java} (77%)
copy
fe/fe-core/src/main/java/org/apache/doris/{datasource/paimon/PaimonSnapshot.java
=> nereids/trees/plans/commands/info/DropAllBrokerOp.java} (59%)
copy
fe/fe-core/src/main/java/org/apache/doris/{datasource/paimon/PaimonSnapshot.java
=> nereids/trees/plans/commands/info/DropBrokerOp.java} (58%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalUsingJoin.java
delete mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/UsingJoin.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/mtmv/PaimonUtilTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/parser/EncryptSQLTest.java
delete mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowCreateTableCommandTest.java
create mode 100644 regression-test/data/correctness_p0/test_default_double.out
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_cloud_mow_lock_expired.out
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load0.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load1.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load2.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load3.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load4.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load5.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load6.csv
create mode 100644
regression-test/data/fault_injection_p0/cloud/test_stream_load7.csv
create mode 100644
regression-test/data/fault_injection_p0/partial_update/test_partial_update_publish_seq.out
copy regression-test/data/{nereids_syntax_p0/using_join.out =>
fault_injection_p0/test_skip_calc_between_segments.out} (68%)
copy regression-test/data/mv_p0/{test_dup_mv_repeat/test_dup_mv_repeat.out =>
query_in_different_db/query_in_different_db.out} (65%)
copy regression-test/data/{nereids_syntax_p0/using_join.out =>
mv_p0/sql_default_limit/sql_default_limit.out} (70%)
copy regression-test/data/{datatype_p0/double/test_double_nan.out =>
nereids_rules_p0/partition_prune/prune_or.out} (55%)
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_lookup_row_key.out
create mode 100644
regression-test/data/unique_with_mow_p0/partial_update/test_partial_update_row_store.out
create mode 100644
regression-test/data/variant_p0/with_index/test_array_contains_with_inverted_index.out
create mode 100644
regression-test/data/variant_p0/with_index/test_array_inverted_index_profile.out
create mode 100644
regression-test/suites/correctness_p0/test_default_double.groovy
create mode 100644
regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_lock_expired.groovy
create mode 100644
regression-test/suites/fault_injection_p0/partial_update/test_partial_update_publish_seq.groovy
create mode 100644
regression-test/suites/fault_injection_p0/test_skip_calc_between_segments.groovy
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/NeedAuditEncryption.java
=> regression-test/suites/function_p0/not_found_function.groovy (67%)
create mode 100644
regression-test/suites/mv_p0/query_in_different_db/query_in_different_db.groovy
create mode 100644
regression-test/suites/mv_p0/sql_default_limit/sql_default_limit.groovy
create mode 100644
regression-test/suites/nereids_p0/subquery/test_correlated_filter_removed.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/partition_prune/prune_or.groovy
create mode 100644
regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_lookup_row_key.groovy
create mode 100644
regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_row_store.groovy
copy regression-test/suites/{inverted_index_p0 =>
variant_p0/with_index}/test_array_contains_with_inverted_index.groovy (57%)
create mode 100644
regression-test/suites/variant_p0/with_index/test_array_index_write.groovy
create mode 100644
regression-test/suites/variant_p0/with_index/test_array_inverted_index_profile.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
