This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from f6ec64c6ad0 [fix](exception) Fix Block noexcept method not throw
exception (#34002)
new d5275c55b45 [bug](fold) fix fold date/datetime error as null (#33845)
new cc3decffa4e [bug](test) fix test case failed with fuuzy fold constatnt
to false (#34052)
new f88093e0bf5 [fix](routine-load) fix routine load lag is negative
(#33846)
new 8b02f90cb43 [chore](session_variable) Add 'data_queue_max_blocks' to
prevent the DataQueue from occupying too much memory. (#34017)
new 1b556efa47b [fix](bdb) Write OP_TIMESTAMP operation until it successed
(#33967)
new dc4753253da [fix](mtmv) Mv check name (#34016)
new 22320453985 [Feat](nereids) nereids add alter view (#33970)
new c210b8ca860 [Feat](nereids) add expression rewrite rule
LikeToEqualRewrite (#33803)
new ba3a15342d7 [Feat](nereids) add transform rule
SimplifyWindowExpression (#33647)
new 503f0ebe2f8 [opt](nereids)project sub expression in other condition
for nested loop join (#32697)
new b4d3ecbcc69 [improvement](spill) improve config of spill thread pool
(#33992)
new d7b77930f80 [feature](profile) sort pipelineX task by total time #34053
new 4e60748d3b7 [improvement](mtmv) Optimize the nested materialized view
rewrite performance (#34050)
new 3b544ee938c [refactor](errormessage) step1: unify the status usage in
FE (#34062)
new 2b271634429 [bugfix](core) close method should check if the pointer is
nullptr (#34067)
The 15 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/config.cpp | 13 +-
be/src/common/config.h | 4 +-
be/src/pipeline/exec/data_queue.cpp | 8 +-
be/src/pipeline/exec/data_queue.h | 4 +
be/src/pipeline/exec/exchange_sink_operator.cpp | 3 +-
.../exec/partitioned_aggregation_sink_operator.cpp | 2 +-
.../exec/partitioned_aggregation_sink_operator.h | 46 ++--
.../partitioned_aggregation_source_operator.cpp | 2 +-
.../exec/partitioned_hash_join_probe_operator.cpp | 12 +-
.../exec/partitioned_hash_join_sink_operator.cpp | 6 +-
be/src/pipeline/exec/spill_sort_sink_operator.cpp | 140 ++++++------
.../pipeline/exec/spill_sort_source_operator.cpp | 3 +-
be/src/pipeline/exec/union_sink_operator.cpp | 1 +
be/src/pipeline/pipeline_fragment_context.cpp | 5 +
be/src/pipeline/pipeline_x/dependency.cpp | 1 -
be/src/pipeline/pipeline_x/dependency.h | 6 +-
be/src/runtime/runtime_state.h | 18 +-
be/src/util/runtime_profile.cpp | 12 +
be/src/util/runtime_profile.h | 2 +
be/src/vec/spill/spill_stream.cpp | 64 +-----
be/src/vec/spill/spill_stream.h | 10 +-
be/src/vec/spill/spill_stream_manager.cpp | 25 +-
be/src/vec/spill/spill_stream_manager.h | 10 +-
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 2 +
.../org/apache/doris/analysis/AlterViewStmt.java | 9 +
.../java/org/apache/doris/common/IdGenerator.java | 6 +
.../main/java/org/apache/doris/common/Status.java | 48 ++--
.../apache/doris/journal/bdbje/BDBJEJournal.java | 22 +-
.../load/routineload/KafkaRoutineLoadJob.java | 15 +-
.../org/apache/doris/nereids/StatementContext.java | 17 +-
.../doris/nereids/jobs/executor/Rewriter.java | 8 +-
.../java/org/apache/doris/nereids/memo/Memo.java | 4 +
.../apache/doris/nereids/memo/StructInfoMap.java | 59 +++--
.../doris/nereids/parser/LogicalPlanBuilder.java | 13 ++
.../org/apache/doris/nereids/rules/RuleType.java | 2 +
.../nereids/rules/exploration/mv/StructInfo.java | 14 +-
.../rules/expression/ExpressionOptimization.java | 4 +-
.../expression/rules/FoldConstantRuleOnBE.java | 50 ++--
.../rules/expression/rules/LikeToEqualRewrite.java | 70 ++++++
...ProjectOtherJoinConditionForNestedLoopJoin.java | 127 +++++++++++
.../rules/rewrite/SimplifyWindowExpression.java | 123 ++++++++++
.../doris/nereids/trees/expressions/ExprId.java | 9 +-
.../expressions/StatementScopeIdGenerator.java | 5 +-
.../expressions/functions/scalar/Tokenize.java | 10 +-
.../apache/doris/nereids/trees/plans/PlanType.java | 3 +-
.../trees/plans/commands/AlterViewCommand.java | 49 ++++
.../trees/plans/commands/info/AlterViewInfo.java | 121 ++++++++++
.../{CreateViewInfo.java => BaseViewInfo.java} | 112 ++-------
.../trees/plans/commands/info/CreateMTMVInfo.java | 5 +
.../trees/plans/commands/info/CreateViewInfo.java | 221 +-----------------
.../trees/plans/visitor/CommandVisitor.java | 5 +
.../main/java/org/apache/doris/qe/Coordinator.java | 19 +-
.../java/org/apache/doris/qe/PointQueryExec.java | 22 +-
.../java/org/apache/doris/qe/ResultReceiver.java | 26 +--
.../java/org/apache/doris/qe/SessionVariable.java | 10 +
.../org/apache/doris/qe/cache/CacheBeProxy.java | 18 +-
.../org/apache/doris/qe/cache/PartitionCache.java | 3 +-
.../arrowflight/FlightSqlConnectProcessor.java | 8 +-
.../doris/nereids/properties/UniqueTest.java | 2 +-
.../expression/rules/LikeToEqualRewriteTest.java | 147 ++++++++++++
...ectOtherJoinConditionForNestedLoopJoinTest.java | 82 +++++++
.../rules/rewrite/PullUpProjectUnderLimitTest.java | 5 +-
.../rules/rewrite/PullUpProjectUnderTopNTest.java | 5 +-
gensrc/thrift/PaloInternalService.thrift | 3 +
.../data/ddl_p0/test_alter_view_nereids.out | 17 ++
.../data/nereids_hint_tpcds_p0/shape/query24.out | 15 +-
.../data/nereids_hint_tpch_p0/shape/q11.out | 37 +--
.../data/nereids_hint_tpch_p0/shape/q7.out | 43 ++--
.../data/nereids_p0/hint/fix_leading.out | 4 +-
.../data/nereids_p0/hint/multi_leading.out | 22 +-
.../push_down_filter_other_condition.out | 6 +-
.../like_to_equal_to_rewrite.out | 24 ++
.../simplify_window_expression.out | 254 +++++++++++++++++++++
.../shape/query14.out | 126 +++++-----
.../shape/query23.out | 13 +-
.../shape/query24.out | 15 +-
.../shape/query44.out | 38 +--
.../shape/query54.out | 121 +++++-----
.../shape/query70.out | 36 ++-
.../constraints/query23.out | 13 +-
.../noStatsRfPrune/query14.out | 132 ++++++-----
.../noStatsRfPrune/query23.out | 13 +-
.../noStatsRfPrune/query24.out | 15 +-
.../noStatsRfPrune/query44.out | 38 +--
.../noStatsRfPrune/query54.out | 115 +++++-----
.../noStatsRfPrune/query70.out | 36 ++-
.../no_stats_shape/query14.out | 132 ++++++-----
.../no_stats_shape/query23.out | 13 +-
.../no_stats_shape/query24.out | 15 +-
.../no_stats_shape/query44.out | 38 +--
.../no_stats_shape/query54.out | 115 +++++-----
.../no_stats_shape/query70.out | 35 ++-
.../rf_prune/query14.out | 126 +++++-----
.../rf_prune/query23.out | 13 +-
.../rf_prune/query24.out | 15 +-
.../rf_prune/query44.out | 38 +--
.../rf_prune/query54.out | 120 +++++-----
.../rf_prune/query70.out | 36 ++-
.../nereids_tpcds_shape_sf100_p0/shape/query14.out | 126 +++++-----
.../nereids_tpcds_shape_sf100_p0/shape/query23.out | 13 +-
.../nereids_tpcds_shape_sf100_p0/shape/query24.out | 15 +-
.../nereids_tpcds_shape_sf100_p0/shape/query44.out | 38 +--
.../nereids_tpcds_shape_sf100_p0/shape/query54.out | 120 +++++-----
.../nereids_tpcds_shape_sf100_p0/shape/query70.out | 35 ++-
.../nostats_rf_prune/q11.out | 33 +--
.../nereids_tpch_shape_sf1000_p0/rf_prune/q11.out | 25 +-
.../nereids_tpch_shape_sf1000_p0/shape/q11.out | 25 +-
.../shape_no_stats/q11.out | 33 +--
.../suites/ddl_p0/test_alter_view_nereids.groovy | 69 ++++++
.../suites/mtmv_p0/test_build_mtmv.groovy | 15 ++
.../like_to_equal_to_rewrite.groovy | 53 +++++
.../simplify_window_expression.groovy | 110 +++++++++
.../query_p0/explain/test_pushdown_explain.groovy | 14 ++
113 files changed, 2772 insertions(+), 1661 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/expression/rules/LikeToEqualRewrite.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/ProjectOtherJoinConditionForNestedLoopJoin.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SimplifyWindowExpression.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AlterViewCommand.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/AlterViewInfo.java
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/{CreateViewInfo.java
=> BaseViewInfo.java} (67%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/expression/rules/LikeToEqualRewriteTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/ProjectOtherJoinConditionForNestedLoopJoinTest.java
create mode 100644 regression-test/data/ddl_p0/test_alter_view_nereids.out
create mode 100644
regression-test/data/nereids_rules_p0/like_to_equal_to_rewrite/like_to_equal_to_rewrite.out
create mode 100644
regression-test/data/nereids_rules_p0/simplify_window_expression/simplify_window_expression.out
create mode 100644 regression-test/suites/ddl_p0/test_alter_view_nereids.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/like_to_equal_to_rewrite/like_to_equal_to_rewrite.groovy
create mode 100644
regression-test/suites/nereids_rules_p0/simplify_window_expression/simplify_window_expression.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
