This is an automated email from the ASF dual-hosted git repository.
morrysnow pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from e8717f2587b [fix](core) Fix the core issue caused by extra fields when
casting a string to a struct. (#50851)
add 4da1c8ab194 [opt](mtmv) optimize mtmv rewrite performance (#49514)
No new revisions were added by this update.
Summary of changes:
.../doris/common/profile/SummaryProfile.java | 18 +-
.../org/apache/doris/mtmv/MTMVRelationManager.java | 24 +-
.../org/apache/doris/mtmv/MTMVRewriteUtil.java | 45 ++-
.../org/apache/doris/nereids/CascadesContext.java | 5 +
.../org/apache/doris/nereids/NereidsPlanner.java | 19 ++
.../java/org/apache/doris/nereids/PlannerHook.java | 12 +
.../org/apache/doris/nereids/StatementContext.java | 43 ++-
.../executor/TablePartitionCollector.java} | 34 +--
.../apache/doris/nereids/memo/StructInfoMap.java | 4 +
.../org/apache/doris/nereids/rules/RuleType.java | 1 +
.../mv/AbstractMaterializedViewRule.java | 223 ++++++---------
.../rules/exploration/mv/HyperGraphComparator.java | 41 ++-
.../mv/InitMaterializationContextHook.java | 17 +-
.../exploration/mv/MaterializationContext.java | 37 ++-
...terializedViewAggregateOnNoneAggregateRule.java | 12 +-
.../rules/exploration/mv/PartitionCompensator.java | 199 +++++++++++++
.../nereids/rules/exploration/mv/StructInfo.java | 121 ++------
.../rules/rewrite/PruneFileScanPartition.java | 1 -
.../rules/rewrite/QueryPartitionCollector.java | 95 +++++++
.../plans/visitor/ExpressionLineageReplacer.java | 27 +-
.../java/org/apache/doris/qe/SessionVariable.java | 9 +
.../org/apache/doris/mtmv/MTMVRewriteUtilTest.java | 41 ++-
.../doris/nereids/memo/StructInfoMapTest.java | 10 +-
.../doris/nereids/mv/IdStatisticsMapTest.java | 3 +-
.../nereids/mv/MtmvCacheNewConnectContextTest.java | 6 +-
.../doris/nereids/mv/MvTableIdIsLongTest.java | 4 +-
.../nereids/mv/OptimizeGetAvailableMvsTest.java | 271 ++++++++++++++++++
.../exploration/mv/PartitionCompensatorTest.java | 187 +++++++++++++
.../org/apache/doris/nereids/util/PlanChecker.java | 12 +-
.../partition_mv_rewrite.out | Bin 2856 -> 4048 bytes
.../unioin_rewrite_grace_big.out} | Bin 2856 -> 3997 bytes
.../mtmv_p0/test_paimon_olap_rewrite_mtmv.groovy | 2 +-
.../suites/mtmv_p0/test_paimon_rewrite_mtmv.groovy | 2 +-
.../mv/availability/grace_period.groovy | 4 +-
.../partition_mv_rewrite.groovy | 293 ++++++++++---------
.../rewrite_duration_exceeded.groovy} | 128 ++++-----
.../unioin_rewrite_grace_big.groovy} | 310 +++++++++++----------
37 files changed, 1554 insertions(+), 706 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/{rules/rewrite/EliminateSortUnderSubqueryOrView.java
=> jobs/executor/TablePartitionCollector.java} (54%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/exploration/mv/PartitionCompensator.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/QueryPartitionCollector.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/mv/OptimizeGetAvailableMvsTest.java
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/nereids/rules/exploration/mv/PartitionCompensatorTest.java
copy regression-test/data/nereids_rules_p0/mv/{ =>
partition_union_rewrite}/partition_mv_rewrite.out (68%)
rename regression-test/data/nereids_rules_p0/mv/{partition_mv_rewrite.out =>
union_rewrite_grace_big/unioin_rewrite_grace_big.out} (69%)
copy regression-test/suites/nereids_rules_p0/mv/{ =>
partition_union_rewrite}/partition_mv_rewrite.groovy (68%)
copy
regression-test/suites/nereids_rules_p0/mv/{direct_query/direct_query.groovy =>
rewrite_duration_exceeded/rewrite_duration_exceeded.groovy} (53%)
rename regression-test/suites/nereids_rules_p0/mv/{partition_mv_rewrite.groovy
=> union_rewrite_grace_big/unioin_rewrite_grace_big.groovy} (67%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
