This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from 371d7598e4 [Fix](multi catalog)Fix nereids context table always use
internal catalog bug (#21953) (#22063)
new 23daf70a95 [fix](publish) fix check_version_exist coredump (#22038)
new 24cce35bd5 [refactor](mem_reuse) refactor mem_reuse in MutableBlock
(#21564)
new 8530065402 [improvement](multi-catalog)add last sync time for external
catalog (#21873)
new 08662829bf [fix](test) should not create and read internal table when
use mock cluster in UT (#21660)
new 09cb7c1b1c [fix](planner)fix bug of pushing conjuncts into inlineview
(#21962)
new 9e1a519fd7 [refactor](vectorized) Remove useless control variables to
simplify aggregation node code (#22026)
new 38481a4f24 [fix](tablet clone) sched wait slot if has be path (#22015)
new 546e33d2a6 [Enhancement](window-funnel)add different modes for
window_funnel() function (#20563)
new 431b47e4d4 [improve](load) add more profiles in tablets channel
(#21838)
new 54520b12e1 [doc](routineload)add routine load ssl example for access
ali-kafka (#21877)
new 093b10e8f5 [Fix](compaction) Fix SizeBasedCumulativeCompactionPolicy
pick_input_rowsets (#21732)
new 257039c2ba [Fix](compaction) add error message when load unsupport
compression code (#22033)
new d642aa4923 [Fix](json reader) fix rapidjson `array->PushBack` may take
ownership… (#21988)
new 50a7edd8ec [Bug][RegressionTest] fix the DCHECK failed in join code
(#22021)
new 8ac118c9fd [typo](docs) fix some mistake in Doris & Spark Column Type
Mapping (#19998)
new cb4f1b8798 [chore](Nereids) fix typo in some plan visitor (#21830)
new 8e6725b2b0 [fix](log) column index off-by-one error in scanner logs
(#19747)
new 5e8c60002f [enhancement](Nereids) support other join framework in
DPHyper (#21835)
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/exec/exec_node.cpp | 9 +-
be/src/exprs/json_functions.cpp | 6 +-
be/src/olap/cumulative_compaction_policy.cpp | 35 +++-
be/src/olap/tablet.cpp | 1 +
be/src/runtime/tablets_channel.cpp | 5 +
be/src/runtime/tablets_channel.h | 2 +
be/src/util/block_compression.cpp | 4 +-
.../aggregate_function_window_funnel.h | 91 +++++++++--
be/src/vec/common/sort/partition_sorter.cpp | 11 +-
be/src/vec/common/sort/sorter.cpp | 12 +-
.../vec/exec/join/process_hash_table_probe_impl.h | 1 -
be/src/vec/exec/scan/vfile_scanner.cpp | 3 +-
be/src/vec/exec/vaggregation_node.cpp | 178 +++++----------------
be/src/vec/exec/vaggregation_node.h | 15 +-
be/src/vec/exec/vrepeat_node.cpp | 27 +---
be/src/vec/exec/vtable_function_node.cpp | 31 +---
be/src/vec/exec/vunion_node.cpp | 31 +---
be/src/vec/runtime/vsorted_run_merger.cpp | 12 +-
be/src/vec/utils/util.hpp | 33 +++-
.../import/import-way/routine-load-manual.md | 36 ++++-
docs/en/docs/ecosystem/spark-doris-connector.md | 8 +-
.../WINDOW-FUNCTION-WINDOW-FUNNEL.md | 6 +-
.../import/import-way/routine-load-manual.md | 46 ++++--
docs/zh-CN/docs/ecosystem/spark-doris-connector.md | 7 +-
.../WINDOW-FUNCTION-WINDOW-FUNNEL.md | 6 +-
.../java/org/apache/doris/analysis/Analyzer.java | 4 +-
.../org/apache/doris/analysis/ShowCatalogStmt.java | 1 +
.../java/org/apache/doris/catalog/DatabaseIf.java | 4 +
.../doris/catalog/InternalSchemaInitializer.java | 2 +-
.../java/org/apache/doris/catalog/TableIf.java | 4 +
.../doris/catalog/external/ExternalDatabase.java | 15 ++
.../doris/catalog/external/ExternalTable.java | 7 +
.../org/apache/doris/clone/TabletSchedCtx.java | 2 +-
.../org/apache/doris/clone/TabletScheduler.java | 11 +-
.../java/org/apache/doris/common/FeConstants.java | 4 +-
.../apache/doris/common/proc/CatalogsProcDir.java | 4 +-
.../org/apache/doris/common/proc/DbsProcDir.java | 4 +-
.../apache/doris/common/proc/TablesProcDir.java | 4 +-
.../org/apache/doris/datasource/CatalogIf.java | 4 +
.../org/apache/doris/datasource/CatalogMgr.java | 7 +-
.../apache/doris/datasource/ExternalCatalog.java | 16 +-
.../apache/doris/datasource/ExternalObjectLog.java | 3 +
.../apache/doris/datasource/InitCatalogLog.java | 3 +
.../apache/doris/datasource/InitDatabaseLog.java | 3 +
.../org/apache/doris/nereids/StatementContext.java | 11 ++
.../doris/nereids/jobs/executor/Optimizer.java | 8 +-
.../doris/nereids/jobs/joinorder/JoinOrderJob.java | 19 +--
.../jobs/joinorder/hypergraph/HyperGraph.java | 54 ++++++-
.../hypergraph/receiver/PlanReceiver.java | 41 +++--
.../java/org/apache/doris/nereids/memo/Group.java | 14 +-
.../java/org/apache/doris/nereids/memo/Memo.java | 35 ++++
.../org/apache/doris/nereids/rules/RuleSet.java | 1 -
.../doris/nereids/stats/StatsCalculator.java | 8 +-
.../apache/doris/nereids/trees/plans/JoinType.java | 44 +++++
.../trees/plans/logical/LogicalFileSink.java | 2 +-
.../trees/plans/physical/PhysicalFileSink.java | 2 +-
.../org/apache/doris/planner/AggregationNode.java | 1 -
.../apache/doris/planner/SingleNodePlanner.java | 14 +-
.../apache/doris/analysis/ShowCatalogStmtTest.java | 6 +-
...freshTableTest.java => RefreshCatalogTest.java} | 65 ++------
.../{RefreshTableTest.java => RefreshDbTest.java} | 67 ++------
.../org/apache/doris/catalog/RefreshTableTest.java | 78 ++-------
.../apache/doris/common/proc/DbsProcDirTest.java | 12 +-
.../doris/nereids/datasets/tpch/TPCHTestBase.java | 9 --
.../doris/nereids/sqltest/JoinOrderJobTest.java | 24 +++
.../doris/nereids/util/HyperGraphBuilder.java | 2 +-
.../org/apache/doris/nereids/util/PlanChecker.java | 4 +-
.../apache/doris/utframe/TestWithFeService.java | 2 +-
.../org/apache/doris/utframe/UtFrameUtils.java | 4 +-
gensrc/thrift/PlanNodes.thrift | 2 +-
.../data/load_p0/stream_load/test_json_load.out | 3 +
.../data/load_p0/stream_load/with_jsonpath.json | 1 +
.../data/nereids_p0/aggregate/window_funnel.out | 15 ++
.../data/query_p0/aggregate/window_funnel.out | 15 ++
.../test_push_conjuncts_inlineview.groovy | 54 +++++++
.../load_p0/stream_load/test_json_load.groovy | 27 ++++
.../nereids_p0/aggregate/window_funnel.groovy | 161 +++++++++++++++++++
.../suites/query_p0/aggregate/window_funnel.groovy | 162 +++++++++++++++++++
78 files changed, 1109 insertions(+), 576 deletions(-)
copy fe/fe-core/src/test/java/org/apache/doris/catalog/{RefreshTableTest.java
=> RefreshCatalogTest.java} (70%)
copy fe/fe-core/src/test/java/org/apache/doris/catalog/{RefreshTableTest.java
=> RefreshDbTest.java} (67%)
create mode 100644 regression-test/data/load_p0/stream_load/with_jsonpath.json
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
