This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from d3e1baddeb [feature](branch-2.0) add failure tolerance for strict mode
partial update stream load (#22100)
new 95606570d6 [enhancement](config) enlarge max_bytes_per_broker_scanner
to 5G #22099
new 9ddbf200cd [bug](node) fix partiton sort node core dump when eos
(#22108)
new 791196054b [fix](partial-update) fix update core for merge-on-write
table (#22090)
new db5300fba4 fix(compaction) release the block and segment iterator
after reading to the end of the segment file (#22082)
new 7d019152f5 [improvement](iceberg) Optimize the split to the
user-specified size #22078
new efb699a463 [refactor](be) use std::move to improve performance of
push_back #22056
new d363007e90 [Bug][Colocate] when adding a table to the colocate group,
we should check that the number of buckets per partition is the same (#21906)
new 1e60089d3b [improvement](spark-load) support datev2 and datetimev2
#21839
new 3b4dbcafc2 [fix](docs) update version since of stream load
enable_profile (#21786)
new 3c6676ce2e [Improvement](pipeline) support send eos on local exchange
and remove some unused code (#22086)
new 31316cd41e [Fix](planner) fix rewritten alias function's original
function is not analyzed again (#21497)
new d7521ed7f4 [Fix](Nereids)fix insert into default value exception
(#21924)
new 29f45eaf04 [Fix](Sonar)Fix Java heap space error (#22135)
new 3a710117b8 [fix](in) throw exception for unsupported data type of in
expr (#22050)
new 5cad1861e5 [enhance](nereids) enable wf partition topn by default
(#21860)
new 054c573cf4 [Fix](binlog) Fix bugs in tombstone (#22031)
new bff1ea378e [fix](inverted index) fix regression case
test_index_change_7 occasional failure (#22066)
new 8eb75c34ab [fix](Nereids) remove double sigature of ceil, floor and
round (#22134)
new 94a7c7f8e3 [opt](Nereids) check multiple distinct functions that
cannot be transformed into muti_distinct (#21626)
new 056374e126 [opt](filecache) use weak_ptr to cache the file handle of
file segment (#21975)
new 11b6dbfab9 [enhancement](config) Enlarge broker scanner bytes conf to
500G, 5G is still not enough (#22126)
The 21 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/sonarcloud.yml | 2 +-
be/src/common/config.cpp | 1 +
be/src/common/config.h | 2 +
be/src/exec/olap_common.h | 14 +-
be/src/exprs/create_predicate_function.h | 3 +-
be/src/io/cache/block/block_file_cache.cpp | 43 +++++
be/src/io/cache/block/block_file_cache.h | 25 +++
be/src/io/cache/block/block_file_segment.cpp | 26 +--
be/src/io/cache/block/block_file_segment.h | 6 +-
be/src/io/cache/block/block_lru_file_cache.cpp | 3 +
be/src/io/cache/block/block_lru_file_cache.h | 1 +
be/src/olap/rowset/segment_v2/segment_writer.cpp | 4 +-
be/src/olap/tablet.cpp | 9 +-
be/src/olap/tablet.h | 3 +-
be/src/pipeline/exec/exchange_source_operator.cpp | 1 -
be/src/runtime/fragment_mgr.cpp | 2 +-
be/src/service/brpc_service.cpp | 2 +-
be/src/service/internal_service.cpp | 17 +-
be/src/service/internal_service.h | 2 +-
be/src/util/proto_util.h | 56 ------
be/src/vec/columns/column_complex.h | 3 +-
be/src/vec/exec/vexchange_node.h | 1 -
be/src/vec/exec/vpartition_sort_node.cpp | 6 +-
be/src/vec/functions/match.h | 10 +-
be/src/vec/olap/vertical_merge_iterator.cpp | 11 +-
be/src/vec/sink/vdata_stream_sender.cpp | 16 +-
be/src/vec/sink/vdata_stream_sender.h | 12 +-
be/test/io/cache/file_block_cache_test.cpp | 144 +++++++++++++++
be/test/vec/exec/vtablet_sink_test.cpp | 2 -
be/test/vec/runtime/vdata_stream_test.cpp | 2 -
docs/en/docs/admin-manual/config/fe-config.md | 2 +-
.../import/import-way/broker-load-manual.md | 2 +-
.../import/import-way/stream-load-manual.md | 2 +-
docs/zh-CN/docs/admin-manual/config/fe-config.md | 2 +-
.../import/import-way/broker-load-manual.md | 2 +-
.../import/import-way/stream-load-manual.md | 2 +-
.../main/java/org/apache/doris/common/Config.java | 2 +-
.../apache/doris/analysis/FunctionCallExpr.java | 5 +-
.../apache/doris/analysis/NativeInsertStmt.java | 12 +-
.../java/org/apache/doris/analysis/SelectStmt.java | 3 +-
.../org/apache/doris/binlog/BinlogTombstone.java | 48 +++--
.../java/org/apache/doris/binlog/DBBinlog.java | 84 ++++-----
.../java/org/apache/doris/binlog/TableBinlog.java | 35 ++--
.../apache/doris/catalog/ColocateGroupSchema.java | 5 +
.../doris/nereids/jobs/executor/Rewriter.java | 3 +
.../nereids/rules/rewrite/CheckMultiDistinct.java | 62 +++++++
.../trees/expressions/functions/scalar/Ceil.java | 2 -
.../trees/expressions/functions/scalar/Dceil.java | 2 -
.../trees/expressions/functions/scalar/Dfloor.java | 2 -
.../trees/expressions/functions/scalar/Dround.java | 3 -
.../trees/expressions/functions/scalar/Floor.java | 2 -
.../trees/expressions/functions/scalar/Round.java | 3 -
.../expressions/functions/scalar/RoundBankers.java | 3 -
.../expressions/functions/scalar/Truncate.java | 2 -
.../planner/external/iceberg/IcebergScanNode.java | 24 ++-
.../java/org/apache/doris/qe/SessionVariable.java | 2 +-
.../doris/rewrite/RewriteAliasFunctionRule.java | 2 +-
.../org/apache/doris/analysis/InsertStmtTest.java | 8 +-
.../doris/nereids/trees/expressions/UdfTest.java | 9 +-
.../apache/doris/load/loadv2/dpp/ColumnParser.java | 6 +-
.../org/apache/doris/load/loadv2/dpp/DppUtils.java | 4 +
.../data/nereids_function_p0/scalar_function/D.out | 200 ++++++++++-----------
.../data/nereids_function_p0/scalar_function/R.out | 192 ++++++++++----------
.../nereids_tpcds_shape_sf100_p0/shape/query44.out | 52 +++---
.../nereids_tpcds_shape_sf100_p0/shape/query67.out | 35 ++--
.../nereids_tpcds_shape_sf100_p0/shape/query70.out | 27 +--
.../sql_functions/math_functions/test_round.out | 13 +-
.../test_partial_update_schema_change.out} | 12 +-
.../index_change/test_index_change_7.groovy | 25 +--
.../suites/nereids_syntax_p0/analyze_agg.groovy | 5 +
.../query_p0/sql_functions/test_in_expr.groovy | 85 +++++++++
.../test_partial_update_schema_change.groovy | 55 ++++++
72 files changed, 938 insertions(+), 537 deletions(-)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/CheckMultiDistinct.java
copy regression-test/data/{bitmap_functions/test_bitmap_intersect.out =>
unique_with_mow_p0/partial_update/test_partial_update_schema_change.out} (76%)
create mode 100644
regression-test/suites/unique_with_mow_p0/partial_update/test_partial_update_schema_change.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
