This is an automated email from the ASF dual-hosted git repository.
924060929 pushed a change to branch fe_local_shuffle_rebase3
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 6c010ad8197 [fix](local shuffle) Route to NereidsCoordinator based on
distributedPlans
discard 3ac8525eaac [doc](local shuffle) DANGER ZONE on sender_count to
prevent repeated mistakes
discard bec9ad46b49 [revert](local shuffle) Roll back the sender_count
std::max patch
discard 065c1865237 [fix](local shuffle) Mirror BE partition_exprs and
sender_count for FE-planned LE
discard 729943679f5 [test](local shuffle) Switch order-sensitive checks to
order_qt_*
discard 4bce60abf79 [fix](local shuffle) Skip LocalExchange under
RecursiveCteNode and mark it serial (DORIS-25865)
discard 4e58f3035d0 [fix](local shuffle) Restore LoadStatistic fileNum
tracking under FE local-shuffle planner
discard b208c094e06 [test](local shuffle) Drop stats-sensitive shape
assertions from test_multilevel_join_agg_local_shuffle
discard b685ab0a4c0 [test](local shuffle) Rewrite LocalExchangePlannerTest
with PlanShape DSL
discard 36f096fb55c [refactor](local shuffle) Move local exchange planning
from BE to FE
add 9b3b9d2c5fc [doc](security) Add threat model for scans (#63447)
add b6d8ef45d7c [chore](be) Document lightweight JSONB validation (#63359)
add 8a8999cf3a5 [refactor](storage) drop StorageField wrapper and clean up
related dead code (#63233)
add c02047ee370 [fix](test) Fix flaky partition_curd_union_rewrite test in
cloud mode (#62766)
add dc5d1398b33 [chore](be) Reject broadcast joins that finalize build
side (#63445)
add b307a23967f [refine](be) remove unsafe PURE annotations (#63440)
add 12f02ebf090 [opt](be) Batch row_id reads in seek_and_read_by_rowid to
reduce column iterator overhead (#63436)
add 4ab7cc02461 [fix](function) support TIMESTAMPDIFF MICROSECOND in
nereids (#63365)
add 974f9bdc89b [opt](sort) avoid copying whole blocks during merge
(#63429)
add 70ca0872d61 [fix](cloud) show proc should display partition cached
version (#60807)
add 58a24298999 [fix](cloud) avoid false tablet diagnosis alarms in cloud
mode (#60805)
add e4238ac87cc [fix](cloud) Fill schema change version holes before
running (#63443)
add f852097a4ff [opt](storage) disable dict encoding in row store columns
(#63438)
add 3da4d2b4669 [fix](test) replace removed JMockit with Mockito in
CloudProcVersionD… (#63473)
add 89da35c208b [refactor](local shuffle) Move local exchange planning
from BE to FE
add 656d321772a [test](local shuffle) Rewrite LocalExchangePlannerTest
with PlanShape DSL
add bcbda135808 [test](local shuffle) Drop stats-sensitive shape
assertions from test_multilevel_join_agg_local_shuffle
add e86efadac6e [fix](local shuffle) Restore LoadStatistic fileNum
tracking under FE local-shuffle planner
add 50af12ef28b [fix](local shuffle) Skip LocalExchange under
RecursiveCteNode and mark it serial (DORIS-25865)
add 469ed844fea [test](local shuffle) Switch order-sensitive checks to
order_qt_*
add f346c695698 [fix](local shuffle) Mirror BE partition_exprs and
sender_count for FE-planned LE
add cec1ba4a809 [revert](local shuffle) Roll back the sender_count
std::max patch
add d0831b9b7b6 [doc](local shuffle) DANGER ZONE on sender_count to
prevent repeated mistakes
add 846d365a889 [fix](local shuffle) Route to NereidsCoordinator based on
distributedPlans
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6c010ad8197)
\
N -- N -- N refs/heads/fe_local_shuffle_rebase3 (846d365a889)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
AGENTS.md | 4 +
be/benchmark/benchmark_zone_map_index.hpp | 4 +-
be/src/cloud/cloud_schema_change_job.cpp | 4 +
be/src/core/binary_cast.hpp | 2 +-
be/src/core/column/column_nullable.h | 5 +-
be/src/core/data_type/data_type_factory.cpp | 5 -
be/src/core/data_type/data_type_factory.hpp | 2 -
.../core/data_type_serde/datelike_serde_common.hpp | 10 +-
be/src/core/string_ref.h | 3 +-
be/src/core/value/map_value.h | 57 --
be/src/core/value/struct_value.h | 61 --
be/src/exec/operator/hashjoin_build_sink.cpp | 6 +
be/src/exec/rowid_fetcher.cpp | 136 ++--
be/src/exec/sort/sort_cursor.h | 5 +
be/src/exec/sort/sorter.cpp | 18 +
be/src/io/cache/cache_block_meta_store.cpp | 2 -
be/src/runtime/collection_value.cpp | 39 -
be/src/runtime/collection_value.h | 80 --
be/src/service/point_query_executor.cpp | 5 +-
be/src/storage/field.h | 382 ----------
be/src/storage/index/ann/ann_index_writer.cpp | 5 -
be/src/storage/index/ann/ann_index_writer.h | 3 -
be/src/storage/index/index_writer.cpp | 21 +-
be/src/storage/index/index_writer.h | 8 +-
.../index/inverted/inverted_index_reader.cpp | 1 -
.../index/inverted/inverted_index_writer.cpp | 54 --
.../storage/index/inverted/inverted_index_writer.h | 2 -
be/src/storage/index/zone_map/zone_map_index.cpp | 6 +-
be/src/storage/index/zone_map/zone_map_index.h | 4 +-
be/src/storage/iterator/olap_data_convertor.cpp | 1 -
be/src/storage/iterator/olap_data_convertor.h | 1 -
.../storage/iterator/vertical_merge_iterator.cpp | 1 -
be/src/storage/iterator/vgeneric_iterators.cpp | 1 -
be/src/storage/olap_common.h | 12 +-
be/src/storage/row_cursor.cpp | 42 +-
be/src/storage/row_cursor.h | 9 +-
be/src/storage/schema.cpp | 24 +-
be/src/storage/schema.h | 11 +-
be/src/storage/schema_change/schema_change.cpp | 9 -
be/src/storage/schema_change/schema_change.h | 1 -
be/src/storage/segment/column_writer.cpp | 170 ++---
be/src/storage/segment/column_writer.h | 36 +-
.../storage/segment/row_binlog_segment_writer.cpp | 2 +-
be/src/storage/segment/segment.cpp | 19 +-
be/src/storage/segment/segment.h | 10 +-
be/src/storage/segment/segment_iterator.cpp | 71 +-
be/src/storage/segment/segment_iterator.h | 6 +-
be/src/storage/segment/segment_writer.cpp | 6 +
.../variant/binary_column_extract_iterator.h | 1 -
.../segment/variant/hierarchical_data_iterator.h | 1 -
.../segment/variant/sparse_column_merge_iterator.h | 1 -
.../segment/variant/variant_column_writer_impl.cpp | 31 +-
.../segment/variant/variant_column_writer_impl.h | 4 +-
.../variant_streaming_compaction_writer.cpp | 3 +-
be/src/storage/segment/vertical_segment_writer.cpp | 6 +
be/src/storage/task/index_builder.cpp | 34 +-
be/src/storage/task/index_builder.h | 12 +-
be/src/storage/types.h | 60 +-
be/src/util/jsonb_document.cpp | 7 +-
be/src/util/jsonb_document.h | 3 +
be/src/util/string_parser.hpp | 3 +-
be/src/util/thrift_util.h | 6 +-
be/test/cloud/cloud_schema_change_job_test.cpp | 109 +++
be/test/cloud/cloud_tablet_test.cpp | 50 ++
be/test/exec/operator/hashjoin_build_sink_test.cpp | 28 +
be/test/exec/operator/sort_operator_test.cpp | 19 +-
be/test/exec/scan/vgeneric_iterators_test.cpp | 1 -
be/test/exec/sort/heap_sorter_test.cpp | 16 +-
be/test/exec/sort/merge_sorter_state.cpp | 67 ++
.../function/cast/function_variant_cast_test.cpp | 1 -
.../load/memtable/memtable_flush_executor_test.cpp | 1 -
.../compaction/ordered_data_compaction_test.cpp | 1 -
.../compaction/vertical_compaction_test.cpp | 1 -
be/test/storage/index/ann/ann_index_smoke_test.cpp | 6 -
.../storage/index/ann/ann_index_writer_test.cpp | 24 +-
.../compaction/util/index_compaction_utils.cpp | 1 +
.../inverted/query/phrase_edge_query_test.cpp | 11 +-
.../inverted/query/phrase_prefix_query_test.cpp | 11 +-
.../index/inverted/query/phrase_query_test.cpp | 11 +-
be/test/storage/metadata_adder_test.cpp | 8 +-
.../storage/segment/column_meta_accessor_test.cpp | 71 ++
.../storage/segment/column_reader_writer_test.cpp | 227 ------
.../storage/segment/inverted_index_array_test.cpp | 46 +-
.../storage/segment/inverted_index_reader_test.cpp | 56 +-
.../storage/segment/inverted_index_writer_test.cpp | 174 ++---
.../storage/segment/segment_corruption_test.cpp | 1 -
be/test/storage/segment/zone_map_index_test.cpp | 52 +-
be/test/storage/storage_types_test.cpp | 87 +--
.../apache/doris/common/proc/IndicesProcDir.java | 4 +-
...ProcDir.java => ProcReplicaVersionDisplay.java} | 33 +-
.../apache/doris/common/proc/ReplicasProcNode.java | 17 +-
.../apache/doris/common/proc/TabletsProcDir.java | 14 +-
.../rules/analysis/DatetimeFunctionBinder.java | 5 +-
.../trees/expressions/literal/Interval.java | 1 +
.../java/org/apache/doris/system/Diagnoser.java | 22 +-
.../doris/clone/TabletReplicaTooSlowTest.java | 97 +++
.../common/proc/CloudProcVersionDisplayTest.java | 200 +++++
.../rules/analysis/DatetimeFunctionBinderTest.java | 10 +
.../data/nereids_syntax_p0/test_timestampdiff.out | 6 +
.../partition_curd_union_rewrite.groovy | 30 +-
.../nereids_syntax_p0/test_timestampdiff.groovy | 28 +
threat-model.md | 806 +++++++++++++++++++++
102 files changed, 2171 insertions(+), 1720 deletions(-)
delete mode 100644 be/src/core/value/map_value.h
delete mode 100644 be/src/core/value/struct_value.h
delete mode 100644 be/src/runtime/collection_value.cpp
delete mode 100644 be/src/runtime/collection_value.h
delete mode 100644 be/src/storage/field.h
copy fe/fe-core/src/main/java/org/apache/doris/common/proc/{BinlogProcDir.java
=> ProcReplicaVersionDisplay.java} (51%)
create mode 100644
fe/fe-core/src/test/java/org/apache/doris/common/proc/CloudProcVersionDisplayTest.java
create mode 100644 threat-model.md
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
