Yukang-Lian opened a new pull request, #67597:
URL: https://github.com/apache/doris/pull/67597
### What problem does this PR solve?
Issue Number: None
Related PR: #65963
Problem Summary: Backport #65963 to `branch-3.1`.
Vertical compaction kept exhausted segment iterator contexts and
dictionary/block memory alive until all value-column groups finished. This
change tracks final row-source consumption and releases exhausted contexts
immediately, while adding active/peak context diagnostics and regression
coverage.
The backport adapts the storage/iterator versus olap/vec source layout and
preserves the target branch APIs. Branches without `use_insert_order_when_same`
retain their existing ordering behavior.
### Release note
Release exhausted segment contexts during vertical compaction to bound
retained memory.
### Check List (For Author)
- Test: Static validation
- Clang Format 16 `--dry-run --Werror`: passed for all changed C++ files
- `git diff --check`: passed
- Changed-file scope, latest base, and cherry-pick provenance verified
- Focused local compilation was attempted on branch-4.1, but the
available generated Thrift/Protobuf headers did not match this branch; hosted
CI is pending
- Behavior changed: Yes
- Releases a segment context after its final row-source reference is
consumed
- Adds active and peak segment-context diagnostics
- Does this need documentation: No
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
