This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a commit to branch branch-4.1
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/branch-4.1 by this push:
new f27a1e5b9eb [fix](scan) Fix adaptive load batch sizing (#63245)
f27a1e5b9eb is described below
commit f27a1e5b9ebb3e177aafbb0222084f71b5c4e5fd
Author: Jerry Hu <[email protected]>
AuthorDate: Fri May 15 15:57:00 2026 +0800
[fix](scan) Fix adaptive load batch sizing (#63245)
## Summary
Related PR: #63005
- update the file scan load path to feed converted blocks into adaptive
batch size prediction before and after varchar truncation
## Root Cause
The load path initialized adaptive batch sizing but did not update the
predictor after converting loaded source blocks. As a result, the reader
could keep using the initial small probe size.
## Validation
- `git diff --check`
- `git diff --cached --check`
- `./run-regression-test.sh --run -d unique_with_mow_c_p0 -s
test_compact_with_seq2`
---
be/src/exec/scan/file_scanner.cpp | 2 ++
1 file changed, 2 insertions(+)
diff --git a/be/src/exec/scan/file_scanner.cpp
b/be/src/exec/scan/file_scanner.cpp
index d97f5a9ae95..c443a44f9a7 100644
--- a/be/src/exec/scan/file_scanner.cpp
+++ b/be/src/exec/scan/file_scanner.cpp
@@ -610,7 +610,9 @@ Status FileScanner::_get_block_wrapped(RuntimeState* state,
Block* block, bool*
RETURN_IF_ERROR(_convert_to_output_block(block));
// Truncate char columns or varchar columns if size is smaller
than file columns
// or not found in the file column schema.
+ _update_adaptive_batch_size_before_truncate(*block);
RETURN_IF_ERROR(_truncate_char_or_varchar_columns(block));
+ _update_adaptive_batch_size_after_truncate(*block);
}
}
break;
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
