mrhhsg commented on code in PR #61535:
URL: https://github.com/apache/doris/pull/61535#discussion_r3007177649
##########
fe/fe-core/src/main/java/org/apache/doris/qe/SessionVariable.java:
##########
@@ -1282,6 +1285,20 @@ public void checkQuerySlotCount(String slotCnt) {
@VariableMgr.VarAttr(name = BROKER_LOAD_BATCH_SIZE, fuzzy = true, checker
= "checkBatchSize")
public int brokerLoadBatchSize = 16352;
+ // Target output block size in bytes for adaptive batch size. 0 disables
the byte limit.
+ // Default 8MB. Passed to storage layer to control how many rows each
SegmentIterator chunk
+ // should contain so the final Block stays near this size.
+ @VariableMgr.VarAttr(name = PREFERRED_BLOCK_SIZE_BYTES, needForward = true,
+ description = {"目标输出 Block 字节数上限，自适应 batch size 功能使用，0 表示不限制，默认
8MB",
+ "Target output block size in bytes for adaptive batch size. 0
disables the limit. Default 8MB."})
+ public long preferredBlockSizeBytes = 8388608L; // 8MB
+
+ // Per-column byte limit when computing adaptive chunk rows. 0 disables
the per-column limit.
+ @VariableMgr.VarAttr(name = PREFERRED_MAX_COLUMN_IN_BLOCK_SIZE_BYTES,
needForward = true,
+ description = {"自适应 batch size 时单列字节数上限，0 表示不限制，默认 1MB",
+ "Per-column byte limit for adaptive batch size. 0 disables
per-column limit. Default 1MB."})
+ public long preferredMaxColumnInBlockSizeBytes = 1048576L; // 1MB
Review Comment:
控制 block 中某个字段不要太大造成 cache miss
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
