This is an automated email from the ASF dual-hosted git repository.
gavinchou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new eab260e3368 [Enhancement](Snapshot) Add migrate and compact parallel
config (#58935)
eab260e3368 is described below
commit eab260e33689a6174af42d75394c64c86e97a404
Author: abmdocrt <[email protected]>
AuthorDate: Sat Dec 13 00:00:11 2025 +0800
[Enhancement](Snapshot) Add migrate and compact parallel config (#58935)
---
cloud/src/common/config.h | 12 ++++++++++++
1 file changed, 12 insertions(+)
diff --git a/cloud/src/common/config.h b/cloud/src/common/config.h
index e465e786600..f085ce04244 100644
--- a/cloud/src/common/config.h
+++ b/cloud/src/common/config.h
@@ -388,6 +388,18 @@ CONF_Bool(enable_snapshot_data_migrator, "false");
CONF_Bool(enable_snapshot_chain_compactor, "false");
CONF_Int32(snapshot_data_migrator_concurrent, "2");
CONF_Int32(snapshot_chain_compactor_concurrent, "2");
+// Parallelism for snapshot migration and compaction operations
+//
+// When to adjust:
+// - Increase (to 20-50): Large-scale migrations (>10K tablets), sufficient
resources
+// - Decrease (to 1-5): Memory/CPU constrained, high FDB conflict rate
+//
+// Cost of higher parallelism:
+// - Increases memory usage (transaction buffers, caches)
+// - Increases CPU usage (proportional to parallelism)
+// - Increases FDB load and may raise conflict rate
+CONF_Int32(snapshot_migrate_parallelism, "2");
+CONF_Int32(snapshot_compact_parallelism, "2");
CONF_mString(aws_credentials_provider_version, "v2");
CONF_Validator(aws_credentials_provider_version,
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
