This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn.git
The following commit(s) were added to refs/heads/main by this push:
new 834fab2cb [MINOR] Fix config doc about DB description
834fab2cb is described below
commit 834fab2cb7d41b72000d3840cb93fcbecab34ccc
Author: sychen <[email protected]>
AuthorDate: Tue Sep 23 10:24:07 2025 +0800
[MINOR] Fix config doc about DB description
### What changes were proposed in this pull request?
### Why are the changes needed?
Config doc only mentions LevelDB. In fact, the configuration is effective
for both LevelDB or RocksDB.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
Closes #3489 from cxzl25/minor_doc_level.
Authored-by: sychen <[email protected]>
Signed-off-by: SteNicholas <[email protected]>
---
common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala | 4 ++--
docs/configuration/worker.md | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git
a/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
b/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
index 9b2d044aa..8d1b26dd2 100644
--- a/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
+++ b/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
@@ -3901,7 +3901,7 @@ object CelebornConf extends Logging {
val WORKER_GRACEFUL_SHUTDOWN_SAVE_COMMITTED_FILEINFO_INTERVAL:
ConfigEntry[Long] =
buildConf("celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval")
.categories("worker")
- .doc("Interval for a Celeborn worker to flush committed file infos into
Level DB.")
+ .doc("Interval for a Celeborn worker to flush committed file infos into
DB.")
.version("0.3.1")
.timeConf(TimeUnit.MILLISECONDS)
.createWithDefaultString("5s")
@@ -3910,7 +3910,7 @@ object CelebornConf extends Logging {
buildConf("celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync")
.categories("worker")
.doc(
- "Whether to call sync method to save committed file infos into Level
DB to handle OS crash.")
+ "Whether to call sync method to save committed file infos into DB to
handle OS crash.")
.version("0.3.1")
.booleanConf
.createWithDefault(false)
diff --git a/docs/configuration/worker.md b/docs/configuration/worker.md
index 4c688fff3..b48a254eb 100644
--- a/docs/configuration/worker.md
+++ b/docs/configuration/worker.md
@@ -103,8 +103,8 @@ license: |
| celeborn.worker.graceful.shutdown.partitionSorter.shutdownTimeout | 120s |
false | The wait time of waiting for sorting partition files during worker
graceful shutdown. | 0.2.0 | |
| celeborn.worker.graceful.shutdown.recoverDbBackend | ROCKSDB | false |
Specifies a disk-based store used in local db. ROCKSDB or LEVELDB (deprecated).
| 0.4.0 | |
| celeborn.worker.graceful.shutdown.recoverPath | <tmp>/recover | false
| The path to store DB. | 0.2.0 | |
-| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval | 5s |
false | Interval for a Celeborn worker to flush committed file infos into Level
DB. | 0.3.1 | |
-| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync | false | false
| Whether to call sync method to save committed file infos into Level DB to
handle OS crash. | 0.3.1 | |
+| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval | 5s |
false | Interval for a Celeborn worker to flush committed file infos into DB. |
0.3.1 | |
+| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync | false | false
| Whether to call sync method to save committed file infos into DB to handle OS
crash. | 0.3.1 | |
| celeborn.worker.graceful.shutdown.timeout | 600s | false | The worker's
graceful shutdown timeout time. | 0.2.0 | |
| celeborn.worker.hdfs.replication.factor | 2 | false | HDFS replication
factor for shuffle files. | 0.7.0 | |
| celeborn.worker.http.auth.administers | | false | A comma-separated list of
users who have admin privileges, Note, when
celeborn.worker.http.auth.supportedSchemes is not set, everyone is treated as
administrator. | 0.6.0 | |