This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch branch-0.6
in repository https://gitbox.apache.org/repos/asf/celeborn.git
The following commit(s) were added to refs/heads/branch-0.6 by this push:
new c778a2c0a [MINOR] Fix config doc about DB description
c778a2c0a is described below
commit c778a2c0adeadee5ba7095be35b9954075138acb
Author: sychen <[email protected]>
AuthorDate: Tue Sep 23 10:24:07 2025 +0800
[MINOR] Fix config doc about DB description
### What changes were proposed in this pull request?
### Why are the changes needed?
Config doc only mentions LevelDB. In fact, the configuration is effective
for both LevelDB or RocksDB.
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?
Closes #3489 from cxzl25/minor_doc_level.
Authored-by: sychen <[email protected]>
Signed-off-by: SteNicholas <[email protected]>
(cherry picked from commit 834fab2cb7d41b72000d3840cb93fcbecab34ccc)
Signed-off-by: SteNicholas <[email protected]>
---
common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala | 4 ++--
docs/configuration/worker.md | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
diff --git
a/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
b/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
index 2e517ed5c..e31206dc2 100644
--- a/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
+++ b/common/src/main/scala/org/apache/celeborn/common/CelebornConf.scala
@@ -3844,7 +3844,7 @@ object CelebornConf extends Logging {
val WORKER_GRACEFUL_SHUTDOWN_SAVE_COMMITTED_FILEINFO_INTERVAL:
ConfigEntry[Long] =
buildConf("celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval")
.categories("worker")
- .doc("Interval for a Celeborn worker to flush committed file infos into
Level DB.")
+ .doc("Interval for a Celeborn worker to flush committed file infos into
DB.")
.version("0.3.1")
.timeConf(TimeUnit.MILLISECONDS)
.createWithDefaultString("5s")
@@ -3853,7 +3853,7 @@ object CelebornConf extends Logging {
buildConf("celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync")
.categories("worker")
.doc(
- "Whether to call sync method to save committed file infos into Level
DB to handle OS crash.")
+ "Whether to call sync method to save committed file infos into DB to
handle OS crash.")
.version("0.3.1")
.booleanConf
.createWithDefault(false)
diff --git a/docs/configuration/worker.md b/docs/configuration/worker.md
index 72343249e..a63d213fe 100644
--- a/docs/configuration/worker.md
+++ b/docs/configuration/worker.md
@@ -103,8 +103,8 @@ license: |
| celeborn.worker.graceful.shutdown.partitionSorter.shutdownTimeout | 120s |
false | The wait time of waiting for sorting partition files during worker
graceful shutdown. | 0.2.0 | |
| celeborn.worker.graceful.shutdown.recoverDbBackend | ROCKSDB | false |
Specifies a disk-based store used in local db. ROCKSDB or LEVELDB (deprecated).
| 0.4.0 | |
| celeborn.worker.graceful.shutdown.recoverPath | <tmp>/recover | false
| The path to store DB. | 0.2.0 | |
-| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval | 5s |
false | Interval for a Celeborn worker to flush committed file infos into Level
DB. | 0.3.1 | |
-| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync | false | false
| Whether to call sync method to save committed file infos into Level DB to
handle OS crash. | 0.3.1 | |
+| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.interval | 5s |
false | Interval for a Celeborn worker to flush committed file infos into DB. |
0.3.1 | |
+| celeborn.worker.graceful.shutdown.saveCommittedFileInfo.sync | false | false
| Whether to call sync method to save committed file infos into DB to handle OS
crash. | 0.3.1 | |
| celeborn.worker.graceful.shutdown.timeout | 600s | false | The worker's
graceful shutdown timeout time. | 0.2.0 | |
| celeborn.worker.http.auth.administers | | false | A comma-separated list of
users who have admin privileges, Note, when
celeborn.worker.http.auth.supportedSchemes is not set, everyone is treated as
administrator. | 0.6.0 | |
| celeborn.worker.http.auth.basic.provider |
org.apache.celeborn.common.authentication.AnonymousAuthenticationProviderImpl |
false | User-defined password authentication implementation of
org.apache.celeborn.common.authentication.PasswdAuthenticationProvider | 0.6.0
| |