This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn-website.git
The following commit(s) were added to refs/heads/main by this push:
new b0d8b1596 Release 0.6.2 (#118)
b0d8b1596 is described below
commit b0d8b15968ce9817c3e51e144a3dece6dabbbb9c
Author: Nicholas Jiang <[email protected]>
AuthorDate: Mon Dec 8 15:03:56 2025 +0800
Release 0.6.2 (#118)
---
.github/workflows/site.yaml | 1 +
docs/community/news.md | 1 +
docs/community/release_notes/release_note_0.6.2.md | 84 ++++++++++++++++++++++
docs/download.md | 9 +--
4 files changed, 91 insertions(+), 4 deletions(-)
diff --git a/.github/workflows/site.yaml b/.github/workflows/site.yaml
index 2d3688e6d..ac4c5f6de 100644
--- a/.github/workflows/site.yaml
+++ b/.github/workflows/site.yaml
@@ -64,6 +64,7 @@ jobs:
- run: ./.github/bin/build_docs.sh 'tags/v0.5.4.tar.gz' '0.5.4'
- run: ./.github/bin/build_docs.sh 'tags/v0.6.0.tar.gz' '0.6.0'
- run: ./.github/bin/build_docs.sh 'tags/v0.6.1.tar.gz' '0.6.1'
+ - run: ./.github/bin/build_docs.sh 'tags/v0.6.2.tar.gz' '0.6.2'
- run: |
echo 'publish:' >> .asf.yaml
echo ' whoami: asf-site' >> .asf.yaml
diff --git a/docs/community/news.md b/docs/community/news.md
index b7e1bf207..f210b0f37 100644
--- a/docs/community/news.md
+++ b/docs/community/news.md
@@ -20,6 +20,7 @@ license: |
| Date | Title
| Brief
|
|-------------------|---------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------|
+| 2025 December 8 | Release 0.6.2
| Celeborn release 0.6.2.
|
| 2025 December 3 | New Committer: Erik Fang
| We are happy to announce Erik Fang becomes a new Celeborn committer.
|
| 2025 September 10 | Release 0.6.1
| Celeborn release 0.6.1.
|
| 2025 July 5 | Release 0.6.0
| Celeborn release 0.6.0.
|
diff --git a/docs/community/release_notes/release_note_0.6.2.md
b/docs/community/release_notes/release_note_0.6.2.md
new file mode 100644
index 000000000..5cd7d23a2
--- /dev/null
+++ b/docs/community/release_notes/release_note_0.6.2.md
@@ -0,0 +1,84 @@
+---
+hide:
+ - navigation
+
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ https://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+---
+
+# Apache Celeborn™ 0.6.2 Release Notes
+
+## Highlight
+
+- Introduce end to end integrity checks
+- Fix uncaught exception in DataPusher
+- Throw IOException when compressed data header corrupted
+
+### Correctness
+
+- [CELEBORN-2176] Fix uncaught exception in DataPusher
+- [CELEBORN-2200] Throw IOException when compressed data header corrupted
+
+### Improvement
+
+- [CELEBORN-474] PushState uses JavaUtils#newConcurrentHashMap to speed up
ConcurrentHashMap#computeIfAbsent
+- [CELEBORN-894] End to End Integrity Checks
+- [CELEBORN-1258] Introduce --show-cluster-apps-info master command to show
cluster application's info
+- [CELEBORN-2131] Add sorting duration logs in FileSorter
+- [CELEBORN-2152] Support merge buffers on the worker side to improve memory
utilization
+- [CELEBORN-2154] Optimize the exception handling of DFS read to avoid tasks
from getting stuck
+- [CELEBORN-2155] Avoid using duplicate diskFileInfoMap functions
+- [CELEBORN-2170] Refactor ByteBuffer's readToReadOnlyuffer interface
+- [CELEBORN-2178] Close hadoopFs FileSystem for stopping master
+- [CELEBORN-2181] Modify the shuffleAllocations order in the disk info log
+- [CELEBORN-2188] Abort multipart upload for S3 and OSS in
DfsTierWriter#handleException
+- [CELEBORN-2189] Allow config worker pod terminationGracePeriodSeconds in
chart
+- [CELEBORN-2192] ReadBufferDispatcher should add timeout constraints to fast
fail in case of timeout
+- [CELEBORN-2195] Align log4j2.xml and metrics.properties of charts with
templates
+- [CELEBORN-2198] Fix NPE in tryWithTimeoutAndCallback test due to lazy
deviceCheckThreadPool not initialized
+- [CELEBORN-2203] Set celeborn.master.internal.endpoints in the configmap
+- [CELEBORN-2208] Log the partition reader wait time if exceeds the threshold
+
+### Stability and Bug Fix
+
+- [CELEBORN-1983] Fix fetch fail not throw due to reach spark maxTaskFailures
+- [CELEBORN-2032] Create reader should change to peer by taskAttemptId'
+- [CELEBORN-2105] RpcMetricsTracker should clean up metrics for stopping Inbox
+- [CELEBORN-2142] DfsTierWriter should create for unavailable disks
+- [CELEBORN-2150] Fix the match condition in checkIfWorkingDirCleaned
+- [CELEBORN-2153] Fix NPE problem that occurs during concurrent merge
+- [CELEBORN-2159] Fix dfs storage type check in
StorageManager#cleanupExpiredShuffleKey
+- [CELEBORN-2163] PushDataHandler should increment WriteDataFailCount for file
writer exception of MapPartition PushData
+- [CELEBORN-2164] Fix incorrect filtering conditions in updateDiskInfos
+- [CELEBORN-2165] Fix endless swagger openapi.json security items
+- [CELEBORN-2171] Fix array index error in submitRetryPushMergedData
+- [CELEBORN-2180] Fix Invalid RequestId during RegisterApplicationInfo
+
+### Dependencies
+
+- [CELEBORN-2167] Bump Spark from 3.5.6 to 3.5.7
+- [CELEBORN-2168] Bump Flink from 1.20.2 to 1.20.3
+- [CELEBORN-2173] jersey-test-framework-core dependency should exclude junit5
dependencies to execute java test cases for CI
+
+## Credits
+
+Thanks to the following contributors who helped to review and commit to Apache
Celeborn 0.6.2 version:
+
+| Contributors | | | | |
|
+|---------------|--------------|-------------|--------------|----------------|----------------|
+| Gaurav Mittal | Hai Zhou | Jiaming Xie | Jianfu Li | JuniverseCoder |
Nicholas Jiang |
+| Ping Zhang | Shaoyun Chen | Wang Fei | Xianming Lei | Yanze Jiang |
Zhaohui Xu |
+| Zhengqi Zhang | | | | |
|
diff --git a/docs/download.md b/docs/download.md
index abac16b9d..7b904cde6 100644
--- a/docs/download.md
+++ b/docs/download.md
@@ -24,14 +24,14 @@ license: |
The latest version is {{ stable_version }}.
-### 0.6.1 (2025-09-10)
+### 0.6.2 (2025-12-08)
-[release note](community/release_notes/release_note_0.6.1.md)
+[release note](community/release_notes/release_note_0.6.2.md)
| | Download from ASF
|
Checksum |
Signature |
|:-----------:|:--------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------:|
-| Source Code |
[src](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz.asc)
|
-| Binary |
[bin](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz.asc)
|
+| Source Code |
[src](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-source.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-source.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-source.tgz.asc)
|
+| Binary |
[bin](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-bin.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-bin.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-bin.tgz.asc)
|
### 0.5.4 (2025-03-13)
@@ -67,6 +67,7 @@ The latest version is {{ stable_version }}.
All celeborn releases are available via
[https://archive.apache.org/dist/celeborn/](https://archive.apache.org/dist/celeborn/)
including checksums and
signatures. At the time of writing, this includes the following versions:
+* Apache Celeborn 0.6.2 (2025-12-08)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.6.2/apache-celeborn-0.6.2-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.6.2/))
* Apache Celeborn 0.6.1 (2025-09-10)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.6.1/))
* Apache Celeborn 0.6.0 (2025-07-05)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.6.0/))
* Apache Celeborn 0.5.4 (2025-03-13)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.5.4/apache-celeborn-0.5.4-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.5.4/))
