This is an automated email from the ASF dual-hosted git repository.
nicholasjiang pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/celeborn-website.git
The following commit(s) were added to refs/heads/main by this push:
new df64b295e Release 0.6.1 (#112)
df64b295e is described below
commit df64b295ede49d3b0a22ffc2566832bfbbca152a
Author: Nicholas Jiang <[email protected]>
AuthorDate: Wed Sep 10 17:36:51 2025 +0800
Release 0.6.1 (#112)
Co-authored-by: 子懿 <[email protected]>
---
docs/community/news.md | 1 +
docs/community/release_notes/release_note_0.6.1.md | 96 ++++++++++++++++++++++
docs/download.md | 9 +-
3 files changed, 102 insertions(+), 4 deletions(-)
diff --git a/docs/community/news.md b/docs/community/news.md
index 715dde51f..7d2f473c9 100644
--- a/docs/community/news.md
+++ b/docs/community/news.md
@@ -20,6 +20,7 @@ license: |
| Date | Title
| Brief
|
|-------------------|---------------------------------------------------------|---------------------------------------------------------------------------------------------------------------------------------|
+| 2025 September 10 | Release 0.6.1
| Celeborn release 0.6.1.
|
| 2025 July 5 | Release 0.6.0
| Celeborn release 0.6.0.
|
| 2025 May 20 | New Committer: Jiaming Xie
| We are happy to announce Jiaming Xie becomes a new Celeborn committer.
|
| 2025 March 13 | Release 0.5.4
| Celeborn release 0.5.4.
|
diff --git a/docs/community/release_notes/release_note_0.6.1.md
b/docs/community/release_notes/release_note_0.6.1.md
new file mode 100644
index 000000000..b995ee783
--- /dev/null
+++ b/docs/community/release_notes/release_note_0.6.1.md
@@ -0,0 +1,96 @@
+---
+hide:
+ - navigation
+
+license: |
+ Licensed to the Apache Software Foundation (ASF) under one or more
+ contributor license agreements. See the NOTICE file distributed with
+ this work for additional information regarding copyright ownership.
+ The ASF licenses this file to You under the Apache License, Version 2.0
+ (the "License"); you may not use this file except in compliance with
+ the License. You may obtain a copy of the License at
+
+ https://www.apache.org/licenses/LICENSE-2.0
+
+ Unless required by applicable law or agreed to in writing, software
+ distributed under the License is distributed on an "AS IS" BASIS,
+ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+ See the License for the specific language governing permissions and
+ limitations under the License.
+---
+
+# Apache Celeborn™ 0.6.1 Release Notes
+
+## Highlight
+
+- Support to register application info with user identifier and extra info
+- Support celeborn.client.push.maxBytesSizeInFlight
+- Fix the issue where reading replica partition that returns zero chunk causes
tasks to hang
+
+### Improvement
+
+- [CELEBORN-1258] Support to register application info with user identifier
and extra info
+- [CELEBORN-1793] Add netty pinned memory metrics
+- [CELEBORN-1844][FOLLOWUP] alway try to use memory storage if available
+- [CELEBORN-1917] Support celeborn.client.push.maxBytesSizeInFlight
+- [CELEBORN-2044] Proactively cleanup stream state from ChunkStreamManager
when the stream ends
+- [CELEBORN-2056] Make the wait time for the client to read non shuffle
partitions configurable
+- [CELEBORN-2061] Introduce metrics to count the amount of data flushed into
different storage types
+- [CELEBORN-2070][CIP-14] Support MapperEnd/Response in CppClient
+- [CELEBORN-2072] Add missing instance filter to grafana dashboard
+- [CELEBORN-2077] Improve toString by JEP-280 instead of ToStringBuilder
+- [CELEBORN-2081] PushDataHandler onFailure log shuffle key
+- [CELEBORN-2082] Add the log of excluded workers with high workloads
+- [CELEBORN-2083] For `WorkerStatusTracker`, log error for
`recordWorkerFailure`
+- [CELEBORN-2085] Use a fixed buffer for flush copying to reduce GC
+- [CELEBORN-2090] Support Lz4 Decompression in CppClient
+- [CELEBORN-2092] Inc COMMIT_FILES_FAIL_COUNT when TimerWriter::close timeout
+- [CELEBORN-2102] Introduce SorterCacheHitRate metric to monitor the hit reate
of index cache for sorter
+- [CELEBORN-2104] Clean up sources of NettyRpcEnv, Master and Worker to avoid
thread leaks
+- [CELEBORN-2106] CommitFile/Reserved location shows detail primary location
UniqueId
+- [CELEBORN-2108] Remove redundant PartitionType
+- [CELEBORN-2112] Introduce PausePushDataStatus and
PausePushDataAndReplicateStatus metric to record status of pause push data
+- [CELEBORN-2117] Use git submodules for Chart Actions
+- [CELEBORN-2118] Introduce IsHighWorkload metric to monitor worker overload
status
+- [CELEBORN-2122] Avoiding multiple accesses to HDFS when retrieving indexes
in DfsPartitionReader
+- [CELEBORN-2123] Add log for commit file size
+- [CELEBORN-2125] Improve PartitionFilesSorter sort timeout log
+- [CELEBORN-2128] Close hadoopFs FileSystem when worker is closed
+- [CELEBORN-2129] CelebornBufferStream should invoke openStreamInternal in
moveToNextPartitionIfPossible to avoid client creation timeout
+- [CELEBORN-2133] LifecycleManager should log stack trace of Throwable for
invoking appShuffleTrackerCallback
+
+### Stability and Bug Fix
+
+- [CELEBORN-1792][FOLLOWUP] Add missing break in resumeByPinnedMemory
+- [CELEBORN-1844][FOLLOWUP] Fix the condition of StoragePolicy that worker
uses memory storage
+- [CELEBORN-2052] Fix unexpected warning logs in Flink caused by duplicate
BufferStreamEnd messages
+- [CELEBORN-2064] Fix the issue where reading replica partition that returns
zero chunk causes tasks to hang
+- [CELEBORN-2068] TransportClientFactory should close channel explicitly to
avoid resource leak for timeout or failure
+- [CELEBORN-2071] Fix the issue where some gauge metrics were not registered
to the metricRegistry
+- [CELEBORN-2073] Fix PartitionFileSizeBytes metrics
+- [CELEBORN-2075] Fix `OpenStreamTime` metrics for `PbOpenStreamList` request
+- [CELEBORN-2078] Fix wrong grafana metrics units
+- [CELEBORN-2086] S3FlushTask and OssFlushTask should close
ByteArrayInputStream to avoid resource leak
+- [CELEBORN-2088] Fix NPE if `celeborn.client.spark.fetch.cleanFailedShuffle`
enabled
+- [CELEBORN-2100] Fix performance issue on readToReadOnlyBuffer
+- [CELEBORN-2119] DfsTierWriter should close s3MultipartUploadHandler and
ossMultipartUploadHandler for close resource
+- [CELEBORN-2139] Fix the condition for using OSS storage
+
+### Documentation
+
+- [CELEBORN-2135] Rename Blaze to Auron
+- [CELEBORN-2087] Refine the docs configuration table view
+
+### Dependencies
+
+- [CELEBORN-2080] Bump Flink from 1.19.2, 1.20.1 to 1.19.3, 1.20.2
+
+## Credits
+
+Thanks to the following contributors who helped to review and commit to Apache
Celeborn 0.6.1 version:
+
+| Contributors | | | |
| |
+|--------------|---------------|-------------|---------------------|----------------|----------|
+| Ethan Feng | Hao Duan | Jiaming Xie | Mridul Muralidharan | Nicholas
Jiang | Rui Zhuo |
+| Shaoyun Chen | Wang Fei | Xian Zhuang | Xinyu Wang | Xu Huang
| Yang Liu |
+| Zhaohui Xu | Zhengqi Zhang | | |
| |
diff --git a/docs/download.md b/docs/download.md
index 1d515c48f..abac16b9d 100644
--- a/docs/download.md
+++ b/docs/download.md
@@ -24,14 +24,14 @@ license: |
The latest version is {{ stable_version }}.
-### 0.6.0 (2025-07-05)
+### 0.6.1 (2025-09-10)
-[release note](community/release_notes/release_note_0.6.0.md)
+[release note](community/release_notes/release_note_0.6.1.md)
| | Download from ASF
|
Checksum |
Signature |
|:-----------:|:--------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------------:|:------------------------------------------------------------------------------------------------:|
-| Source Code |
[src](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-source.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-source.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-source.tgz.asc)
|
-| Binary |
[bin](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-bin.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-bin.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-bin.tgz.asc)
|
+| Source Code |
[src](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz.asc)
|
+| Binary |
[bin](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz)
|
[sha512](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz.sha512)
|
[asc](https://downloads.apache.org/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-bin.tgz.asc)
|
### 0.5.4 (2025-03-13)
@@ -67,6 +67,7 @@ The latest version is {{ stable_version }}.
All celeborn releases are available via
[https://archive.apache.org/dist/celeborn/](https://archive.apache.org/dist/celeborn/)
including checksums and
signatures. At the time of writing, this includes the following versions:
+* Apache Celeborn 0.6.1 (2025-09-10)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.6.1/apache-celeborn-0.6.1-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.6.1/))
* Apache Celeborn 0.6.0 (2025-07-05)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.6.0/apache-celeborn-0.6.0-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.6.0/))
* Apache Celeborn 0.5.4 (2025-03-13)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.5.4/apache-celeborn-0.5.4-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.5.4/))
* Apache Celeborn 0.5.3 (2025-01-06)
([Source](https://archive.apache.org/dist/celeborn/celeborn-0.5.3/apache-celeborn-0.5.3-source.tgz),
[Binaries](https://archive.apache.org/dist/celeborn/celeborn-0.5.3/))
