commits  

Messages by Thread

• (celeborn) branch branch-0.6 updated: [CELEBORN-2218] Bump lz4-java version from 1.8.0 to 1.10.4 to resolve CVE‐2025‐12183 and CVE-2025-66566 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2218] Bump lz4-java version from 1.8.0 to 1.10.4 to resolve CVE‐2025‐12183 and CVE-2025-66566 nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2272] Add LZ4TPCDSDataBenchmark nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2272] Add LZ4TPCDSDataBenchmark nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2270] Fix problem with eviction to tiered storage during partition split nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2049] Bump Ratis version from 3.1.3 to 3.2.1 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2226][CIP-14] Support RetryFetchChunk functionality for Cel… nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2248] Implement lazy loading for columnar shuffle classes and skew shuffle method using static holder pattern nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2248] Implement lazy loading for columnar shuffle classes and skew shuffle method using static holder pattern nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2239] Support Spark 4.1 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2268] Improve test coverage for MEMORY and S3 storage nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2267][FOLLOWUP] Add Cpp-Write Java-Read integration tests for LZ4 and ZSTD nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2222][CIP-14] Support Retrying when createReader failed for CelebornInputStream in CppClient nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2271] StorageManager#saveCommittedFileInfosExecutor should call shutdown before awaitTermination nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2271] StorageManager#saveCommittedFileInfosExecutor should call shutdown before awaitTermination nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2262] Prepare S3 directory only once and cache s3 client for MultiPartUploader rexxiong
• (celeborn) branch main updated: [CELEBORN-2269] Update Cpp TransportClient to resolve hostnames via DNS rexxiong
• (celeborn) branch main updated: [CELEBORN-2266] Modernize Protobuf CMake usage and add install rules nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2265] Do not waste resources on hotpath for debug logging in HashBasedShuffleWriter and SortBasedShuffleWriter nicholasjiang
• (celeborn) branch main updated (eb7a720ac -> 13cd4a923) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2259] The S3MultipartUploadHandler uses fs.s3a.aws.credentials.provider nicholasjiang
• (celeborn) branch branch-0.6 updated (cb0d30089 -> db9585f71) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2063] Parallelize the create partition writer in handleReserveSlots to speed up the reserveSlots RPC process time nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2221][CIP-14] Support writing with compression in C++ client nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2263] Fix IndexOutOfBoundsException while reading from S3 rexxiong
• (celeborn) branch main updated: [CELEBORN-2263] Fix IndexOutOfBoundsException while reading from S3 rexxiong
• (celeborn) branch main updated: [CELEBORN-2256] Helm chart: add support for setting annotations on the service account (to support eks.amazonaws.com/role-arn) nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2256] Helm chart: add support for setting annotations on the service account (to support eks.amazonaws.com/role-arn) nicholasjiang
• (celeborn) branch main updated (ec38fcce3 -> b659439ed) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2254] Fix support for S3 and add a simple integration test nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2254] Fix support for S3 and add a simple integration test nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2205] Introduce metrics to fetch chunk for memory and local disk nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1577][FOLLOWUP] Fix master resource consumption metrics nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1577][FOLLOWUP] Fix master resource consumption metrics nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2250] Fix lock contention in ReducePartitionCommitHandler.finishMapperAttempt via fine-grained locks nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2245] Bump maven 3.9.12 csy
• (celeborn) branch main updated (60ffcbde9 -> 908346128) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2249] Bump Spark from 3.5.7 to 3.5.8 nicholasjiang
• (celeborn) branch main updated: CELEBORN #2249] Bump Spark from 3.5.7 to 3.5.8 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2211] Avoid allocating additional buffers When HdfsFlushTask writes data nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2243][FOLLOWUP][SPARK-2] During the close phase of hashWriter, pushData and mergeData are sent in parallel nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2243][FOLLOWUP][SPARK-2] During the close phase of hashWriter, pushData and mergeData are sent in parallel nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2229][CIP-14] Add support for celeborn.client.push.maxBytesSizeInFlight in CppClient rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2243] During the close phase of hashWriter, pushData and mergeData are sent in parallel nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2243] During the close phase of hashWriter, pushData and mergeData are sent in parallel nicholasjiang
• (celeborn-website) branch dependabot/pip/urllib3-2.6.3 created (now 5038e9e5) github-bot
• (celeborn) branch main updated: [CELEBORN-2235][CIP-14] Adapt Java end's serialization to CppWriterClient rexxiong
• (celeborn) branch main updated: [CELEBORN-2210] When a flushBuffer consolidation OOM exception occurs… rexxiong
• (celeborn) branch main updated: [CELEBORN-2236] Avoiding regular expressions for DiskFileInfo storage type determination rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2166][FOLLOWUP] Update config celeborn.client.shuffleDataLostOnUnknownWorker.enabled version to 0.6.3 feiwang
• (celeborn) branch main updated: [CELEBORN-2166][FOLLOWUP] Update config celeborn.client.shuffleDataLostOnUnknownWorker.enabled version to 0.6.3 feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2166] Fast fail reduce stage if shuffle data is lost because of worker lost feiwang
• (celeborn) branch main updated: [CELEBORN-2240] Adapt to SPARK-51756 which add a new parameter `checksumValue` in `MapStatus.apply` chengpan
• (celeborn-website) branch dependabot/pip/pymdown-extensions-10.16.1 created (now 91e0f8da7) github-bot
• (celeborn) branch branch-0.6 updated (4db362613 -> 693acedb9) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2231] Upgrade jersey version to 2.47 to fix CVE-2025-12383 nicholasjiang
• (celeborn) branch branch-0.6 updated (8295bf36b -> 4db362613) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2231] Upgrade jersey version to 2.47 to fix CVE-2025-12383 nicholasjiang
• (celeborn) branch main updated (345cb3b67 -> ac8cffbb0) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2231] Upgrade jersey version to 2.47 to fix CVE-2025-12383 nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2231] Upgrade jersey version to 2.47 to fix CVE-2025-12383 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2231] Upgrade jersey version to 2.47 to fix CVE-2025-12383 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2217] Use a separate thread to handle RpcEndpointVerifier messages rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-1577][FOLLOWUP] Fix addGauge error in registerUserResourceCons… nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1577][FOLLOWUP] Fix addGauge error in registerUserResourceCons… nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2212] Optimize the sorting efficiency of memoryWriters when evicting the largest memory file nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2212] Optimize the sorting efficiency of memoryWriters when evicting the largest memory file nicholasjiang
• (celeborn) branch main updated (22336992a -> 36d6b0cba) nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2214] Add extraInitContainers for worker in helm nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2214] Add extraInitContainers for worker in helm nicholasjiang
• (celeborn) branch main updated (329250ec0 -> d546398a4) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2234] Bump jetty version to 9.4.58.v20250814 to fix GHSA-qh8g-58pp-2wxh nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2234] Bump jetty version to 9.4.58.v20250814 to fix GHSA-qh8g-58pp-2wxh nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2234] Bump jetty version to 9.4.58.v20250814 to fix GHSA-qh8g-58pp-2wxh nicholasjiang
• (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
  • (celeborn-website) 01/17: gitignore github-bot
• (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot
  • (celeborn-website) 17/17: .asf.yaml github-bot

• Earlier messages