commits  

Messages by Thread

• (celeborn) branch main updated: [CELEBORN-2508] Fail safely after AQE integrity validation errors nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2508] Fail safely after AQE integrity validation errors nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2493] Complete integrity validation for empty AQE chunk splits nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2493] Complete integrity validation for empty AQE chunk splits nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2392] Prevent false shuffle expiry during concurrent registration nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2392] Prevent false shuffle expiry during concurrent registration nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2434] Clamp endMapIndex in sliceSortedBufferByMapRange zaynt
• (celeborn) branch main updated: [CELEBORN-2505][UI] Reorder and collapse sections in the Spark UI Celeborn tab zaynt
• (celeborn) branch main updated: [CELEBORN-2504] Bump Spark from 3.5.8 to 3.5.9 zaynt
• (celeborn) branch main updated: [CELEBORN-2503] Bump Ratis version from 3.3.0 to 3.3.1 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2502] Swap DataPusher buffers instead of copying pushed data nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2485] Fix disk file cleanup for mixed-storage shuffles nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2485] Fix disk file cleanup for mixed-storage shuffles nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2499] Show shuffle slot assignments in the Spark UI Celeborn tab zaynt
• (celeborn) branch main updated: [CELEBORN-2429][CIP-23] Batch worker/application heartbeats into aggregated raft log entries zaynt
• (celeborn) branch main updated (3cb708b05e -> d750eddeb3) zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2501] Fix DataPushQueue dropping tasks when there is no partition location map zaynt
• (celeborn) branch main updated: [CELEBORN-2479] Show shuffle compression ratio in Spark UI zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2500] Use ArrayDeque instead of LinkedList in TransportFrameDecoder zaynt
• (celeborn) branch main updated: [CELEBORN-2500] Use ArrayDeque instead of LinkedList in TransportFrameDecoder zaynt
• (celeborn) branch main updated: [CELEBORN-2494][TEST] Fix flaky PushDataTimeoutTest after replica timeout nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2451] Make DRA safe under AUTO fallback by tying supportsReliableStorage to fallback policy nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2491] Fix mapper completion racing with shuffle integrity metadata aggregation nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2491] Fix mapper completion racing with shuffle integrity metadata aggregation nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2497][TEST] Fix gauge snapshot race in Master metrics tests nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2496][TEST] Fix mtime granularity race in ReloadingX509TrustManagerSuiteJ.testReloadSymlink zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2495] Fix memory leak of committedFileInfos when graceful shutdown is disabled zaynt
• (celeborn) branch main updated: [CELEBORN-2495] Fix memory leak of committedFileInfos when graceful shutdown is disabled zaynt
• (celeborn) branch main updated: [CELEBORN-2498][TEST] Fix testDataPushQueue starvation on fast machines zaynt
• (celeborn) branch main updated: [CELEBORN-2490] Make memory file storage configurable for replica partitions zaynt
• (celeborn) branch main updated: [CELEBORN-2480][FOLLOWUP] Test columnar batch limits and round trips zaynt
• (celeborn) branch main updated: [CELEBORN-2387] Add ReserveSlotsFailCount worker metric zaynt
• (celeborn) branch main updated: [CELEBORN-2478] Add celeborn-client build information to Spark UI Celeborn tab zaynt
• (celeborn) branch main updated: [CELEBORN-2467] Fix silent shuffle data loss when a replica's commit times out on OSS and HDFS storage nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2489] Fix unknown worker lookup in shuffle data loss detection nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2467] Fix silent shuffle data loss when a replica's commit times out on OSS and HDFS storage nicholasjiang
• (celeborn) branch main updated: [CELEBORN-194] Introduce client side metrics for celeborn nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2489] Fix unknown worker lookup in shuffle data loss detection nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2480] Push columnar shuffle batches by estimated size in bytes nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2480] Push columnar shuffle batches by estimated size in bytes nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2488] Cache Maven distribution in CI workflows zaynt
• (celeborn) branch main updated: [CELEBORN-2482] Report pushes failed by push-timeout channel close as push timeout instead of connection exception zaynt
• (celeborn) branch main updated: [CELEBORN-2220][CIP-14] Support Slow Start Push in C++ Client zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2487] Fix leaked LifecycleManager in spark-it client suites zaynt
• (celeborn) branch main updated: [CELEBORN-2487] Fix leaked LifecycleManager in spark-it client suites zaynt
• (celeborn) branch main updated: [CELEBORN-2484][BUILD] Make sbt downloads resilient to transient Maven Central failures zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2475] Fix stale HA configuration documentation that breaks CI zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2481] Fix NPE when persisting MapFileMeta without segment granularity zaynt
• (celeborn) branch main updated: [CELEBORN-2481] Fix NPE when persisting MapFileMeta without segment granularity zaynt
• (celeborn) branch main updated: [CELEBORN-2483] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with the initial app heartbeat zaynt
• (celeborn) branch main updated: [CELEBORN-2476] Fix initial storage fallback for MEMORY locations nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2476] Fix initial storage fallback for MEMORY locations nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2403] Add worker metrics for disk status and unhealthy disk count zaynt
• (celeborn) branch main updated: [CELEBORN-2458] Invalidate transport client after push timeout zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2458] Invalidate transport client after push timeout zaynt
• (celeborn) branch main updated: [CELEBORN-2462][WORKER] Reduce misleading WARN/ERROR logs during decommission shutdown zaynt
• (celeborn) branch main updated: [CELEBORN-2463] Add ManuallyExcludedWorkerCount metric to distinguish manually excluded workers zaynt
• (celeborn) branch main updated: [CELEBORN-2466] Support per-zone worker StatefulSets and autoscaling in the Helm chart zaynt
• (celeborn) branch main updated: [CELEBORN-2470] Add backoff with jitter to push retries and log hard split once per file zaynt
• (celeborn) branch main updated: [CELEBORN-2472] Unregister Celeborn application from MR AppMaster on shutdown zaynt
• (celeborn) branch main updated: [CELEBORN-2474] Send WWW-Authenticate challenge when no auth header present rexxiong
• (celeborn) branch main updated: [CELEBORN-2452] Prevent device error broadcast from deleting committed shuffle files zaynt
• (celeborn) branch main updated: [CELEBORN-2361] Unblock stage-end when CommitFilesResponse carries an empty map-id bitmap zaynt
• (celeborn) branch main updated: [CELEBORN-2475] Fix stale HA configuration documentation that breaks CI rexxiong
• (celeborn) branch branch-0.7 updated: [CELEBORN-2452] Prevent device error broadcast from deleting committed shuffle files zaynt
• (celeborn) branch main updated: [CELEBORN-2446] Support topologySpreadConstraints for master and worker pods in Helm chart zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2359] Deduplicate # HELP/# TYPE lines in PrometheusServlet output zaynt
• (celeborn) branch main updated: [CELEBORN-2359] Deduplicate # HELP/# TYPE lines in PrometheusServlet output zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2361] Unblock stage-end when CommitFilesResponse carries an empty map-id bitmap zaynt
• (celeborn) branch main updated: [CELEBORN-2356] Fix NPE before null-check in handleChunkFetchRequest zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2356] Fix NPE before null-check in handleChunkFetchRequest zaynt
• (celeborn) branch main updated: [CELEBORN-2357] Add Metrics Prefix zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2473] Do not relocate zstd-jni in the Tez shaded jar zaynt
• (celeborn) branch main updated: [CELEBORN-2473] Do not relocate zstd-jni in the Tez shaded jar zaynt
• (celeborn) branch main updated: [MINOR] Update pnpm/action-setup to specific version v6.1.0 in web_lint.yml rexxiong
• (celeborn) branch main updated: [CELEBORN-2455] Remove redundant synchronized in Dispatcher.postMessage zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2453] Master should fail fast when the Ratis server is closed unexpectedly zaynt
• (celeborn) branch main updated: [CELEBORN-2434] Clamp endMapIndex in sliceSortedBufferByMapRange zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2454] Add config celeborn.master.ha.ratis.raft.server.close.threshold and docs for Ratis JvmPauseMonitor zaynt
• (celeborn) branch main updated: [CELEBORN-2454] Add config celeborn.master.ha.ratis.raft.server.close.threshold and docs for Ratis JvmPauseMonitor zaynt
• (celeborn) branch main updated: [CELEBORN-2453] Master should fail fast when the Ratis server is closed unexpectedly zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2456] Fix wrong isAssignableFrom direction in Basic/Bearer authenticationSupported zaynt
• (celeborn) branch main updated: [CELEBORN-2456] Fix wrong isAssignableFrom direction in Basic/Bearer authenticationSupported zaynt
• (celeborn) branch main updated: [CELEBORN-2415] Add Celeborn Spark UI extension zaynt
• (celeborn) branch branch-0.7 updated: [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE rexxiong
• (celeborn) branch main updated: [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE rexxiong
• (celeborn) branch main updated: [CELEBORN-2442] Optimize meta memory for very large partitions zaynt
• (celeborn) branch main updated: [CELEBORN-2430] Expose unexpected errors in client background threads rexxiong
• (celeborn) branch branch-0.7 updated: [CELEBORN-2428] Fix TierWriter buffer accounting when CompositeByteBuf insertion fails zaynt
• (celeborn) branch main updated: [CELEBORN-2428] Fix TierWriter buffer accounting when CompositeByteBuf insertion fails zaynt
• (celeborn) branch main updated: [CELEBORN-2398] Allow ChangePartitionManager to refresh candidate workers without allocating slots zaynt
• (celeborn) branch main updated: [CELEBORN-2447] Add a /healthz endpoint to master and worker nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2440][INFRA] Post a merge summary comment on the PR in merge_pr.py nicholasjiang
• (celeborn) branch CELEBORN-2445 deleted (was 6462d76bd) csy
• (celeborn) branch CELEBORN-2445 created (now 6462d76bd) csy
  • (celeborn) 01/01: feat(worker): add per-decommission timeout override csy
• (celeborn) branch main updated: [CELEBORN-2060][FOLLOWUP] Fix rack-aware replica storage selection nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2390] Add docker-compose for local cluster chengpan
• (celeborn) branch main updated (b356ccec0 -> cb086f2ca) chengpan
• (celeborn) branch main updated: [CELEBORN-2437][INFRA] Fix JIRA fix version suggestion in merge_pr.py nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2408] Exclude unused Netty QUIC/HTTP3 modules from shaded clients chengpan
• (celeborn) branch main updated: [CELEBORN-2438][INFRA] Remove empty protected_branches in .asf.yaml chengpan
• (celeborn) branch branch-0.7 updated: [CELEBORN-2438][INFRA] Remove empty protected_branches in .asf.yaml chengpan
• (celeborn) branch branch-0.7 updated: [CELEBORN-2421] Avoid redundant ByteBuffer allocation in LocalPartitionDataReader nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2431] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with app heartbeat counter reset nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2431] Fix flaky RemoteShuffleMasterSuiteJ shuffleCount assertions racing with app heartbeat counter reset nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2410] Add missing module coverage to labeler.yml chengpan
• (celeborn) branch main updated: [CELEBORN-2421] Avoid redundant ByteBuffer allocation in LocalPartitionDataReader nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2409] Fix outdated Spark version descriptions in docs chengpan
• (celeborn) branch main updated: [CELEBORN-2409] Fix outdated Spark version descriptions in docs chengpan
• (celeborn) branch branch-0.7 updated: [CELEBORN-2433] Fix Utils.tryWithResources evaluating by-name resource expression twice chengpan
• (celeborn) branch branch-0.6 updated: [CELEBORN-2433] Fix Utils.tryWithResources evaluating by-name resource expression twice chengpan
• (celeborn) branch main updated: [CELEBORN-2433] Fix Utils.tryWithResources evaluating by-name resource expression twice chengpan
• (celeborn) branch main updated: [CELEBORN-2408] Exclude unused Netty QUIC/HTTP3 modules from shaded clients chengpan
• (celeborn) branch main updated: [CELEBORN-2435] Make CelebornConfSuite transport io.mode expectation platform-aware chengpan
• (celeborn) branch branch-0.7 updated: [CELEBORN-2435] Make CelebornConfSuite transport io.mode expectation platform-aware chengpan
• (celeborn) branch branch-0.6 updated: [CELEBORN-2435] Make CelebornConfSuite transport io.mode expectation platform-aware chengpan
• (celeborn) branch branch-0.7 updated: [CELEBORN-2411][CIP22] Preserve Spark IO cipher transformation zaynt
• (celeborn) branch main updated (51357a4c6 -> 994106443) zaynt
• (celeborn) branch main updated: [CELEBORN-2425] Bump Ratis version from 3.2.2 to 3.3.0 nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2426] Correct the calculation of the count of unreleased partitions at shutdown nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2426] Correct the calculation of the count of unreleased partitions at shutdown nicholasjiang
• (celeborn) branch branch-0.7 updated: [CELEBORN-2413] Fail transport requests retriably when the C++ connection is closed or a write fails nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2413] Fail transport requests retriably when the C++ connection is closed or a write fails nicholasjiang
• (celeborn) branch main updated (14b2cf597 -> c951e9804) nicholasjiang
• (celeborn) branch main updated (9c16805fc -> 14b2cf597) zaynt
• (celeborn-website) branch main updated: docs: restore 0.6.3 download section (#126) nicholasjiang
• (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot
  • (celeborn-website) 19/19: .asf.yaml github-bot

• Earlier messages