commits  

Messages by Thread

• (celeborn) branch branch-0.6 updated: [CELEBORN-1319][FOLLOWUP] Support celeborn optimize skew partitions patch for Spark v3.5.6 and v4.0.0 feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1577][FOLLOWUP] Improve check quota message feiwang
• (celeborn) branch main updated: [CELEBORN-1577][FOLLOWUP] Improve check quota message feiwang
• svn commit: r77503 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) branch branch-0.6 updated (10fbace4a -> bfe6b1aaa) feiwang
  • (celeborn) 01/02: [RELEASE] Bump 0.6.0 feiwang
  • (celeborn) 02/02: [RELEASE] Bump 0.6.1-SNAPSHOT feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2033] updateProduceBytes should be called even if updateProduceBytes throws exception feiwang
• (celeborn) branch main updated: [CELEBORN-1892] Adding register with master fail count metric for worker feiwang
• svn commit: r77500 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1892] Adding register with master fail count metric for worker feiwang
• (celeborn) tag v0.6.0-rc0 updated (96943300f -> 2b812dcea) feiwang
• (celeborn) branch main updated: [CELEBORN-2033] updateProduceBytes should be called even if updateProduceBytes throws exception feiwang
• (celeborn) branch main updated: [CELEBORN-1719][FOLLOWUP] Rename throwsFetchFailure to stageRerunEnabled nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1719][FOLLOWUP] Rename throwsFetchFailure to stageRerunEnabled nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1572][FOLLOWUP] Support to show Celeborn CLI version for sub command rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-1572][FOLLOWUP] Support to show Celeborn CLI version for sub command rexxiong
• (celeborn) branch main updated: [CELEBORN-2028] Setup GA for grafana dashboard ethanfeng
• (celeborn-website) branch dependabot/pip/requests-2.32.4 created (now 061125406) github-bot
• svn commit: r77457 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) tag v0.6.0-rc0 updated (1245b88a6 -> 96943300f) feiwang
• (celeborn) branch main updated: [CELEBORN-2015][FOLLOWUP] Retry IOException failures for RPC requests feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2015][FOLLOWUP] Retry IOException failures for RPC requests feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2030] Bump Spark from 3.5.5 to 3.5.6 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2030] Bump Spark from 3.5.5 to 3.5.6 nicholasjiang
• (celeborn) branch main updated (da84baed4 -> feba7baec) nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2029][FLINK] Some minor optimizations in the Flink integration nicholasjiang
• (celeborn) branch CELEBORN-1334 deleted (was 4076d451b) feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1720][FOLLOWUP] Fix flakyTest - check if fetch failure task another attempt is running or successful feiwang
• (celeborn) branch main updated: [CELEBORN-1720][FOLLOWUP] Fix flakyTest - check if fetch failure task another attempt is running or successful feiwang
• (celeborn) branch main updated: [CELEBORN-1673][FOLLOWUP] Shouldn't ignore InterruptedException when client retry feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1673][FOLLOWUP] Shouldn't ignore InterruptedException when client retry feiwang
• (celeborn) branch main updated: [CELEBORN-2014] updateInterruptionNotice REST API nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2003] Add retry mechanism when completing S3 multipart upload ethanfeng
• (celeborn) branch main updated (2e41877cd -> 061cdc382) ethanfeng
• (celeborn) branch main updated: [CELEBORN-2017][HELM] Add namespace to the metadata rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2017][HELM] Add namespace to the metadata rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2025] RpcFailure Scala 2.13 serialization is incompatible rexxiong
• (celeborn) branch main updated: [CELEBORN-2025] RpcFailure Scala 2.13 serialization is incompatible rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2026] Skip build tez client nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2026] Skip build tez client nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2020][FOLLOWUP] Add --auth-header option to usage of CLI commands nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2020][FOLLOWUP] Add --auth-header option to usage of CLI commands nicholasjiang
• (celeborn) branch main updated (7bde738e5 -> c0512c67f) rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2022] Spark4 Client should package commons-io rexxiong
• (celeborn) branch branch-0.6 updated: [CELEBORN-2021] Fix issues on regression HDFS and OSS before release 0.6 ethanfeng
• (celeborn) branch main updated: [CELEBORN-2021] Fix issues on regression HDFS and OSS before release 0.6 ethanfeng
• (celeborn) branch CELEBORN-1768 updated (d5d48d3b6 -> 9a3f7db74) binjieyang
• (celeborn) branch CELEBORN-1768 updated (a650218e8 -> d5d48d3b6) binjieyang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2020][FOLLOWUP] Fix CLI master commands authentication testing nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2020][FOLLOWUP] Fix CLI master commands authentication testing nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2023] Spark4 Client incompatible with isLocalMaster method nicholasjiang
• (celeborn) branch main updated: [CELEBORN-2023] Spark4 Client incompatible with isLocalMaster method nicholasjiang
• (celeborn) branch CELEBORN-1768 updated: update binjieyang
• (celeborn) branch CELEBORN-1768 updated (52da4bd35 -> aceee64c7) binjieyang
• (celeborn) branch CELEBORN-1851 deleted (was a74d100fc) feiwang
• (celeborn) branch main updated (ba3cfe604 -> 5f58fb1e3) feiwang
• (celeborn) branch branch-0.6 updated (a209d9eea -> 3db9bf31b) nicholasjiang
  • (celeborn) 01/02: [CELEBORN-2005] Introduce numBytesIn, numBytesOut, numBytesInPerSecond, numBytesOutPerSecond metrics for RemoteShuffleServiceFactory nicholasjiang
  • (celeborn) 02/02: [CELEBORN-2005][FOLLOWUP] Introduce ShuffleMetricGroup for numBytesIn, numBytesOut, numRecordsOut, numBytesInPerSecond, numBytesOutPerSecond, numRecordsOutPerSecond metrics nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2020] Support http authentication for Celeborn CLI feiwang
• (celeborn) branch main updated: [CELEBORN-2020] Support http authentication for Celeborn CLI feiwang
• (celeborn) branch main updated: [CELEBORN-2005][FOLLOWUP] Introduce ShuffleMetricGroup for numBytesIn, numBytesOut, numRecordsOut, numBytesInPerSecond, numBytesOutPerSecond, numRecordsOutPerSecond metrics guoweijie
• (celeborn) branch branch-0.6 updated: [CELEBORN-1627][FOLLOWUP] Fix the issue where the case of name affects the metrics dashboard feiwang
• (celeborn) branch main updated (3fb6d5b82 -> 0227a1ab2) feiwang
• (celeborn) branch branch-0.6 updated (3ec8a199a -> 3b7522a23) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-1413][FOLLOWUP] Support dependencies of spark-4.0 profile nicholasjiang
• (celeborn) branch main updated (c79e02f8e -> 3fb6d5b82) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-1413][FOLLOWUP] Support dependencies of spark-4.0 profile nicholasjiang
• (celeborn) branch s0nskar-patch-1 deleted (was 7aa01aaa1) s0nskar
• (celeborn) branch s0nskar-patch-1 created (now 7aa01aaa1) s0nskar
  • (celeborn) 01/01: Create release.yml s0nskar
• (celeborn) branch branch-0.6 updated: [CELEBORN-1413][FOLLOWUP] Support dependencies of spark-4.0 profile nicholasjiang
• (celeborn) branch main updated (12e91640f -> c79e02f8e) nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2018] Support min number of workers selected for shuffle nicholasjiang
  • (celeborn) branch branch-0.6 updated: [CELEBORN-2018] Support min number of workers selected for shuffle feiwang
• (celeborn) branch main updated: [CELEBORN-2018] Support min number of workers selected for shuffle nicholasjiang
  • (celeborn) branch main updated: [CELEBORN-2018] Support min number of workers selected for shuffle feiwang
  • (celeborn) branch main updated: [CELEBORN-2018] Support min number of workers selected for shuffle feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1413][FOLLOWUP] Bump spark 4.0 version to 4.0.0 feiwang
• (celeborn) branch main updated: [CELEBORN-1413][FOLLOWUP] Bump spark 4.0 version to 4.0.0 nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2009] Commit files request failure should exclude worker in LifecycleManager feiwang
• (celeborn) branch main updated: [CELEBORN-2009] Commit files request failure should exclude worker in LifecycleManager feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-1528][HELM] Use volume claim template to support various storage backend feiwang
• (celeborn) branch main updated: [CELEBORN-1528][HELM] Use volume claim template to support various storage backend feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2015] Retry IOException failures for RPC requests feiwang
• (celeborn) branch main updated: [CELEBORN-2015] Retry IOException failures for RPC requests feiwang
• (celeborn-website) branch main updated: add new user kuaishou and mucfc ethanfeng
• (celeborn) branch main updated: [MINOR][DOC] Correct configuration values ​​in slotsallocation feiwang
• (celeborn) branch branch-0.6 updated: [MINOR][DOC] Correct configuration values ​​in slotsallocation feiwang
• (celeborn) branch main updated (5590ef0ab -> 0dffcf6c9) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2013] Upgrade scala binary version of spark-3.3, spark-3.4, spark-3.5 profile to 2.13.8 nicholasjiang
• (celeborn) branch main updated (dae6a32d3 -> 5590ef0ab) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2013] Upgrade scala binary version of spark-3.3, spark-3.4, spark-3.5 profile to 2.13.8 nicholasjiang
• (celeborn) branch main updated (0f89d3d81 -> dae6a32d3) nicholasjiang
  • (celeborn) 01/01: [CELEBORN-2013] Upgrade scala binary version of spark-3.3, spark-3.4, spark-3.5 profile to 2.13.8 nicholasjiang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2013] Upgrade scala binary version of spark-3.3, spark-3.4, spark-3.5 profile to 2.13.8 feiwang
• (celeborn) branch main updated: [CELEBORN-2013] Upgrade scala binary version of spark-3.3, spark-3.4, spark-3.5 profile to 2.13.8 feiwang
• (celeborn) branch main updated (637c42338 -> 48fb71ee7) feiwang
• (celeborn) branch main updated: [CELEBORN-2012] Add license for http5 feiwang
• (celeborn) tag v0.6.0-rc0 updated (cf6fe3f8d -> 1245b88a6) feiwang
• svn commit: r77123 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2012] Add license for http5 feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2011][INFRA] Add a script to simplify the process of creating release notes feiwang
• svn commit: r77115 - /release/celeborn/KEYS feiwang
• svn commit: r77114 - /release/celeborn/KEYS feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2010][FOLLOWUP] Fix svn staging dir feiwang
• (celeborn) branch main updated: [CELEBORN-2010][FOLLOWUP] Fix svn staging dir feiwang
• svn commit: r77113 - /dev/celeborn/v0.6.0-rc0/ feiwang
• svn commit: r77112 - /dev/celeborn/v0.6.0-rc0/ feiwang
• svn commit: r77111 - /release/celeborn/KEYS feiwang
• svn commit: r77110 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) tag v0.6.0-rc1 deleted (was cf6fe3f8d) feiwang
• svn commit: r77109 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) tag v0.6.0-rc0 updated (cf6fe3f8d -> 54504f38a) feiwang
• (celeborn) tag v0.6.0-rc1 created (now cf6fe3f8d) feiwang
• (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.1-SNAPSHOT feiwang
  • (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.1-SNAPSHOT feiwang
  • (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.1-SNAPSHOT feiwang
• (celeborn) tag v0.6.0-rc0 updated (54504f38a -> cf6fe3f8d) feiwang
  • (celeborn) tag v0.6.0-rc0 updated (54504f38a -> cf6fe3f8d) feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2010][INFRA] Add release guide feiwang
• (celeborn) branch main updated: [CELEBORN-2010][INFRA] Add release guide feiwang
• (celeborn) branch main updated: [CELEBORN-2005] Introduce numBytesIn, numBytesOut, numBytesInPerSecond, numBytesOutPerSecond metrics for RemoteShuffleServiceFactory ethanfeng
• svn commit: r77055 - /dev/celeborn/v0.6.0-rc0/ feiwang
• (celeborn) tag v0.6.0-rc0 updated (2d3c48460 -> 54504f38a) feiwang
• (celeborn) branch branch-0.6 updated (e319705ba -> a825accdc) feiwang
  • (celeborn) 02/02: [RELEASE] Bump 0.6.1-SNAPSHOT feiwang
  • (celeborn) 01/02: [RELEASE] Bump 0.6.0 feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2006] LifecycleManager should avoid parsing shufflePartitionType every time feiwang
• (celeborn) branch main updated: [CELEBORN-2006] LifecycleManager should avoid parsing shufflePartitionType every time feiwang
• (celeborn) branch main updated: [CELEBORN-2007] Reduce PartitionLocation memory usage feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2007] Reduce PartitionLocation memory usage feiwang
• (celeborn) branch branch-0.6 updated: [CELEBORN-2008] SlotsAllocator should select disks randomly in RoundRobin mode feiwang
• (celeborn) branch branch-0.5 updated: [CELEBORN-2008] SlotsAllocator should select disks randomly in RoundRobin mode feiwang
• (celeborn) branch main updated: [CELEBORN-2008] SlotsAllocator should select disks randomly in RoundRobin mode feiwang
• (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.0 feiwang
  • (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.0 feiwang
  • (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.0 feiwang
  • (celeborn) branch branch-0.6 updated: [RELEASE] Bump 0.6.0 feiwang
• (celeborn) branch main updated (2d7ca727e -> cbf4a145c) feiwang
  • (celeborn) 01/01: Bump 0.7.0-SNAPSHOT feiwang
• (celeborn) branch main updated: Bump 0.7.0-SNAPSHOT feiwang
• (celeborn) branch main updated: [MINOR] Change some config version feiwang
• (celeborn) branch main updated: [CELEBORN-1775][FOLLOWUP] Improve logging around commit files feiwang
• (celeborn) branch main updated: [CELEBORN-1916][FOLLOWUP] Improve Aliyun OSS support ethanfeng
• (celeborn) branch main updated: [CELEBORN-1896] delete data from failed to fetch shuffles ethanfeng
• (celeborn) branch main updated: [CELEBORN-2004] Filter empty partition before createIntputStream feiwang
• (celeborn) branch main updated: [CELEBORN-2002][MASTER] Audit shuffle lifecycle in separate log file feiwang
• (celeborn) branch main updated: [CELEBORN-1993] CelebornConf introduces celeborn.<module>.io.threads to specify number of threads used in the client thread pool ethanfeng
• (celeborn) branch main updated: [CELEBORN-2000] Ignore the getReducerFileGroup timeout before shuffle stage end ethanfeng
• (celeborn) branch main updated: [CELEBORN-1800] Introduce ApplicationTotalCount and ApplicationFallbackCount metric to record the total and fallback count of application feiwang
• (celeborn) branch main updated: [CELEBORN-1995] Optimize memory usage for push failed batches feiwang
• (celeborn) branch main updated: [CELEBORN-1921][FOLLOWUP] Log the GetReducerFileGroupResponse size to provide insights ethanfeng
• (celeborn) branch main updated: [CELEBORN-1960] Fix PauseSpentTime only append the interval check time rexxiong
• (celeborn) branch main updated: [CELEBORN-1691][FOLLOWUP] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to deserialize in flink ethanfeng
• (celeborn) branch main updated (d03efcbdb -> a9ce4113a) ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1999] OpenStreamTime should use requestId to record cost time feiwang
• (celeborn) branch main updated: [CELEBORN-1999] OpenStreamTime should use requestId to record cost time feiwang
• (celeborn) branch main updated: [CELEBORN-1994] Introduce disruptor dependency to support asynchronous logging of log4j2 ethanfeng
• (celeborn) branch branch-0.5 updated (610f40b39 -> 94042fd31) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1855] LifecycleManager return appshuffleId for non barrier stage when fetch fail has been reported rexxiong
• (celeborn) branch main updated: [CELEBORN-1989][HELM] Split securityContext into master.podSecurityContext and worker.podSecurityContext rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1855] LifecycleManager return appshuffleId for non barrier stage when fetch fail has been reported rexxiong
• (celeborn) branch main updated: [CELEBORN-1974] ApplicationId as metrics label should be behind a config flag feiwang
• (celeborn) branch main updated: [CELEBORN-1968] Publish metric for unreleased partition location count when worker was gracefully shutdown feiwang
• (celeborn) branch main updated (6ceadd3b2 -> 3896249b9) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1487][FOLLOWUP] Fix updateProduceBytes rexxiong
• (celeborn) branch main updated: [CELEBORN-1987][HELM] Split dnsPolicy into master.dnsPolicy and worker.dnsPolicy rexxiong
• (celeborn) branch main updated: [CELEBORN-1965] Rely on all default hadoop providers for S3 auth ethanfeng
• (celeborn) branch main updated (7542adf70 -> 06bcc207d) rexxiong
• (celeborn) branch main updated: [CELEBORN-1948] Fix the issue where replica may lose data when HARD_SPLIT occurs during handlePushMergeData rexxiong
• (celeborn) branch main updated: [CELEBORN-1319][CELEBORN-474][FOLLOWUP] PushState uses JavaUtils#newConcurrentHashMap to speed up ConcurrentHashMap#computeIfAbsent ethanfeng
• (celeborn) branch main updated: [CELEBORN-1760][FOLLOWUP] Remove redundant release on data added in flushBuffer rexxiong
• (celeborn) branch main updated: Update celeborn conf to add S3 in default and doc for policy ethanfeng
• (celeborn) branch main updated: [CELEBORN-1912] Client should send heartbeat to worker for processing heartbeat to avoid reading idleness of worker which enables heartbeat ethanfeng
• (celeborn) branch main updated: [CELEBORN-1992] Ensure hadoop FS are not closed by hadoop ShutdownHookManager ethanfeng
• (celeborn) branch main updated: [CELEBORN-1501][FOLLOWUP] Add bytes written threshold for top app consumption metrics feiwang
• (celeborn) branch main updated: [CELEBORN-1981][HELM] Rename masterReplicas and workerReplicas to master.replicas and worker.replicas chengpan
• (celeborn) branch main updated: [MINOR][INFRA] Do not cancel GHA jobs on committing to main/branch-* branches chengpan
• (celeborn) branch main updated: [CELEBORN-1985][HELM] Add new values master.envFrom and worker.envFrom chengpan
• (celeborn) branch main updated: [CELEBORN-1986][HELM] Rename priorityClass.{master,worker} to {master,worker}.priorityClass chengpan
• (celeborn) branch main updated: [CELEBORN-1977] Add help/type on prometheus exposed metrics chengpan
• (celeborn) branch main updated: [CELEBORN-1919] Hardsplit batch tracking should be disabled when pushing only a single replica ethanfeng
• (celeborn) branch main updated (725e3ce9f -> ec4ea9773) rexxiong
• (celeborn) branch main updated: [CELEBORN-1980][HELM] Split environments into master.env and worker.env rexxiong
• (celeborn) branch main updated: [CELEBORN-1972][ ][HELM] Rename affinity.{master,worker} to {master,worker}.affinity rexxiong
• (celeborn-website) branch main updated: NIT: Fix indentation (#106) feiwang
• (celeborn) branch main updated: [CELEBORN-1982] Slot Selection Perf Improvements ethanfeng
• (celeborn) branch main updated: [CELEBORN-1983] Fix fetch fail not throw due to reach spark maxTaskFailures feiwang
• (celeborn) branch CELEBORN-1982 deleted (was d0adebd12) feiwang
• (celeborn) branch CELEBORN-1982 created (now d0adebd12) feiwang
  • (celeborn) 01/01: remove jmh plugin feiwang
• (celeborn) branch main updated: [CELEBORN-1976] CommitHandler should use celeborn.client.rpc.commitFiles.askTimeout for timeout of doParallelCommitFiles rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1976] CommitHandler should use celeborn.client.rpc.commitFiles.askTimeout for timeout of doParallelCommitFiles rexxiong
• (celeborn) branch main updated: [CELEBORN-1951][HELM] Rename resources.{master,worker} to {master,worker}.resoruces rexxiong
• (celeborn) branch main updated: [CELEBORN-1966] Added fix to get userinfo in celeborn rexxiong
• (celeborn) branch main updated: [CELEBORN-1969] Remove celeborn.client.shuffle.mapPartition.split.enabled to enable shuffle partition split at default for MapPartition ethanfeng
• (celeborn) branch main updated: [CELEBORN-1961] Convert Resource.proto from Protocol Buffers version 2 to version 3 ethanfeng
• (celeborn) branch main updated: [CELEBORN-1436][FOLLOWUP] Add swagger editor links for RESTful spec rexxiong

• Earlier messages
• Later messages