commits  

Messages by Thread

• • (celeborn-website) 02/12: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/12: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/12: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/12: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/12: .github/bin/build_docs.sh github-bot
• (celeborn-website) branch release-043 created (now 21cd75269) chengpan
  • (celeborn-website) 01/01: Add Release Notes for 0.4.3 chengpan
• (celeborn) annotated tag v0.4.3 updated (52cb34603 -> fa1ad9096) chengpan
• svn commit: r73601 - /dev/celeborn/v0.4.3-rc0/ /release/celeborn/celeborn-0.4.3/ chengpan
• (celeborn) branch branch-0.5 updated: [CELEBORN-1769] Fix packed partition location cause GetReducerFileGroupResponse lose location rexxiong
• (celeborn) branch main updated: [CELEBORN-1769] Fix packed partition location cause GetReducerFileGroupResponse lose location rexxiong
• (celeborn) branch main updated (80ebb1983 -> 11cbacb04) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1761][CIP-14] Add cppProto to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1622][CIP-11] Adding documentation for Worker Tags feature ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1765] Fix NPE when removeFileInfo in StorageManager rexxiong
• (celeborn) branch main updated (372ef79a0 -> 22ee8bfed) rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1760] OOM causes disk buffer unable to be released rexxiong
• (celeborn) branch main updated: [CELEBORN-1760] OOM causes disk buffer unable to be released rexxiong
• (celeborn) branch CELEBORN-1768 updated (562752121 -> 73730f64a) binjieyang
• (celeborn) branch CELEBORN-1768 updated (f080f7ce1 -> 562752121) binjieyang
• (celeborn) branch CELEBORN-1768 created (now f080f7ce1) binjieyang
  • (celeborn) 01/01: [CELEBORN-1768][WRITER] Refactoring Shuffle Writer to extract common methods binjieyang
• (celeborn) branch main updated: [CELEBORN-1731] Support merged kv input for Tez ethanfeng
• (celeborn) branch main updated (8948df17f -> cfd20fa0d) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1733] Support ordered grouped kv input for Tez ethanfeng
• (celeborn) branch main updated: [CELEBORN-1721][CIP-12] Support HARD_SPLIT in PushMergedData rexxiong
• (celeborn) branch main updated: [CELEBORN-1758] Remove the empty user resource consumption from worker heartbeat nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1730] Support unordered KV output for Tez ethanfeng
• (celeborn) branch main updated: [CELEBORN-1729] Support ordered KV output for Tez ethanfeng
• (celeborn) branch main updated: [CELEBORN-1754][CIP-14] Add exceptions and checking utils to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1743] Resolve the metrics data interruption and the job failure caused by locked resources rexxiong
• (celeborn) branch main updated: [CELEBORN-1748] Deprecate identity provider configs tied with quota rexxiong
• (celeborn) branch branch-0.4 updated: [RELEASE] Bump 0.4.4-SNAPSHOT chengpan
• (celeborn) branch branch-0.5 updated: [CELEBORN-1759] Fix reserve slots might lost partition location between 0.4 client and 0.5 server ethanfeng
• (celeborn) branch main updated (3dd810cd9 -> 7102174ed) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1612] Add a basic reader writer class to Tez ethanfeng
• svn commit: r73454 - /dev/celeborn/v0.4.3-rc0/ chengpan
• (celeborn) branch branch-0.4 updated: [RELEASE] Bump 0.4.3 chengpan
• (celeborn) tag v0.4.3-rc0 created (now 52cb34603) chengpan
• (celeborn) branch main updated: [CELEBORN-1756] Only gauge hdfs metrics if HDFS storage enabled to reduce metrics ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher chengpan
• (celeborn) branch main updated: [CELEBORN-1750] Return struct worker resource consumption information with RESTful api feiwang
• (celeborn) branch main updated: [CELEBORN-1755] Update doc to include S3 as one of storage layers ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• (celeborn) branch main updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• (celeborn) branch main updated: [CELEBORN-1746] Reduce the size of aws dependencies ethanfeng
• (celeborn) branch main updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1530][FOLLOWUP] Exclude web modules by default ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• (celeborn-website) branch main updated: Add Weijie Guo to committer (#91) rexxiong
• (celeborn) branch main updated: [CELEBORN-1621][FOLLOWUP] Support enabling worker tags via config ethanfeng
• (celeborn) branch main updated: [CELEBORN-1751][CIP-14] Add celebornException utils to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1745] Remove application top disk usage code ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch branch-0.4 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch main updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch main updated (e642197b5 -> 1aefd8f42) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1749] Fix incorrect application diskBytesWritten metrics nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1621][CIP-11] Predefined worker tags expr via dynamic configs ethanfeng
• (celeborn-website) branch main updated: Release 0.5.2 (#90) rexxiong
• (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
• (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
• (celeborn) tag v0.5.2 created (now 513bd5995) nicholasjiang
• svn commit: r73253 - /dev/celeborn/v0.5.2-rc6/ /release/celeborn/celeborn-0.5.2/ nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1747] Fix flaky test - HybridShuffleWordCountTest nicholasjiang
• (celeborn) branch main updated: [MINOR] Update DingTalk group link nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1741][CIP-14] Add processBase utils to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1713] RpcTimeoutException should include RPC address in message ethanfeng
• (celeborn) branch main updated: [CELEBORN-1543][FOLLOWUP] License check adds flink-1.20 profile ethanfeng
• (celeborn) branch main updated: [CELEBORN-1634][FOLLOWUP] Simplify the logic of the `RpcSource.addTimer` and `RpcSource.updateTimer` fchen
• svn commit: r73210 - /dev/celeborn/v0.5.2-rc6/ nicholasjiang
• (celeborn) tag v0.5.2-rc6 created (now 513bd5995) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1724][CIP-14] Add environment setup tools for CppClient development ethanfeng
• (celeborn) branch main updated: [CELEBORN-1545] Add Tez plugin skeleton and dag app master ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• (celeborn) branch main updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1530] support MPU for S3 ethanfeng
• (celeborn) branch main updated (99a34f36b -> 317cb973d) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1618][CIP-11] Supporting tags via DB Config Service ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• (celeborn) branch main updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• (celeborn) branch main updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1485][0.4] Refactor addCounter, addGauge and addTimer of AbstractSource to reduce CPU utilization fchen
• (celeborn) branch branch-0.5 updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• (celeborn) branch main updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• (celeborn) branch main updated: [CELEBORN-1719] Introduce celeborn.client.spark.stageRerun.enabled with alternative celeborn.client.spark.fetch.throwsFetchFailure to enable spark stage rerun nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1631][FOLLOWUP] Add latest snapshot index in message of HandleResponse for /snapshot/create nicholasjiang
• (celeborn) branch branch-0.4 updated (45f404d51 -> 959b771fb) fchen
• (celeborn) branch main updated: [CELEBORN-1715] RemoteShuffleMaster should check celeborn.client.push.replicate.enabled in constructor nicholasjiang
• (celeborn-website) branch main updated: add user kcbebank (#89) nicholasjiang
• svn commit: r73143 - /dev/celeborn/v0.5.2-rc5/ nicholasjiang
• (celeborn) tag v0.5.2-rc5 created (now c057e960f) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1619][CELEBORN-474][FOLLOWUP] TagsManager uses JavaUtils#newConcurrentHashMap to speed up ConcurrentHashMap#computeIfAbsent nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1634] Support queue time/processing time metrics for rpc framework rexxiong
• (celeborn) branch main updated: [CELEBORN-1707] Audit all RESTful api calls and use separate restAuditFile nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1714] Optimize handleApplicationLost nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1490][FOLLOWUP] Polish CelebornTierProducerAgent nicholasjiang
• svn commit: r73091 - /dev/celeborn/v0.5.2-rc4/ nicholasjiang
• (celeborn) tag v0.5.2-rc4 created (now 7fd96fdde) nicholasjiang
• (celeborn) branch branch-0.5 updated (28b2f56e1 -> 5c6a2c85f) feiwang
  • (celeborn) 01/01: [CELEBORN-1705] Fix disk buffer size is negative issue feiwang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• (celeborn) branch main updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• (celeborn) branch main updated: [CELEBORN-1660] Cache available workers and only count the available workers device free capacity rexxiong
• (celeborn) branch main updated (def5254ec -> 7fbf0e2fa) chengpan
• (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Document adds Flink 1.16 support ethanfeng
• (celeborn) branch main updated: [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation rexxiong
• (celeborn) branch main updated: [CELEBORN-1711][TEST] Fix '65535' port is invalid feiwang
• svn commit: r72999 - /dev/celeborn/v0.5.2-rc3/ nicholasjiang
• (celeborn) tag v0.5.2-rc3 created (now 8ac06dfe6) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1601][FOLLOWUP] Refine the RESTful apis for revise lost shuffles rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• (celeborn) branch main updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• (celeborn) branch main updated: [CELEBORN-1702] Bump Ratis version from 3.1.1 to 3.1.2 ethanfeng
• (celeborn) branch main updated: [CELEBORN-1708] Bump protobuf version from 3.21.7 to 3.25.5 ethanfeng
• (celeborn) branch main updated: [CELEBORN-1709] Bump jetty version from 9.4.52.v20230823 to 9.4.56.v20240826 ethanfeng
• (celeborn) branch main updated (8b54ed8c3 -> 6d2b9f6d9) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow multiple builds run in the same ci server ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated: [CELEBORN-1685] ShuffleFallbackPolicy supports ShuffleFallbackCount metric rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated (164c66349 -> 4545cdc40) nicholasjiang
• (celeborn) branch main updated: [MINOR] Fix docs typo ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• (celeborn) branch main updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• (celeborn) branch main updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• (celeborn) branch main updated: [CELEBORN-1697] Improve ThreadStackTrace for thread dump ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1692] Set mount point in fromPbFileInfoMap nicholasjiang
• (celeborn) branch main updated (4e7df13af -> 4b8b125a1) nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1680] Introduce ShuffleFallbackCount metrics ethanfeng
• (celeborn) branch main updated: [MINOR] Remove unused TODO comments in CelebornTierProducerAgent#processBuffer rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1671] CelebornShuffleReader will try replica if create client failed rexxiong
• (celeborn) branch main updated: [CELEBORN-1671] CelebornShuffleReader will try replica if create client failed rexxiong
• (celeborn) branch main updated (64f201dd8 -> f2e904302) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1636][FOLLOWUP] Dynamic resources will only be utilized in case of candidates shortages rexxiong
• (celeborn) branch main updated: [CELEBORN-1678][FOLLOWUP] Improve Celeborn CLI user guide ethanfeng
• (celeborn) branch main updated: [CELEBORN-1684] Fix ambiguous client jar expression of document nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1531][FOLLOWUP] Assign the scheduled check task rexxiong
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Support process large buffer in flink hybrid shuffle rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1682] Add java tools.jar into classpath for JVM quake nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1682] Add java tools.jar into classpath for JVM quake nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Add Flink Hybrid Shuffle IT test cases nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1660] Using map for workers to find worker fast ethanfeng

• Earlier messages
• Later messages