commits  

Messages by Thread

• [incubator-uniffle] branch master updated: Add Notice and DISCLAMER file (#215) jshao
• [incubator-uniffle] branch master updated: [MINOR] Modify the format of DISCLAIMER (#217) roryqi
• [incubator-uniffle] branch master updated: [TEST] Improve SimpleClusterManagerTest (#216) roryqi
• [incubator-uniffle] branch master updated: Add DISCLAIMER (#212) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Return index-file size of n*SEGMENT_SIZE in HDFS reading (#204) roryqi
• [incubator-uniffle] branch master updated: [IMPROVEMENT] Add more metrics about local storage info (#205) roryqi
• [incubator-uniffle] branch master updated: Fix flaky test of heartbeatTimeoutTest (#206) roryqi
• [incubator-uniffle] branch master updated: [Improvement][AQE] Avoid calling getShuffleResult multiple times (#190) roryqi
• [incubator-uniffle-website] branch asf-site updated (4c3e2d2 -> 930f932) github-bot
  • [incubator-uniffle-website] 01/01: deploy: e2fb0e5f1ca9c6d42e4b6b862bae2aed3bebd714 github-bot
• [incubator-uniffle-website] branch master updated: Update Slack invitation link (#4) jshao
• [incubator-uniffle] branch master updated: [ISSUE-186][Feature] Use I/O cost time to select storage paths (#192) roryqi
• [incubator-uniffle] branch master updated: [Issue-194][Feature] Support spark 3.2.0 (#201) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-144] Fix flaky test `RssShuffleUtilsTest#testDestroyDirectByteBuffer` (#203) roryqi
• [incubator-uniffle] branch uniffle-144 updated (89db9b2a -> e938f6ac) yangjie01
  • [incubator-uniffle] 01/01: fix yangjie01
• [incubator-uniffle] branch uniffle-144 updated (912b9293 -> 89db9b2a) yangjie01
  • [incubator-uniffle] 01/01: fix yangjie01
• [incubator-uniffle] branch uniffle-144 created (now 912b9293) yangjie01
  • [incubator-uniffle] 01/01: fix yangjie01
• [incubator-uniffle] branch master updated: [ISSUE-48][FEATURE][FOLLOW UP] Generate informer and lister for crd (#202) roryqi
• [incubator-uniffle] branch master updated: [IMPROVEMENT] Introduce the enumType in ConfigOptions (#199) roryqi
• [incubator-uniffle] branch master updated: [MINOR] Replace HashSet with ImmutableSet in configs (#195) roryqi
• [incubator-uniffle] branch master updated: [Log-Improvement] Log the newly registered app id (#193) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-48][FEATURE][FOLLOW UP] Add webhook component (#188) roryqi
• [incubator-uniffle] branch master updated: Fix some bad practices reported by spotbugs (#177) roryqi
• [incubator-uniffle-website] branch asf-site updated (c3869d7 -> 4c3e2d2) github-bot
  • [incubator-uniffle-website] 01/01: deploy: 3fb3bda68c39171c7b41ded4a5b9b95212009878 github-bot
• [incubator-uniffle-website] branch master updated: Modify the wrong mail list (#3) roryqi
• [incubator-uniffle-website] branch asf-site created (now c3869d7) github-bot
  • [incubator-uniffle-website] 01/01: deploy: cd1fd6c978b816708614c96dffa5ac21c590d0a8 github-bot
• [incubator-uniffle-website] branch master updated: Add the deploy workflow (#2) roryqi
• Error while running notifications feature from .asf.yaml in incubator-uniffle-website! Apache Infrastructure
  • Error while running notifications feature from .asf.yaml in incubator-uniffle-website! Apache Infrastructure
• [incubator-uniffle] branch master updated: [Improvement] Add optional environment variables (#187) roryqi
• [incubator-uniffle] branch master updated: Fix flaky test about kerberos (#191) roryqi
• [incubator-uniffle] branch master updated: [FOLLOWUP] Add the conf of rss.security.hadoop.krb5-conf.file (#184) roryqi
• [incubator-uniffle-website] branch master created (now d7af0cf) jshao
  • [incubator-uniffle-website] 01/01: first commit jshao
• [incubator-uniffle] branch master updated: [FOLLOWUP] Store app user in shuffleTaskInfo (#181) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-173][FOLLOWUP] The size of single buffer flush should reach rss.server.flush.cold.storage.threshold.size (#180) roryqi
• [incubator-uniffle] branch master updated: Revert "[ISSUE-173][FOLLOWUP] The size of single buffer flush should reach rss.server.flush.cold.storage.threshold.size (#178)" (#179) roryqi
• [incubator-uniffle] branch revert-178-follow_issue_173 created (now eecf9a27) roryqi
  • [incubator-uniffle] 01/01: Revert "[ISSUE-173][FOLLOWUP] The size of single buffer flush should reach rss.server.flush.cold.storage.threshold.size (#178)" roryqi
• [incubator-uniffle] branch master updated: [ISSUE-173][FOLLOWUP] The size of single buffer flush should reach rss.server.flush.cold.storage.threshold.size (#178) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Should match from pathToStorages when appId does not exist in appIdToStorages (#168) roryqi
• [incubator-uniffle] branch master updated (df4163fd -> 6cbd9b7b) roryqi
• [incubator-uniffle] branch master updated: [BUGFIX] Fix resource leak when shuffle read (#174) roryqi
• [incubator-uniffle] branch master updated: PID file name should contain program name (#165) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-48][FEATURE]: Init Operator Directory (#161) roryqi
• [incubator-uniffle] branch master updated: [FOLLOWUP] Delete hdfs shuffle data files using proxy user (#170) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-76] Disallow sendShuffleData if requireBufferId expired (#159) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Introduce a new class ShuffleTaskInfo (#158) roryqi
• [incubator-uniffle] branch master updated: [MINOR] Introduce more grpc server metrics (#150) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Filter null value when selecting remote storage in ApplicationManager (#156) roryqi
• [incubator-uniffle] branch master updated: [MINOR][DOC] Remove spaces when reading file of excluded nodes (#155) roryqi
• [incubator-uniffle] branch master updated: [DOC] Migrate the coordinator doc from README to docs page (#153) roryqi
• [incubator-uniffle] branch master updated: [MINOR] Tagged spark hadoop version in release package (#149) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Output the registering/lost/exclude nodes in log (#148) roryqi
• [incubator-uniffle] branch master updated (18663edb -> b3c07529) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-48][FEATURE] Add Uniffle Dockerfile (#132) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Add the number of unhealthy nodes in CoordinatorMetrics (#147) roryqi
• [incubator-uniffle] branch master updated: [MINOR] Fix flaky test testGetHostIp (#141) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-127][IMPROVEMENT] Add timeout reconnection when DelegationRssShuffleManager send the request of AccessCluster (#139) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT][STORAGE] Fix storage module code style (#131) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT]Make the conf of rss.storage.basePath as list (#130) roryqi
• [incubator-uniffle] branch master updated (fd8ccdd -> 3f8826a) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Set heartBeatExecutorService as daemon thread (#121) roryqi
• [incubator-uniffle] branch master updated (fce4bb6 -> 177e1b6) roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Remove useless server id from `StorageManagerFactory#createStorageManager` roryqi
• [incubator-uniffle] branch master updated: [MINOR][IMPROVEMENT] Avoid CoordinatorServer#initialization multiple `new Configuration()` (#118) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-106][IMPROVEMENT] Set rpc timeout for all rpc interface (#113) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-107][IMPROVEMENT] Assign partition again if registerShuffleServers failed (#115) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Introduce config to customize assignment server numbers in client side (#100) roryqi
• [incubator-uniffle] branch master updated (351275d -> 687cac9) roryqi
• [incubator-uniffle] branch master updated: [ISSUE-111] Sleep less time but try more times when stopping (#112) roryqi
• [incubator-uniffle] branch master updated: [CI] Test compile in Java 11 and Java 17 (#105) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Ignore partial failure on initializing local storage in shuffle server side (#102) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Add RssUtils#cloneBitMap() (#103) roryqi
• [incubator-uniffle] branch master updated: [Improvement] LocalStorage init use multi thread (#72) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Fix common module code style (#99) roryqi
• [incubator-uniffle] branch master updated: [Improvement] ShuffleBlock should be release when finished reading (#74) roryqi
• [incubator-uniffle] branch master updated: [DOC] Update title and description in README (#94) roryqi
• [incubator-uniffle] branch master updated: [Performance Optimization] Improve the speed of writing index file in shuffle server (#91) roryqi
• [incubator-uniffle] branch master updated: [DOC] Remove wechat group in README (#88) colin
• [incubator-uniffle] branch master updated (229b63b -> f70c4aa) roryqi
• [incubator-uniffle] branch master updated (20d39e8 -> 229b63b) roryqi
• [incubator-uniffle] branch master updated: [Log enhancement] return error message when getting assignment servers and log exception when initializing (#64) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Shutdown the grpc executors pool when closing (#83) roryqi
• [incubator-uniffle] branch master updated: [Log Improvment] Add more detailed debug info for MR client (#84) roryqi
• [incubator-uniffle] branch master updated: [Minor] Make config keys final (#70) zhifgli
• [incubator-uniffle] branch master updated: [MINOR] Comments of PartitionBalanceAssignmentStrategy miss byte units (#68) roryqi
• [incubator-uniffle] branch master updated: [TEST] Add more unit tests in rss-common (#63) roryqi
• [incubator-uniffle] branch master updated: Log enhancement: Merge multiple logs into oneline and add more description (#62) roryqi
• [incubator-uniffle] branch master updated: Introduce the extraProperties to support user-defined pluggable accessCheckers (#42) macduan
• [incubator-uniffle] branch master updated: [DOC] Replace Firestorm with Uniffle (#60) roryqi
• [incubator-uniffle] branch master updated (c3616c2 -> 2c67f5d) macduan
• [incubator-uniffle] branch master updated: Send commit concurrently in client side (#59) roryqi
• [incubator-uniffle] branch master updated: [Improvement] Log indicate the shuffle server host:port when doing remote calling (#58) roryqi
• [incubator-uniffle] tag release-0.5.0 created (now 1554f9f) roryqi
• [incubator-uniffle] branch master updated: [Experimental Feature] MR Supports Remote Spill (#55) zhifgli
• [incubator-uniffle] branch master updated: [Style] Check indentation (#56) roryqi
• [incubator-uniffle] branch master updated (aa02ee6 -> e343b93) roryqi
• Error while running notifications feature from .asf.yaml in incubator-uniffle! Apache Infrastructure
• [incubator-uniffle] branch master updated: Enable spotbugs and fix high priority bugs (#38) zhifgli
• [incubator-uniffle] branch master updated: [Improvement] Provides utility classes for creating thread factories (#49) roryqi
• [incubator-uniffle] branch branch-0.5.0 updated: [Bug] Fix skip() api maybe skip unexpected bytes which makes inconsistent data (#40) (#52) roryqi
• [incubator-uniffle] branch master updated: [Bug] Fix skip() api maybe skip unexpected bytes which makes inconsistent data (#40) zhifgli
• [incubator-uniffle] branch master updated: Supplement doc about assignment tags (#47) roryqi
• [incubator-uniffle] branch master updated: [Chore]: document update and build optimize (#45) roryqi
• [incubator-uniffle] branch master updated: [Improvement] modify code to avoid raw use of parameterized class (#46) roryqi
• [incubator-uniffle] branch master updated: Optimize the bash script (#29) roryqi
• [incubator-uniffle] branch master updated (f7c65d4 -> 4a51ff3) roryqi
• [incubator-uniffle] branch master updated (37beb1f -> f7c65d4) colin
• [incubator-uniffle] branch master updated: Rename Firestorm to Uniffle in README.md (#32) roryqi
• [incubator-uniffle] branch master updated: [TYPO] Fix misspelled word "integration" (#34) jshao
• [incubator-uniffle] branch master updated: Fix the log of incorrectly bound class (#35) zhifgli
• [incubator-uniffle] branch master updated: Bump commons-lang3 from 3.5 to 3.10 (#28) roryqi
• [incubator-uniffle] branch master updated: [INFRA] Improve asf.yaml to reduce the notifications (another-try) (#33) roryqi
• [incubator-uniffle] branch master updated: Switch to temurin JDK in CI (#24) roryqi
• [incubator-uniffle] branch master updated: Remove redundant package (#27) roryqi
• [incubator-uniffle] branch master updated: [TEST] Improve code coverage in rss-common (#26) roryqi
• [incubator-uniffle] branch master updated: Improve asf.yaml to reduce the notifications (#25) jshao
• [incubator-uniffle] branch master updated: Move rss-integration-spark-common-test package (#23) roryqi
• [incubator-uniffle] branch branch-0.5.0 updated: [Bug] Fix NPE problem when process the event if application was cleared already (#16) (#21) colin
• [incubator-uniffle] branch master updated: [Followup] Use asList method in some existing configOptions (#18) roryqi
• [incubator-uniffle] branch master updated: Add CI and Codecov badges in README (#20) roryqi
• [incubator-uniffle] branch master updated: Correct the config description and fix typo (#19) roryqi
• [incubator-uniffle] branch master updated: Enable codecov (#17) roryqi
• [incubator-uniffle] branch master updated: [Bug] Fix NPE problem when process the event if application was cleared already (#16) roryqi
• [incubator-uniffle] branch master updated: [Followup] Migrate to Junit5 (#14) roryqi
• [incubator-uniffle] branch master updated: Covert PartitionAssignmentInfo to static inner class (#15) roryqi
• [incubator-uniffle] branch master updated: Update name of modules (#12) roryqi
• [incubator-uniffle] branch master updated: Minimize apache-rat excluded files (#11) roryqi
• [incubator-uniffle] branch master updated: Introduce the asList method in ConfigOptions (#9) roryqi
• [incubator-uniffle] branch master updated: [Minor] Store shuffleId int to be consistent with other data structure (#10) roryqi
• [incubator-uniffle] branch master updated: [Minor] Trivial code improvements (#7) roryqi
• [incubator-uniffle] branch master updated: Add asf yaml jshao
• [incubator-uniffle] branch dependabot/maven/com.fasterxml.jackson.core-jackson-databind-2.12.6.1 created (now a3a13f3) github-bot
• [incubator-uniffle] branch dependabot/maven/integration-test/spark3/com.fasterxml.jackson.core-jackson-databind-2.12.6.1 created (now 01a5aef) github-bot
• [incubator-uniffle] branch dependabot/maven/integration-test/spark3/junit-junit-4.13.1 created (now a2dc61c) github-bot
• [incubator-uniffle] branch dependabot/maven/org.apache.hadoop-hadoop-common-3.2.3 created (now 1fd7abd) github-bot
• [incubator-uniffle] branch branch-0.3.0 created (now 1d69058) jshao
  • [incubator-uniffle] 01/01: [Bugfix] Fix uncorrect index file (#92) (#93) jshao
• [incubator-uniffle] branch branch-0.4.0 created (now 6a4295a) jshao
• [incubator-uniffle] branch branch-0.5.0 created (now 55cb16f) jshao
  • [incubator-uniffle] 03/04: upgrade to 0.5.0 (#189) jshao
  • [incubator-uniffle] 01/04: [Bugfix] [0.5] Fix spark2 executor stop NPE problem (#188) jshao
  • [incubator-uniffle] 02/04: [Doc] Update readme with features like multiple remote storage support etc (#192) jshao
  • [incubator-uniffle] 04/04: [Bugfix] [0.5] Fix MR don't have remote storage information when we use dynamic conf and MEMORY_LOCALE_HDFS storageType (#195) (#196) jshao
• [incubator-uniffle] branch master created (now 166f3f8) jshao
  • [incubator-uniffle] 08/17: [Improvement] Check ADAPTIVE_EXECUTION_ENABLED in RssShuffleManager (#197) jshao
  • [incubator-uniffle] 03/17: [Bugfix] Fix spark2 executor stop NPE problem (#186) jshao
  • [incubator-uniffle] 05/17: upgrade to 0.6.0-snapshot (#190) jshao
  • [incubator-uniffle] 06/17: [Bugfix] Fix MR don't have remote storage information when we use dynamic conf and MEMORY_LOCALE_HDFS storageType (#195) jshao
  • [incubator-uniffle] 01/17: [Improvement] Avoid using the default forkjoin pool by parallelStream directly (#180) jshao
  • [incubator-uniffle] 02/17: [Bugfix] Fix spark2 executor stop NPE problem (#187) jshao
  • [incubator-uniffle] 14/17: [Improvement] Close coordinatorClients when DelegationRssShuffleManager stops (#205) jshao
  • [incubator-uniffle] 11/17: Support build_distribution.sh to specify different mvn build options for Spark2 and Spark3 (#203) jshao
  • [incubator-uniffle] 09/17: [Improvement] Add dynamic allocation patch for Spark 3.2 (#199) jshao
  • [incubator-uniffle] 10/17: [MINOR] Close clusterManager resources (#202) jshao
  • [incubator-uniffle] 16/17: Support using remote fs path to specify the excludeNodesFilePath (#200) jshao
  • [incubator-uniffle] 13/17: [Improvement] Add RSS_IP environment variable support for K8S (#204) jshao
  • [incubator-uniffle] 07/17: [Minor] Remove serverNode from tags structure when heartbeart timeout (#193) jshao
  • [incubator-uniffle] 17/17: [Improvement] Modify configuration template (#209) jshao
  • [incubator-uniffle] 04/17: [Doc] Update readme with features like multiple remote storage support etc (#191) jshao
  • [incubator-uniffle] 15/17: [Minor] Make clearResourceThread and processEventThread daemon (#207) jshao
  • [incubator-uniffle] 12/17: [Improvement] Move detailed client configuration to individual doc (#201) jshao
• [incubator-uniffle] branch branch-0.1.0 created (now 36343ec) jshao
• [incubator-uniffle] branch branch-0.2.0 created (now 75b5376) jshao
  • [incubator-uniffle] 02/02: [Bugfix] Fix uncorrect index file (#92) jshao
  • [incubator-uniffle] 01/02: [Feature] [0.2] Support Spark 3.2 (#88) jshao
• subscribe Colin Ma

• Later messages