Re: [PR] [FLINK-35533][runtime] Support Flink hybrid shuffle integration with Apache Celeborn [flink]

2024-06-12 Thread via GitHub
reswqa merged PR #24900: URL: https://github.com/apache/flink/pull/24900 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-35533][runtime] Support Flink hybrid shuffle integration with Apache Celeborn [flink]

2024-06-12 Thread via GitHub
TanYuxin-tyx commented on code in PR #24900: URL: https://github.com/apache/flink/pull/24900#discussion_r1635866275 ## flink-core/src/main/java/org/apache/flink/configuration/NettyShuffleEnvironmentOptions.java: ## @@ -490,6 +490,24 @@ public enum CompressionCodec {

Re: [PR] [FLINK-35533][runtime] Support Flink hybrid shuffle integration with Apache Celeborn [flink]

2024-06-12 Thread via GitHub
TanYuxin-tyx commented on code in PR #24900: URL: https://github.com/apache/flink/pull/24900#discussion_r1635860182 ## flink-runtime/src/test/java/org/apache/flink/runtime/util/NettyShuffleDescriptorBuilder.java: ## @@ -80,8 +83,14 @@ public NettyShuffleDescriptor buildRemote()

Re: [PR] [FLINK-35533][runtime] Support Flink hybrid shuffle integration with Apache Celeborn [flink]

2024-06-11 Thread via GitHub
reswqa commented on code in PR #24900: URL: https://github.com/apache/flink/pull/24900#discussion_r1634238153 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/tiered/storage/TieredStorageConsumerClient.java: ## @@ -148,12 +162,52 @@ public