[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915677727 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderTest.java: ## @@ -0,0 +1,418 @@ +/* + * Licensed to the Apache

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915677727 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderTest.java: ## @@ -0,0 +1,418 @@ +/* + * Licensed to the Apache

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915606824 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderTest.java: ## @@ -0,0 +1,418 @@ +/* + * Licensed to the Apache

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915601498 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderTest.java: ## @@ -0,0 +1,418 @@ +/* + * Licensed to the Apache

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915597495 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderTest.java: ## @@ -0,0 +1,418 @@ +/* + * Licensed to the Apache

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915563903 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadSchedulerTest.java: ## @@ -0,0 +1,403 @@ +/* + * Licensed to the

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-07 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915527214 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadSchedulerTest.java: ## @@ -0,0 +1,403 @@ +/* + * Licensed to the

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-06 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r915441265 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,416 @@ +/* + * Licensed to the Apache Sof

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911869376 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Sof

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911843536 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Sof

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911842656 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,382 @@ +/* + * Licensed to the Apache Sof

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911841814 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911839932 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911839274 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911838929 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911838648 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911828005 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-07-01 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911824289 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,408 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911660986 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911659434 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911659104 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsMemoryDataSpiller.java: ## @@ -0,0 +1,139 @@ +/* + * Licensed to the Apache Software

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911655012 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/BufferWithInfo.java: ## @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software Found

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r911601331 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReader.java: ## @@ -0,0 +1,379 @@ +/* + * Licensed to the Apache Sof

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910835005 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionViewNotifier.java: ## @@ -0,0 +1,37 @@ +/* + * Licensed to the Apache So

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910825853 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910812157 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910804995 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910776973 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910776973 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-30 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r910774514 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/BufferReaderWriterUtil.java: ## @@ -200,12 +211,32 @@ static Buffer readFromByteChannel(

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-29 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r909527803 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-29 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r909453748 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-29 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r909423606 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsResultPartitionReadScheduler.java: ## @@ -0,0 +1,424 @@ +/* + * Licensed to the Apac

[GitHub] [flink] reswqa commented on a diff in pull request #19960: [FLINK-27907][runtime] implement disk read and write logic for hybrid shuffle

2022-06-29 Thread GitBox
reswqa commented on code in PR #19960: URL: https://github.com/apache/flink/pull/19960#discussion_r909422919 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/BufferReaderWriterUtil.java: ## @@ -162,8 +162,19 @@ static Buffer readFileRegionFromByteChan