This is an automated email from the ASF dual-hosted git repository.
sewen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from ad18d13 [FLINK-19079][table-runtime] Introduce row time deduplicate
operator (#13331)
new 65c1edf [FLINK-15981][refactor] Refactor NettyMessage#write() to
allow writing multiple message parts.
new 4869d35 [FLINK-15981][network] Implement zero-copy file transfer in
network based on FileRegion for bounded blocking partitions
new 92d5033 [hotfix] Move FileBufferReaderITCase from 'flink-tests' to
'flink-runtime'
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../io/network/NettyShuffleServiceFactory.java | 3 +-
.../runtime/io/network/buffer/BufferRecycler.java | 14 ++
.../io/network/buffer/FileRegionBuffer.java | 240 +++++++++++++++++++++
.../runtime/io/network/netty/NettyMessage.java | 224 +++++++++----------
.../partition/BoundedBlockingSubpartition.java | 27 ++-
...dBlockingSubpartitionDirectTransferReader.java} | 159 +++++++-------
.../BoundedBlockingSubpartitionReader.java | 3 +-
.../partition/BoundedBlockingSubpartitionType.java | 43 +++-
.../runtime/io/network/partition/BoundedData.java | 6 +
.../network/partition/BufferReaderWriterUtil.java | 41 +++-
.../network/partition/FileChannelBoundedData.java | 5 +
.../FileChannelMemoryMappedBoundedData.java | 5 +
.../network/partition/MemoryMappedBoundedData.java | 5 +
.../network/partition/ResultPartitionFactory.java | 24 ++-
.../io/network/partition/ResultSubpartition.java | 6 +-
.../partition/SortMergeSubpartitionReader.java | 7 +-
.../partition/consumer/LocalInputChannel.java | 5 +
.../partition/consumer/SingleInputGate.java | 14 +-
.../partition/consumer/SingleInputGateFactory.java | 3 +-
.../NettyShuffleEnvironmentConfiguration.java | 4 +
.../NettyMessageClientDecoderDelegateTest.java | 36 ++--
.../runtime/io/network/netty/NettyTestUtil.java | 9 +-
...oundedBlockingSubpartitionAvailabilityTest.java | 1 +
.../partition/BoundedBlockingSubpartitionTest.java | 41 +++-
.../BoundedBlockingSubpartitionWriteReadTest.java | 7 +-
.../network/partition}/FileBufferReaderITCase.java | 38 ++--
.../partition/FileChannelBoundedDataTest.java | 1 +
.../network/partition/InputGateFairnessTest.java | 4 +-
.../network/partition/ResultPartitionBuilder.java | 10 +-
.../partition/ResultPartitionFactoryTest.java | 3 +-
.../partition/consumer/SingleInputGateBuilder.java | 5 +-
31 files changed, 707 insertions(+), 286 deletions(-)
create mode 100644
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/buffer/FileRegionBuffer.java
copy
flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/{BoundedBlockingSubpartitionReader.java
=> BoundedBlockingSubpartitionDirectTransferReader.java} (51%)
rename {flink-tests/src/test/java/org/apache/flink/test/runtime =>
flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition}/FileBufferReaderITCase.java
(88%)
