[ https://issues.apache.org/jira/browse/FLINK-14956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16984777#comment-16984777 ]
zhijiang commented on FLINK-14956: ---------------------------------- I would close this duplicated issue to focus on FLINK-14845 only. > MemoryMappedBoundedData Compressed Buffer Slicer > ------------------------------------------------ > > Key: FLINK-14956 > URL: https://issues.apache.org/jira/browse/FLINK-14956 > Project: Flink > Issue Type: Improvement > Components: Runtime / Network > Reporter: Nicholas Jiang > Priority: Minor > Attachments: CPU-IO.png, Compress-Read.png, Compress-Write.png > > > MemoryMappedBoundedData, implementation of BoundedData simply through > ByteBuffers backed by memory, uses CompressedBufferSlicer which is > implementation of BoundedData.Reader to slice next buffer with uncompress. > CompressedBufferSlicer reads BoundedData by LZ4SafeDecompressor decompressing > byte buffer.When FileChannelMemoryMappedBoundedData tries to write buffer, > this uses LZ4Compressor to compress buffer to improve I/O performance. > Compress read process: > !Compress-Read.png|width=556,height=251! > Compress write process: > !Compress-Write.png|width=278,height=261! > CPU/IO performance comparsion chart: > !CPU-IO.png|width=416,height=312! -- This message was sent by Atlassian Jira (v8.3.4#803005)