[ 
https://issues.apache.org/jira/browse/FLINK-6337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982545#comment-15982545
 ] 

Ufuk Celebi commented on FLINK-6337:
------------------------------------

Hey [~zjwang]! I think the buffer pool is required for spillable result 
partitions (when creating SpillableSubpartitionView). When they are consumed, a 
buffer provider needs to be given to the partition to copy the buffers to. I 
think this is not implemented in an efficient way at the moment (ideally the 
copy should not be necessary), but the proper implementation would require some 
more involved refactorings.

> Remove the buffer provider from PartitionRequestServerHandler
> -------------------------------------------------------------
>
>                 Key: FLINK-6337
>                 URL: https://issues.apache.org/jira/browse/FLINK-6337
>             Project: Flink
>          Issue Type: Improvement
>          Components: Network
>            Reporter: zhijiang
>            Assignee: zhijiang
>            Priority: Minor
>
> Currently, {{PartitionRequestServerHandler}} will create a 
> {{LocalBufferPool}} when the channel is registered. The {{LocalBufferPool}} 
> is only used to get segment size for creating read view in 
> {{SpillableSubpartition}}, and the buffers in the pool will not be used all 
> the time, so it will waste the buffer resource of global pool.
> We would like to remove the {{LocalBufferPool}} from the 
> {{PartitionRequestServerHandler}}, and the {{LocalBufferPool}} in 
> {{ResultPartition}} can also provide the segment size for creating sub 
> partition view.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to