?????? flink 1.10????????

Mon, 27 Apr 2020 03:15:41 -0700 

Thank you Xintong.??????????????????????
-XX:MaxDirectMemorySizeFramework + Task Off-Heap + Network Memory
MaxDirectMemorySize=Framework Off-Heap + Task Off-Heap + Network 
Memory??????MaxDirectMemorySize=10??????10=1+1+8??10=1+8+1,??2??????????????????????????????????3??????????????????????????????????task
 off-heap????????????????job????????????????



------------------ ???????? ------------------
??????: "Xintong Song"<tonysong...@gmail.com&gt;; 
????????: 2020??4??27??(??????) ????12:06
??????: "user-zh"<user-zh@flink.apache.org&gt;; 
????: Re: flink 1.10????????



??????

Flink&nbsp;1.10&nbsp;????????????????????????????????????????????????????????????????????????????????????????????????????&nbsp;TM&nbsp;????&nbsp;heap,
direct,&nbsp;native&nbsp;??????????????????????????&nbsp;300mb????????????????????????&nbsp;heap&nbsp;????????100mb??????&nbsp;direct&nbsp;??
native&nbsp;????&nbsp;200mb??????????direct/native&nbsp;????????????&nbsp;200/0,&nbsp;100/100,&nbsp;0/200??????????????????&nbsp;200
??????????????????????????????????????&nbsp;direct&nbsp;????&nbsp;native&nbsp;??????????????&nbsp;Flink&nbsp;1.10&nbsp;??????&nbsp;direct/native
??????????????????????????????????????????????????????????????????????????????????????????????????????????????&nbsp;Flink
????????????????????????????????????????????[1]??

????????????????&nbsp;direct&nbsp;????????????????????????????????????????????????????
??taskmanager.memory.task.off-heap.size??&nbsp;??????[2]??

??????????Flink&nbsp;??????&nbsp;TM&nbsp;????????&nbsp;slot&nbsp;??????????????????????????&nbsp;JVM&nbsp;??????????????????????????????????????????????Flink
??????????????managed&nbsp;memory??[3]&nbsp;??????????????????????????&nbsp;Flink&nbsp;????????????????????????????????????&nbsp;JVM
??????????????????????????????????&nbsp;RocksDBStateBackend&nbsp;??????&nbsp;Batch&nbsp;????????????????????&nbsp;direct&nbsp;oom&nbsp;????????????

Thank&nbsp;you~

Xintong&nbsp;Song


[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/zh/ops/memory/mem_detail.html
[2]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/zh/ops/memory/mem_trouble.html#outofmemoryerror-direct-buffer-memory
[3]
https://ci.apache.org/projects/flink/flink-docs-release-1.10/zh/ops/memory/mem_setup.html#%E6%89%98%E7%AE%A1%E5%86%85%E5%AD%98

On&nbsp;Mon,&nbsp;Apr&nbsp;27,&nbsp;2020&nbsp;at&nbsp;10:31&nbsp;AM&nbsp;??????(Jiacheng&nbsp;Jiang)&nbsp;<920334...@qq.com&gt;
wrote:

&gt;&nbsp;hi
&gt;
&gt;
&gt;&nbsp;&amp;nbsp;&nbsp;&amp;nbsp;??????????????????standalone
&gt;&nbsp;flink????????????????job??tm??????????8g????????????flink1.10??????????taskmanager.memory.flink.size??10g??????????????????????????job??????????????????????job????????????????java.lang.OutOfMemoryError:
&gt;&nbsp;Direct&nbsp;buffer&nbsp;memory??????1??job??????????????Direct
&gt;&nbsp;Memory??????????????????????????flink1.10????????standalone&nbsp;cluster????slot????????????????????
&gt;&nbsp;??????????slot????????????????????A&nbsp;TaskManager&nbsp;with&nbsp;three&nbsp;slots,&nbsp;for&nbsp;example,&nbsp;will
&gt;&nbsp;dedicate&nbsp;1/3&nbsp;of&nbsp;its&nbsp;managed&nbsp;memory&nbsp;to&nbsp;each&nbsp;slot.&amp;nbsp;??????its&nbsp;managed
&gt;&nbsp;memory??????taskmanager.memory.managed.size??????????????????
&gt;
&gt;
&gt;&nbsp;best&amp;nbsp;
&gt;&nbsp;Jungle

回复