[ https://issues.apache.org/jira/browse/IGNITE-9305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16589960#comment-16589960 ]
Pavel Pereslegin edited comment on IGNITE-9305 at 8/23/18 9:28 AM: ------------------------------------------------------------------- Hi [~dmagda]. Do I understand correctly that we don't logging aggregated information about off-heap usage? Example of such output: {noformat} ^-- H/N/C [hosts=1, nodes=2, CPUs=8] ^-- CPU [cur=2.57%, avg=4.44%, GC=0%] ^-- PageMemory [pages=34] ^-- Heap [used=130MB, free=96.31%, comm=244MB] ^-- Off-heap sysMemPlc [used=0MB, free=99.98%, comm=100MB] ^-- Off-heap default [used=0MB, free=99.62%, comm=20MB] ^-- Off-heap metastoreMemPlc [used=0MB, free=99.96%, comm=100MB] ^-- Ignite persistence default [used=0MB] ^-- Outbound messages queue [size=0] ^-- Public thread pool [active=0, idle=6, qSize=0] ^-- System thread pool [active=0, idle=7, qSize=0] ^-- Custom executor 0 [active=0, idle=0, qSize=0] ^-- Custom executor 1 [active=0, idle=0, qSize=0] {noformat} was (Author: xtern): Hi [~dmagda], Do I understand correctly that we don't logging aggregated information about off-heap usage? Example of such output: {noformat} ^-- H/N/C [hosts=1, nodes=2, CPUs=8] ^-- CPU [cur=2.57%, avg=4.44%, GC=0%] ^-- PageMemory [pages=34] ^-- Heap [used=130MB, free=96.31%, comm=244MB] ^-- Off-heap sysMemPlc [used=0MB, free=99.98%, comm=100MB] ^-- Off-heap default [used=0MB, free=99.62%, comm=20MB] ^-- Off-heap metastoreMemPlc [used=0MB, free=99.96%, comm=100MB] ^-- Ignite persistence default [used=0MB] ^-- Outbound messages queue [size=0] ^-- Public thread pool [active=0, idle=6, qSize=0] ^-- System thread pool [active=0, idle=7, qSize=0] ^-- Custom executor 0 [active=0, idle=0, qSize=0] ^-- Custom executor 1 [active=0, idle=0, qSize=0] {noformat} > Wrong off-heap size is reported for a node > ------------------------------------------ > > Key: IGNITE-9305 > URL: https://issues.apache.org/jira/browse/IGNITE-9305 > Project: Ignite > Issue Type: Task > Affects Versions: 2.6 > Reporter: Denis Magda > Assignee: Pavel Pereslegin > Priority: Blocker > Fix For: 2.7 > > > Was troubleshooting an Ignite deployment today and couldn't find out from the > logs what was the actual off-heap space used. > Those were the given memory resoures (Ignite 2.6): > {code} > [2018-08-16 15:07:49,961][INFO ][main][GridDiscoveryManager] Topology > snapshot [ver=1, servers=1, clients=0, CPUs=64, offheap=30.0GB, heap=24.0GB] > {code} > And that weird stuff was reported by the node (pay attention to the last > line): > {code} > [2018-08-16 15:45:50,211][INFO > ][grid-timeout-worker-#135%cluster_31-Dec-2017%][IgniteKernal%cluster_31-Dec-2017] > > Metrics for local node (to disable set 'metricsLogFrequency' to 0) > ^-- Node [id=c033026e, name=cluster_31-Dec-2017, uptime=00:38:00.257] > ^-- H/N/C [hosts=1, nodes=1, CPUs=64] > ^-- CPU [cur=0.03%, avg=5.54%, GC=0%] > ^-- PageMemory [pages=6997377] > ^-- Heap [used=9706MB, free=61.18%, comm=22384MB] > ^-- Non heap [used=144MB, free=-1%, comm=148MB] - this line is always the > same! > {code} > Had to change the code by using > {code}dataRegion.getPhysicalMemoryPages(){code} to find out that actual > off-heap usage size was > {code} > >>> Physical Memory Size: 28651614208 => 27324 MB, 26 GB > {code} > The logs have to report the following instead: > {code} > ^-- Off-heap {Data Region 1} [used={dataRegion1.getPhysicalMemorySize()}, > free=X%, comm=dataRegion1.maxSize()] > ^-- Off-heap {Data Region 2} [used={dataRegion2.getPhysicalMemorySize()}, > free=X%, comm=dataRegion2.maxSize()] > {code} > If Ignite persistence is enabled then the following extra lines have to be > added to see the disk used space: > {code} > ^-- Ignite persistence {Data Region 1}: > used={dataRegion1.getTotalAllocatedSize() - > dataRegion1.getPhysicalMemorySize()} > ^-- Ignite persistence {Data Region 2} > [used={dataRegion2.getTotalAllocatedSize() - > dataRegion2.getPhysicalMemorySize()}] > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)