shihuafeng created DRILL-8484: --------------------------------- Summary: An oom exception occurred When read data from Stream with container ,resulting in hashJoinPOP memory leak Key: DRILL-8484 URL: https://issues.apache.org/jira/browse/DRILL-8484 Project: Apache Drill Issue Type: Bug Components: Server Affects Versions: 1.21.1 Reporter: shihuafeng Fix For: 1.22.0
*Describe the bug* An oom exception occurred When read data from Stream with container ,resulting in hashJoinPOP memory leak *To Reproduce* prepare data for tpch 1s # 30 concurrent for tpch sql8 # set direct memory 5g # when it had OutOfMemoryException , stopped all sql. # finding memory leak *leak info* {code:java} Allocator(frag:5:0) 5000000/1000000/31067136/40041943040 (res/actual/peak/limit) child allocators: 1 Allocator(op:5:0:1:HashJoinPOP) 1000000/16384/22822912/41943040 (res/actual/peak/limit) child allocators: 0 ledgers: 2 ledger[1882757] allocator: op:5:0:1:HashJoinPOP), isOwning: true, size: 8192, references: 2, life: 16936270178816167..0, allocatorManager: [1703465, life: 16936270178813617..0] holds 4 buffers. DrillBuf[2041995], udle: [1703441 0..957]{code} execption info {code:java} Caused by: org.apache.drill.exec.exception.OutOfMemoryException: Unable to allocate buffer of size 16384 (rounded from 14359) due to memory limit (41943040). Current allocation: 22583616 at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:241) at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:216) at org.apache.drill.exec.cache.VectorAccessibleSerializable.readFromStreamWithContainer(VectorAccessibleSerializable.java:172) at org.apache.drill.exec.physical.impl.aggregate.SpilledRecordBatch.next(SpilledRecordBatch.java:157) ... 18 common frames omitted{code} -- This message was sent by Atlassian Jira (v8.20.10#820010)