[jira] [Commented] (DRILL-8485) HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
[ https://issues.apache.org/jira/browse/DRILL-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830330#comment-17830330 ] ASF GitHub Bot commented on DRILL-8485: --- shfshihuafeng commented on PR #2891: URL: https://github.com/apache/drill/pull/2891#issuecomment-2017129746 > LGTM +1 Thanks @shfshihuafeng for all these memory leak fixes. I am honored to get your approved. > HashJoinPOP memory leak is caused by an oom exception when read data from > InputStream > - > > Key: DRILL-8485 > URL: https://issues.apache.org/jira/browse/DRILL-8485 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.21.1 >Reporter: shihuafeng >Priority: Major > Fix For: 1.21.1 > > > when traversing fieldList druing read data from InputStream, if the > intermediate process throw exception,we can not release previously > constructed vectors. it result in memory leak。 > it is similar to DRILL-8484 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8485) HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
[ https://issues.apache.org/jira/browse/DRILL-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830305#comment-17830305 ] ASF GitHub Bot commented on DRILL-8485: --- cgivre merged PR #2891: URL: https://github.com/apache/drill/pull/2891 > HashJoinPOP memory leak is caused by an oom exception when read data from > InputStream > - > > Key: DRILL-8485 > URL: https://issues.apache.org/jira/browse/DRILL-8485 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.21.1 >Reporter: shihuafeng >Priority: Major > Fix For: 1.21.1 > > > when traversing fieldList druing read data from InputStream, if the > intermediate process throw exception,we can not release previously > constructed vectors. it result in memory leak。 > it is similar to DRILL-8484 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (DRILL-8485) HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
[ https://issues.apache.org/jira/browse/DRILL-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17830261#comment-17830261 ] ASF GitHub Bot commented on DRILL-8485: --- shfshihuafeng opened a new pull request, #2891: URL: https://github.com/apache/drill/pull/2891 …n read data from InputStream # [DRILL-8485](https://issues.apache.org/jira/browse/DRILL-8485): HashJoinPOP memory leak is caused by an oom exception when read data from InputStream ## Description it is similar to [DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484) **exception info** ``` Caused by: org.apache.drill.exec.exception.OutOfMemoryException: Unable to allocate buffer of size 16384 (rounded from 15364) due to memory limit (41943040). Current allocation: 4337664 at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:241) at org.apache.drill.exec.memory.BaseAllocator.buffer(BaseAllocator.java:216) at org.apache.drill.exec.memory.BaseAllocator.read(BaseAllocator.java:856) ``` **leak info** ``` Allocator(frag:5:1) 500/100/27824128/40041943040 (res/actual/peak/limit) child allocators: 1 Allocator(op:5:1:1:HashJoinPOP) 100/16384/22822912/41943040 (res/actual/peak/limit) child allocators: 0 ledgers: 2 ledger[442780] allocator: op:5:1:1:HashJoinPOP), isOwning: true, size: 8192, references: 2, life: 4486836603491..0, allocatorManager: [390894, life: 4486836601180..0] holds 4 buffers. DrillBuf[458469], udle: [390895 1024..8192] event log for: DrillBuf[458469] ``` ## Documentation (Please describe user-visible changes similar to what should appear in the Drill documentation.) ## Testing The testing method for drill-8485 is the similar as for [DRILL-8484](https://issues.apache.org/jira/browse/DRILL-8484). we can throw exception in the method readVectors > HashJoinPOP memory leak is caused by an oom exception when read data from > InputStream > - > > Key: DRILL-8485 > URL: https://issues.apache.org/jira/browse/DRILL-8485 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.21.1 >Reporter: shihuafeng >Priority: Major > Fix For: 1.21.1 > > > when traversing fieldList druing read data from InputStream, if the > intermediate process throw exception,we can not release previously > constructed vectors. it result in memory leak。 > it is similar to DRILL-8484 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (DRILL-8485) HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
[ https://issues.apache.org/jira/browse/DRILL-8485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shihuafeng updated DRILL-8485: -- Description: when traversing fieldList druing read data from InputStream, if the intermediate process throw exception,we can not release previously constructed vectors. it result in memory leak。 it is similar to DRILL-8484 was: when traversing fieldList druing read data from InputStream, if the intermediate process throw exception,we can not release previously constructed vectors. it result in memory leak。 it is similar to [DRILL-8484] HashJoinPOP memory leak is caused by an oom exception when read data from Stream with container - ASF JIRA (apache.org) > HashJoinPOP memory leak is caused by an oom exception when read data from > InputStream > - > > Key: DRILL-8485 > URL: https://issues.apache.org/jira/browse/DRILL-8485 > Project: Apache Drill > Issue Type: Bug > Components: Server >Affects Versions: 1.21.1 >Reporter: shihuafeng >Priority: Major > Fix For: 1.21.1 > > > when traversing fieldList druing read data from InputStream, if the > intermediate process throw exception,we can not release previously > constructed vectors. it result in memory leak。 > it is similar to DRILL-8484 -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (DRILL-8485) HashJoinPOP memory leak is caused by an oom exception when read data from InputStream
shihuafeng created DRILL-8485: - Summary: HashJoinPOP memory leak is caused by an oom exception when read data from InputStream Key: DRILL-8485 URL: https://issues.apache.org/jira/browse/DRILL-8485 Project: Apache Drill Issue Type: Bug Components: Server Affects Versions: 1.21.1 Reporter: shihuafeng Fix For: 1.21.1 when traversing fieldList druing read data from InputStream, if the intermediate process throw exception,we can not release previously constructed vectors. it result in memory leak。 it is similar to [DRILL-8484] HashJoinPOP memory leak is caused by an oom exception when read data from Stream with container - ASF JIRA (apache.org) -- This message was sent by Atlassian Jira (v8.20.10#820010)
