[
https://issues.apache.org/jira/browse/DRILL-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13951551#comment-13951551
]
Aman Sinha commented on DRILL-443:
----------------------------------
Attached patch Drill-443-1.patch contains a patch for memory leaks reported
inside the HashAggregate and HashTable. This enables 3 of the TestHashAggr
tests to complete successfully.
However, there are 2 other tests in that file that report a leak inside
ParquetRecordReader .. see stack below. It's not clear if these are related to
HashAggregation or a more general issue with ParquetRecordReader. I have put
an 'Ignore' for those 2 tests for now. If this turns out to be more general
issue, I will open a separate bug.
Total 2 allocation(s) of byte size(s): 40000, 40000, at stack location:
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:96)
org.apache.drill.exec.memory.TopLevelAllocator$ChildAllocator.buffer(TopLevelAllocator.java:101)
org.apache.drill.exec.vector.BigIntVector.allocateNew(BigIntVector.java:103)
org.apache.drill.exec.vector.AllocationHelper.allocate(AllocationHelper.java:29)
org.apache.drill.exec.store.VectorHolder.allocateNew(VectorHolder.java:90)
org.apache.drill.exec.store.VectorHolder.reset(VectorHolder.java:73)
org.apache.drill.exec.store.parquet.ParquetRecordReader.resetBatch(ParquetRecordReader.java:275)
org.apache.drill.exec.store.parquet.ParquetRecordReader.next(ParquetRecordReader.java:333)
org.apache.drill.exec.physical.impl.ScanBatch.next(ScanBatch.java:94)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:107)
org.apache.drill.exec.record.AbstractSingleRecordBatch.next(AbstractSingleRecordBatch.java:42)
org.apache.drill.exec.physical.impl.validate.IteratorValidatorBatchIterator.next(IteratorValidatorBatchIterator.java:107)
org.apache.drill.exec.physical.impl.aggregate.HashAggBatch.next(HashAggBatch.java:105)
> HashAggregation leaking memory
> ------------------------------
>
> Key: DRILL-443
> URL: https://issues.apache.org/jira/browse/DRILL-443
> Project: Apache Drill
> Issue Type: Bug
> Reporter: Jacques Nadeau
> Assignee: Aman Sinha
> Attachments: Drill-443-1.patch
>
>
> TestHashAggr currently set to ignore due to memory leak. Enabling will show
> leak behaviors.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
