[ https://issues.apache.org/jira/browse/CARBONDATA-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ajantha Bhat resolved CARBONDATA-3787. -------------------------------------- Fix Version/s: 2.0.0 Resolution: Fixed > MemoryLeak in data load and compaction > --------------------------------------- > > Key: CARBONDATA-3787 > URL: https://issues.apache.org/jira/browse/CARBONDATA-3787 > Project: CarbonData > Issue Type: Bug > Reporter: Ajantha Bhat > Assignee: Kumar Vishal > Priority: Major > Fix For: 2.0.0 > > Time Spent: 10m > Remaining Estimate: 0h > > Direct byte buffer used in #3638, which has memory leak > > DirectByteBuffer are cleaned in offheap memory by JVM, when GC happens (when > heap is full). Consider a scenario, where heap is not full, but offheap is > getting full. In this case DirectByteBuffers is not cleaned as GC not > happened. This time we may get OOM from offheap memory and yarn may kill the > jvm process. So, it is better to clean up the DirectByteBuffers after the > usage by calling a reflection method. -- This message was sent by Atlassian Jira (v8.3.4#803005)