[ https://issues.apache.org/jira/browse/HDFS-12591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16192007#comment-16192007 ]
Jonathan Eagles commented on HDFS-12591: ---------------------------------------- I can't comment regarding the whole of the jira, but it looks like there is a memory leak introduced by calling DBIterator.iterator() without calling close. Similar to work done in YARN-5368 > [READ] Implement LevelDBFileRegionFormat > ---------------------------------------- > > Key: HDFS-12591 > URL: https://issues.apache.org/jira/browse/HDFS-12591 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: hdfs > Reporter: Ewan Higgs > Priority: Minor > Attachments: HDFS-12591-HDFS-9806.001.patch > > > The existing work for HDFS-9806 uses an implementation of the {{FileRegion}} > read from a csv file. This is good for testability and diagnostic purposes, > but it is not very efficient for larger systems. > There should be a version that is similar to the {{TextFileRegionFormat}} > that instead uses LevelDB. -- This message was sent by Atlassian JIRA (v6.4.14#64029) --------------------------------------------------------------------- To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org