Scott Sitar created HIVE-5344:
---------------------------------
Summary: DeprecatedLzoTextInputFormat never purges its lzo index
cache
Key: HIVE-5344
URL: https://issues.apache.org/jira/browse/HIVE-5344
Project: Hive
Issue Type: Bug
Components: File Formats
Affects Versions: 0.10.0
Environment: Debian 6, cloudera cdh4.2.0
Reporter: Scott Sitar
DeprecatedLzoTextInputFormat holds a cache of lzo indexes for every file that
it ever reads (so does LzoTextInputFormat), but this cache can grow in size
without bound and is never pruned.
We are running hive queries against lzo-compressed logs, connecting through
jdbc and hive-server2. HiveInputFormat stores a single instance of
DeprecatedLzoTextInputFormat, and will eventually run out of memory as this
cache grows out of control.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
