Gopal V created HIVE-10940:
------------------------------
Summary: HiveInputFormat::pushFilters serializes PPD objects for
each getRecordReader call
Key: HIVE-10940
URL: https://issues.apache.org/jira/browse/HIVE-10940
Project: Hive
Issue Type: Bug
Components: File Formats
Affects Versions: 1.2.0
Reporter: Gopal V
Assignee: Sergey Shelukhin
{code}
String filterText = filterExpr.getExprString();
String filterExprSerialized = Utilities.serializeExpression(filterExpr);
{code}
the serializeExpression initializes Kryo and produces a new packed object for
every split.
HiveInputFormat::getRecordReader -> pushProjectionAndFilters -> pushFilters.
And Kryo is very slow to do this for a large filter clause.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
