[ https://issues.apache.org/jira/browse/HIVE-20279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16563552#comment-16563552 ]
Nishant Bangarwa commented on HIVE-20279: ----------------------------------------- +cc [~ashutoshc] Can you point to more details about the header/footer functionality. I don't think we need to check any of the checks for header/footer buffer for Druid - https://github.com/nishantmonu51/hive/blob/ba0217ff17501fb849d8999e808d37579db7b4f1/ql/src/java/org/apache/hadoop/hive/ql/io/HiveContextAwareRecordReader.java#L317 Can you please confirm ? > HiveContextAwareRecordReader slows down Druid Scan queries. > ------------------------------------------------------------ > > Key: HIVE-20279 > URL: https://issues.apache.org/jira/browse/HIVE-20279 > Project: Hive > Issue Type: Improvement > Reporter: Nishant Bangarwa > Assignee: Nishant Bangarwa > Priority: Major > Attachments: scan2.svg > > > HiveContextAwareRecordReader add lots of overhead for Druid Scan Queries. > See attached flame graph. > Looks like the operations for checking for existence of footer/header buffer > takes most of time For druid and other storage handlers that do not have > footer buffer we should skip the logic for checking the existence for storage > handlers atleast. -- This message was sent by Atlassian JIRA (v7.6.3#76005)