Prasanth Jayachandran created HIVE-12450:
--------------------------------------------
Summary: OrcFileMergeOperator does not use correct compression
buffer size
Key: HIVE-12450
URL: https://issues.apache.org/jira/browse/HIVE-12450
Project: Hive
Issue Type: Bug
Affects Versions: 1.2.1, 1.2.0, 1.3.0, 2.0.0
Reporter: Prasanth Jayachandran
Assignee: Prasanth Jayachandran
OrcFileMergeOperator checks for compatibility before merging orc files. This
compatibility check include checking compression buffer size. But the output
file that is created does not honor the compression buffer size and always
defaults to 256KB. This will not be a problem when reading the orc file but can
create unwanted memory pressure because of wasted space within compression
buffer.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)