[
https://issues.apache.org/jira/browse/HIVE-7219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14031393#comment-14031393
]
Gopal V commented on HIVE-7219:
-------------------------------
1243 seconds to insert 1Tb, which is not bad at all.
The only ORC method which shows up on my profiler is the RedBlackTree::add().
> Improve performance of serialization utils in ORC
> -------------------------------------------------
>
> Key: HIVE-7219
> URL: https://issues.apache.org/jira/browse/HIVE-7219
> Project: Hive
> Issue Type: Improvement
> Components: File Formats
> Affects Versions: 0.14.0
> Reporter: Prasanth J
> Assignee: Prasanth J
> Attachments: HIVE-7219.1.patch, HIVE-7219.2.patch, HIVE-7219.3.patch,
> orc-read-perf-jmh-benchmark.png
>
>
> ORC uses serialization utils heavily for reading and writing data. The
> bitpacking and unpacking code in writeInts() and readInts() can be unrolled
> for better performance. Also double reader/writer performance can be improved
> by bulk reading/writing from/to byte array.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
