[
https://issues.apache.org/jira/browse/HIVE-17994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gopal V updated HIVE-17994:
---------------------------
Description:
On machines with slower NUMA, the hashmap lookup for
TypeInfo::getPrimitiveCategory is the slowest part of the vectorized
serialization loops. The static object references run hot with the NUMA access
speeds penalizing half the threads.
This lookup is done for every column, for every row - though vectorization
enforces that this type cannot change at all.
!vec-serialize-hashmap.png!
was:
On machines with slower NUMA, the hashmap lookup for
TypeInfo::getPrimitiveCategory is the slowest part of the vectorized
serialization loops. The static object references run hot with the NUMA access
speeds penalizing half the threads.
!vec-serialize-hashmap.png!
> Vectorization: Serialization bottlenecked on irrelevant hashmap lookup
> ----------------------------------------------------------------------
>
> Key: HIVE-17994
> URL: https://issues.apache.org/jira/browse/HIVE-17994
> Project: Hive
> Issue Type: Bug
> Reporter: Gopal V
> Attachments: vec-serialize-hashmap.png
>
>
> On machines with slower NUMA, the hashmap lookup for
> TypeInfo::getPrimitiveCategory is the slowest part of the vectorized
> serialization loops. The static object references run hot with the NUMA
> access speeds penalizing half the threads.
> This lookup is done for every column, for every row - though vectorization
> enforces that this type cannot change at all.
> !vec-serialize-hashmap.png!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
