[
https://issues.apache.org/jira/browse/ARROW-8494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Micah Kornfield updated ARROW-8494:
-----------------------------------
Description:
This logic would attempt to create the data necessary for each field by passing
through the levels once for each field. it is expected that due to SIMD this
will perform better for nested data with shallow nesting, but due to repetitive
computation might perform worse for deep nested that include List-types.
At a high level the logic would be structured as:
{{for each field:}}
{{ for each rep/def level entry:}}
{{ update null bitmask and offsets.}}
was:This logic would attempt to create the data necessary for each field by
passing through the levels once for each field. it is expected that due to
SIMD this will perform better for nested data with shallow nesting, but due to
repetetive computation might perform worse for deep nested that include
List-types.
> [C++] Implement vectorized array reassembly logic
> -------------------------------------------------
>
> Key: ARROW-8494
> URL: https://issues.apache.org/jira/browse/ARROW-8494
> Project: Apache Arrow
> Issue Type: Sub-task
> Components: C++
> Reporter: Micah Kornfield
> Assignee: Micah Kornfield
> Priority: Major
>
> This logic would attempt to create the data necessary for each field by
> passing through the levels once for each field. it is expected that due to
> SIMD this will perform better for nested data with shallow nesting, but due
> to repetitive computation might perform worse for deep nested that include
> List-types.
>
> At a high level the logic would be structured as:
> {{for each field:}}
> {{ for each rep/def level entry:}}
> {{ update null bitmask and offsets.}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
