ctsk opened a new pull request, #7564:
URL: https://github.com/apache/arrow-rs/pull/7564
# Rationale for this change
When converting data into row format, a significant portion of cycles is
spent determining the lengths of the rows to be created. For columns with
fixed-size elements (determined by datatype), this calculation can be optimized
by avoiding writes to an intermediate vector for length tracking.
# What changes are included in this PR?
- Implements `LengthTracker` which only materializes lengths for
variable-size columns
- Updates length calculation in `row_lengths(..)` and offset computation in
`RowConverter::append` to use the `LengthTracker`
# Are there any user-facing changes?
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
