Dandandan opened a new issue, #9582:
URL: https://github.com/apache/arrow-rs/issues/9582

   ## Description
   
   StringView dictionary decoding currently goes through an intermediate index 
buffer: decode indices → gather views. For RLE runs (which are common), this 
roundtrip is unnecessary.
   
   ## Proposed Changes
   
   - For RLE runs, use `repeat_n` to fill views directly, skipping the index 
buffer entirely
   - Pre-reserve output views capacity before the decode loop, eliminating 
per-chunk reallocation
   - Skip buffer management when all dictionary views are inlined (≤12 bytes)
   - Pre-reserve offsets in ByteArray dictionary decoding
   
   This eliminates the intermediate index buffer roundtrip for the common RLE 
case and reduces StringView dictionary decoding time by ~49% in benchmarks.
   
   🤖 Generated with [Claude Code](https://claude.com/claude-code)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to