iemejia opened a new pull request, #3533:
URL: https://github.com/apache/parquet-java/pull/3533

   ## Summary
   
   - Replace `IntList.size()` slab-iteration with a simple `totalSize` counter 
incremented on each `add()`
   - Eliminates O(slabs) overhead from dictionary encoding hot paths where 
`size()` is called frequently
   
   ## Details
   
   `IntList.size()` was iterating over all slabs to sum their lengths on every 
call. For delta encoding writers that check size thresholds frequently, this 
becomes O(slabs) per check. With a running counter it's O(1).
   
   The improvement is primarily relevant for large row groups where the number 
of slabs grows.
   
   All 576 parquet-column tests pass.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to