kszucs opened a new pull request, #55639:
URL: https://github.com/apache/arrow/pull/55639

   ### Rationale for this change
   
   With content-defined chunking, list columns lose the chunk boundaries that 
fall at the start of a `WriteArrow()` call, so their pages depend on how the 
data is chunked in memory.
   
   ### What changes are included in this PR?
   
   The nested branch of the chunker keeps the empty chunk at offset 0 of a 
call, like the flat branches do, so the column writer closes the page left open 
by the previous call.
   
   ### Are these changes tested?
   
   Yes. A new test compares the pages of a chunked table and its combined 
version for each tested type, and the tests now check that no data page is 
empty.
   
   ### Are there any user-facing changes?
   
   No.
   
   ### Was AI used for this PR?
   
   In accordance to the [AI generation 
guidelines](https://arrow.apache.org/docs/dev/developers/overview.html#ai-generated-code),
 please disclose below whether and how AI was used in this PR.
   
   **PR code and description written by:**
   
   - [ ] Human
   - [x] AI
   
   **Reviewed before submission by:**
   
   - [x] Human
   - [ ] AI
   - [ ] Not reviewed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to