kszucs opened a new pull request, #55639: URL: https://github.com/apache/arrow/pull/55639
### Rationale for this change With content-defined chunking, list columns lose the chunk boundaries that fall at the start of a `WriteArrow()` call, so their pages depend on how the data is chunked in memory. ### What changes are included in this PR? The nested branch of the chunker keeps the empty chunk at offset 0 of a call, like the flat branches do, so the column writer closes the page left open by the previous call. ### Are these changes tested? Yes. A new test compares the pages of a chunked table and its combined version for each tested type, and the tests now check that no data page is empty. ### Are there any user-facing changes? No. ### Was AI used for this PR? In accordance to the [AI generation guidelines](https://arrow.apache.org/docs/dev/developers/overview.html#ai-generated-code), please disclose below whether and how AI was used in this PR. **PR code and description written by:** - [ ] Human - [x] AI **Reviewed before submission by:** - [x] Human - [ ] AI - [ ] Not reviewed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
