el-hult opened a new pull request, #55351:
URL: https://github.com/apache/arrow/pull/55351

   ### Rationale for this change
   Adresses part of issue #32723. 
   Using the parquet ReadTable functions fails on list of dicts, if they 
contain more than one row group.
   In such case, the data is in a chunked array. A NotImplemented guards stops 
this from being read.
   
   ### What changes are included in this PR?
   This PR is a minimal fix that addresses this in the case when the chunks can 
be combined into a single array.
   It does not address the overflow issues, and the preexisting 
arrow::Concatenate will throw on that. The error is propagated.
   
   ### Are these changes tested?
   One test case is added for this specific situation. It fails without the fix 
in reader.cc.
   No regressions on `parquet-arrow-reader-writer-test` found, which I also 
tested. 
   On macOS.
   
   ### Are there any user-facing changes?
   The users will be able to read a few more parquet files that were previously 
rejected.
   
   ### Was AI used for this PR?
   
   Yes. 
   
   Claude (Opus and Sonnet 5.5) was used for compiling information from 
existing issues and propose a solution. I decided to do a minimal fix, not 
addressing the overflow problems, to make sure I understand the PR. I also 
asked it to verify style guide and contributor process on 
https://arrow.apache.org/docs/dev/developers/guide/step_by_step/ hoping I dont 
miss any steps.
   
   **PR code and description written by:**
   
   - [x] Human (The PR text)
   - [x] AI (The code)
   
   **Reviewed before submission by:**
   
   - [x] Human
   - [ ] AI
   - [ ] Not reviewed
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to