ding-young opened a new pull request, #7627: URL: https://github.com/apache/arrow-rs/pull/7627
# Which issue does this PR close? Closes #7165 #7169 . # Rationale for this change Although `RowConverter` flattens data type on converting columns into rows, it builds array with original `SortField` which contains unflattened types when converting rows back into columns. Therefore, output array has inconsistent data type although it is actually flattened. # What changes are included in this PR? When decoding columns, instead of using original `SortField`, it uses new field with updated data type of child `ArrayData`, which is flattened. I've also considered alternative approaches like recursively modify all the `fields` on `convert_rows` or `convert_raw`, but considering that we already visit each field recursively, I just corrected the field in `decode_column` for simplicity. I'd be happy to hear about the feedback on correctness of this pr and any other suggestions. # Are there any user-facing changes? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
