alamb opened a new pull request, #8392: URL: https://github.com/apache/arrow-rs/pull/8392
# Which issue does this PR close? - closes https://github.com/apache/arrow-rs/issues/8319 - closes https://github.com/apache/arrow-rs/issues/8296 # Rationale for this change This is needed to read/write the Variant Parquet logical type. Note, this is broken out the larger PR here: - Broken out from https://github.com/apache/arrow-rs/pull/8365 We need a way to write Variant encoded data to/from parquet, and the current way the VariantArray is implemented doesn't work (panics when writing to parquet) Instead of a `impl Array` it seems the way to do this is using an Arrow Extension Type. See https://github.com/apache/arrow-rs/issues/8319#issuecomment-3285280543 for more details # What changes are included in this PR? 1. remove the `Array` impl for `VariantArray`, which forces explict conversions back/forth when reading/writing 2. remove the `Array` impl for `ShreddedVariantFieldArray`, which forces explicit conversions back/forth when reading/writing 3. Add `VariantType` extension type # Are these changes tested? Yes, with new code and tests # Are there any user-facing changes? Yes, but this is not yet stable / released, so these changes have no impact on the releasability of this code -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
