scovich commented on issue #7870: URL: https://github.com/apache/arrow-rs/issues/7870#issuecomment-3038898636
> We probably want to make sure we can share the metadata across rows if desired (so in other words I don't think it should require starting a new metadata...) That's tricky, because we don't know, at the time we start a new variant, whether it will add new field names and/or use all existing ones. From a parquet dictionary encoding perspective, it's attractive to use one/few byte-identical metadata dictionaries for the whole column. But getting it wrong could bloat things really badly. > I suggest we postpone any more API changes here until we start working on actual variant cast kernels 🤔 Fair. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
