This seems like a common-enough data type that having a first-class logical type would be a good idea (perhaps even more so than UUID!). Compute engines would be able to implement kernels that provide manipulations of JSON data similar to what you can do with jq or GraphQL.
On Fri, Jul 29, 2022 at 1:43 PM Pradeep Gollakota <pgollak...@google.com.invalid> wrote: > > Hi Team! > > I filed ARROW-17255 to support the JSON logical type in Arrow. Initially > I'm only interested in C++ support that wraps a string. I imagine that as > Arrow and Parquet get more sophisticated, we might want to do more > interesting things (shredding?) with the JSON. > > David mentioned that there have been discussions around other "common" > extensions like UUID. Is this something that the community would be > interested in? My goal at the moment is to be able to export data from > BigQuery to Parquet with the correct LogicalType set in the exported files. > > Thanks! > Pradeep