alamb commented on PR #7783:
URL: https://github.com/apache/arrow-rs/pull/7783#issuecomment-3033652862
> @alamb Do you think it is worth creating an arrow utility that abstracts
away string to variant conversion? i.e. a function that takes in a StringArray
(array of JSON strings some of which could be null), and returns a StructArray
(array of corresponding variants where nulls are propagated directly)? If so,
where should such functionality be in the codebase?
Yes I think that is an important function
I suggest calling it a `kernel` and putting it in a
`parquet-variant-compute` crate
Perhaps an API like this:
```rust
fn to_variant(array: &Array) -> StructArray {
...
}
```
>
> Also, adding this high-level functionality would also abstract away many
of the changes we make to the lower-level library. If we make changes to
`VariantBuilder` to require buffers from the caller, we could simply modify
this high-level function and users' workflows would stay the same.
This is a great idea
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
