Hello! For an Array of mixed types, you can use a DenseUnion [1] or SparseUnion type [2].
For modeling as rows instead of columns, the short answer is "no" but you could store the pivot/rotation of the table (columns represent rows) or you can use something like a StructArray [3]. The data in the StructArray is essentially still column-oriented though (row values are not contiguous), but some access of values for the same row may be more ergonomic. Otherwise, if you really want contiguous row values (and not to store the pivot of the table) then... I'm pretty sure you don't want a columnar format. In which case, if you share what about Arrow interests you, then maybe someone can point you to an appropriate project or relevant feature. [1]: https://arrow.apache.org/docs/format/Columnar.html#dense-union [2]: https://arrow.apache.org/docs/format/Columnar.html#sparse-union [3]: https://arrow.apache.org/docs/format/Columnar.html#struct-layout Sent from Proton Mail for iOS On Thu, Feb 29, 2024 at 09:15, Eliran Noach (BLOOMBERG/ 120 PARK) <eno...@bloomberg.net> wrote: > Hello, > > our team is utilizing apache arrow in one of our projects. > We were wondering if it is possible to create an array and store elements of > different types. > We basically looking for a way to store different types say Double, Int, > String in a single array and be able to parse it when received by a different > application. > > we looked at all the array types and they all seem to be strongly typed > DoubleArray, Int32Array etc ... Same is true for scalar types > > ** we are also wondering if it is possible to model the array as rows and not > as columns ? I know this sounds like it goes against the apache arrow design > of columnar format, we are would still like to know if it is possible and if > so how it can be achieved. > > Thanks in Advanced, > Eliran >
signature.asc
Description: OpenPGP digital signature
