Since the specification explicitly mentions FixedSizeList, but the current conversion to/from parquet is expensive compared to doubles and other primitives (the nested type needs repetition and definition levels) should we discuss what’s the recommendation when integrating with other non-arrow systems or is that an implementation detail only? (Pandas, parquet)
Best regards, Adam Lippai On Wed, Mar 8, 2023 at 1:13 AM Alenka Frim <ale...@voltrondata.com.invalid> wrote: > > > > Just one comment, though: since we also define a separate "Tensor" IPC > > structure in Arrow, maybe we should state the relationship somewhere in > the > > documentation? (Even if the answer is "no relationship".) > > > > Agree David, thanks for bringing it up. > > I will add the information about "no relationship" to the Tensor IPC > structure into the spec and will also keep in mind to add it to the > documentation that follows the implementations. >
