paleolimbot commented on issue #2063: URL: https://github.com/apache/arrow-adbc/issues/2063#issuecomment-2272077427
Thank you for opening! One of the challenges with the Postgres array type is that it can (in theory) have a different number of dimensions for each item, whereas in Arrow land we either need to know the number of dimensions in advance. For everything except a single dimension (where Arrow's `list` type can handle items of different sizes), we would need to know the complete shape in advance (and perhaps return the new tensor extension type). In the near term we could error when we encounter a number of dimensions that is not exactly one? I don't think we have a mechanism to "warn" or "notice" that we have potentially lost some information. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
