vigneshsiva11 commented on issue #6586: URL: https://github.com/apache/arrow-rs/issues/6586#issuecomment-3851998217
Hi, @kylebarron I’d like to work on this issue. From my understanding, ArrowArrayStreamReader currently assumes that the stream yields a StructArray and always constructs a RecordBatch, whereas the Arrow C Stream interface allows streams of generic ArrowArray. My plan is to: - Use the FFI_ArrowSchema to derive the actual DataType of the incoming array - Construct a generic ArrayRef from the stream instead of assuming Struct - Introduce a new reader that yields ArrayRef, while keeping the existing RecordBatch-based behavior intact for backward compatibility Please let me know if this approach aligns with the project direction. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
