Paddy Horan created ARROW-6971: ---------------------------------- Summary: [Rust] Replace "RecordBatchReader" with "BatchIterator" Key: ARROW-6971 URL: https://issues.apache.org/jira/browse/ARROW-6971 Project: Apache Arrow Issue Type: Improvement Components: Rust, Rust - DataFusion Affects Versions: 0.15.0 Reporter: Paddy Horan Assignee: Paddy Horan Fix For: 1.0.0
As part of the recent reader work we introduced {code:java} // arrow::record_batch::RecordBatchReader{code} but in datafusion we have {code:java} // datafusion::physical_plan::BatchIterator {code} These two trait are almost identical (BatchIterator implements Send + Sync whereas RecordBatchReader does not). I propose we replace RecordBatchReader with BatchIterator (i.e. move it to arrow as it's generally useful outside of datafusion) and update parquet and data fusion accordingly. [~andygrove] [~liurenjie1024] do you see any issues with this? -- This message was sent by Atlassian Jira (v8.3.4#803005)