alamb commented on PR #9697: URL: https://github.com/apache/arrow-rs/pull/9697#issuecomment-4260624825
Actually, I dug around and I think we *DO* have the API that is needed: https://docs.rs/parquet/58.0.0/parquet/arrow/push_decoder/struct.ParquetPushDecoder.html#method.try_next_reader So the idea would be instead of calling [`try_decode`](https://docs.rs/parquet/58.0.0/parquet/arrow/push_decoder/struct.ParquetPushDecoder.html#method.try_decode) the caller could call `try_next_reader` And then once a reader is returned, we could then clear out all the cached data (`clear_all_ranges`) and wait for the next request What do you think @HippoBaro ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
