Wes McKinney created ARROW-5428: ----------------------------------- Summary: [C++] Add option to set "read extent" in arrow::io::BufferedInputStream Key: ARROW-5428 URL: https://issues.apache.org/jira/browse/ARROW-5428 Project: Apache Arrow Issue Type: Improvement Components: C++ Reporter: Wes McKinney Fix For: 0.14.0
I'm looking at simplifying libparquet to use common IO interfaces rather than its own custom ones The {{parquet::BufferedInputStream}} interface has an option to not read beyond a particular number of bytes. For example, if we were reading a 32MB block with 1MB buffering, then we will not consume more than 32MB from the raw InputStream. This seems like a fairly trivial addition to {{arrow::io::BufferedInputStream}} to track total read bytes and do not read beyond the configured extent. We'll have to add a method like {{set_read_extent}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)