zeapo edited a comment on pull request #7309: URL: https://github.com/apache/arrow/pull/7309#issuecomment-636706744
After sleeping on it, here's the 3rd option (exposing infer schema with BufReader): https://github.com/apache/arrow/compare/master...zeapo:feature/buffer-exposed The advantage is that it does not need the dependency on gzip and has little impact on the api. It also opens the way to have other formats support. However, this needs for the user to do manual seek (if the BufRead is on a File) and does not rely on the Builder. Unless a new builder with buffer is added. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
