jorisvandenbossche commented on pull request #10132: URL: https://github.com/apache/arrow/pull/10132#issuecomment-825572200
> Do we need to add anywhere that the dataset scanning will use the streaming version and so this caveat applies to dataset scanning? I'm not sure where such a comment would go though since the dataset docs are format-agnostic and the CSV docs are dataset-agnostic. I think it would be good to have a section in the dataset docs that lists the supported formats, points to the format-specific docs with more details, and list any caveat like this one for CSV. (but that doesn't necessarily need to happen in this PR, to be clear) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
