jorisvandenbossche commented on code in PR #13983:
URL: https://github.com/apache/arrow/pull/13983#discussion_r999439418
##########
python/pyarrow/_dataset.pyx:
##########
@@ -2484,9 +2482,11 @@ cdef class Scanner(_Weakrefable):
record batches are overflowing memory then this method can be
called to reduce their size.
batch_readahead : int, default 16
- The number of batches to read ahead in a file. This might not work
- for all file formats. Increasing this number will increase
Review Comment:
Same here
##########
python/pyarrow/_dataset.pyx:
##########
@@ -2397,12 +2396,14 @@ cdef class Scanner(_Weakrefable):
record batches are overflowing memory then this method can be
called to reduce their size.
batch_readahead : int, default 16
- The number of batches to read ahead in a file. This might not work
- for all file formats. Increasing this number will increase
Review Comment:
It seems you (accidentally?) lost the "This might not work for all file
formats" ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
