adamreeve commented on PR #46972: URL: https://github.com/apache/arrow/pull/46972#issuecomment-3046718785
I looked a bit closer at the `write_batch_size` parameter. This doesn't actually control how many values are written to a page, but just how many are written at once before checking whether the page size has reached the configured page size limit and writing out the page. From that mailing list thread, it sounds like other implementations have a byte based limit and a separate row count limit, but it doesn't look like there's a row limit in the C++ implementation. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
