b4l opened a new issue, #5004: URL: https://github.com/apache/arrow-rs/issues/5004
**Which part is this question about** Parquet record batch writer row group size **Describe your question** Is it possible to create a row group for each record batch written. **Additional context** When writing record batches, the parquet record batch writer creates row groups of size `max row group size`. This is unfortunate when the record batches are partitioned in a way to have high locality as they get split up and the statistic become less usable since the batches are `rechuncked`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
