wgtmac commented on code in PR #50743:
URL: https://github.com/apache/arrow/pull/50743#discussion_r3688976953
##########
cpp/src/parquet/properties.h:
##########
@@ -492,6 +496,18 @@ class PARQUET_EXPORT WriterProperties {
return this;
}
+ /// Specify the max row group size in compressed bytes.
+ /// Default unlimited.
+ ///
+ /// The limit is checked against the compressed pages accumulated in the
+ /// current row group, so the actual row group size may slightly exceed it.
+ /// Only effective for buffered row groups (
+ /// parquet::arrow::FileWriter::WriteRecordBatch).
Review Comment:
IIRC, WriteTable also splits the table into several row groups if
max_row_group_length is reached.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
