adonm opened a new pull request, #3829: URL: https://github.com/apache/iceberg-python/pull/3829
## What changes? Adds an opt-in `write.parquet.page-index-enabled` table property. When enabled, PyIceberg passes `write_page_index=True` to PyArrow's `ParquetWriter`, producing Parquet column and offset indexes for page-level predicate pruning. The default is `false`, preserving existing output and file-size behavior. ## Why? PyArrow supports page-index writing, but PyIceberg did not expose it through table properties. Readers such as ClickHouse can use these indexes to avoid decoding nonmatching pages for selective queries. ## Testing - Added a direct unit test for default/opt-in writer kwargs - Extended the existing Parquet writer-property integration parameterization - `PYTHONPATH=. uv run pytest tests/io/test_pyarrow.py -k parquet_page_index_writer_property -q` — passed - `ruff check` on changed Python files — passed - `git diff --check` — passed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
