rok commented on issue #47254: URL: https://github.com/apache/arrow/issues/47254#issuecomment-3155595714
@ssvenkatesh as per [docs](https://duckdb.org/docs/stable/data/parquet/encryption.html#limitations) DuckDBs parquet encryption is not compatible with PyArrow's parquet encryption (PyArrow is just a wrapper around Arrow C++). I hoped that DuckDB only reads uniformly encrypted files, however even that appears to not be true [as per this gist](https://gist.github.com/rok/042d59b2fbf81034a63cb815e17d6daf). [Original DuckDBs encryption PR](https://github.com/duckdb/duckdb/pull/9392) states "We mostly follow the [Parquet Modular Encryption specification](https://github.com/apache/parquet-format/blob/master/Encryption.md), save for some details.". PyArrow aims for supporting the [encryption spec](https://github.com/apache/parquet-format/blob/master/Encryption.md) as do other parquet readers (e.g. arrow-rs) and would probably not support implementation specific encryption. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
