andersonm-ibm opened a new pull request #10450: URL: https://github.com/apache/arrow/pull/10450
Exposes in PyArrow the high-level C++ API for Parquet encryption that was added in https://github.com/apache/arrow/pull/8023. Design document: https://docs.google.com/document/d/1i1M5f5azLEmASj9XQZ_aQLl5Fr5F0CvnyPPVu1xaD9U A test is added for writing and reading encrypted parquet files using a simple in-memory KMS, that is not to be used as an example of a KMS client. A separate PR will give an example KMS client. This PR handles only the file-level encryption. Dataset will be handled separately. The multithreading model is currently under investigation, so a lock is added to InternalFileDecryptor to prevent concurrency issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
