Re: Property-driven Parquet encryption

2020-07-12 Thread Gidon Gershinsky
Hi Micah, Thanks for your comments here, and at the design googledoc. We'll get started, we've got the input we were looking for. Cheers, Gidon

Fwd: Property-driven Parquet encryption

2020-07-10 Thread Gidon Gershinsky
Sorry, Micah, and thanks again. Cheers, Gidon -- Forwarded message - From: Gidon Gershinsky Date: Fri, Jul 10, 2020 at 10:41 AM Subject: Re: Property-driven Parquet encryption To: dev , Hi Michah, Thanks! I was hoping for community feedback, it's better to discuss

Re: Property-driven Parquet encryption

2020-07-10 Thread Gidon Gershinsky
cryptionConfig { > > std::string column_keys; > > std::string footer_key; > > std::string encryption_algorithm; > > }; > > > > Cheers, Gidon > > > > > > -- Forwarded message - > > From: Gidon Gershinsky >

Re: Property-driven Parquet encryption

2020-07-09 Thread Micah Kornfield
_kms_conf; > }; > > struct EncryptionConfig { > std::string column_keys; > std::string footer_key; > std::string encryption_algorithm; > }; > > Cheers, Gidon > > > -- Forwarded message - > From: Gidon Gershinsky > Date: T

Fwd: Property-driven Parquet encryption

2020-07-09 Thread Gidon Gershinsky
; }; Cheers, Gidon -- Forwarded message - From: Gidon Gershinsky Date: Tue, Jul 7, 2020 at 9:35 AM Subject: Property-driven Parquet encryption To: dev Cc: tham Hi all, We are working on the Parquet modular encryption, and are currently adding a high-level interface that allows

Property-driven Parquet encryption

2020-07-07 Thread Gidon Gershinsky
Hi all, We are working on the Parquet modular encryption, and are currently adding a high-level interface that allows to encrypt/decrypt parquet files via properties only (without calling the low level API). In the spark/parquet-mr domain, we're using the Hadoop configuration properties for that