[
https://issues.apache.org/jira/browse/PARQUET-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xinli Shang updated PARQUET-1325:
---------------------------------
Description:
PARQUET-1178 proposed a mechanism for modular encryption and decryption of
Parquet files. On top of it, another layer need to be added to wrap up the
details of the usage of encryption/decryption and shield upper layer
application like Spark, Presto, Hive transparent.
The goal is no changes in the existing systems (i.e. Hive, Presto, Spark etc)
* Only update the parquet library and config
* Parquet schema should control the access
The code could be like below.
*ParquetWriter* (..., schema, ….) {
if(schema.hasCryptoColumn() && keys == null)
{ Keys = PluggableKeyManagement.getKeys(schema) }
……….
}
was:
PARQUET-1178 proposed a mechanism for modular encryption and decryption of
Parquet files. On top of it, another lay need to be added to wrap up the
details of the usage of encryption/decryption and shield upper layer
application like Spark, Presto, Hive transparent.
The goal is no changes in the existing systems (i.e. Hive, Presto, Spark etc)
* Only update the parquet library and config
* Parquet schema should control the access
The code could be like below.
*ParquetWriter* (..., schema, ….) {
if(schema.hasCryptoColumn() && keys == null) {
Keys = PluggableKeyManagement.getKeys(schema)
}
……….
}
> Parquet column access control support
> --------------------------------------
>
> Key: PARQUET-1325
> URL: https://issues.apache.org/jira/browse/PARQUET-1325
> Project: Parquet
> Issue Type: New Feature
> Components: parquet-mr
> Affects Versions: 1.10.1
> Reporter: Xinli Shang
> Priority: Major
> Labels: None
> Fix For: 1.10.1
>
> Original Estimate: 1,440h
> Remaining Estimate: 1,440h
>
> PARQUET-1178 proposed a mechanism for modular encryption and decryption of
> Parquet files. On top of it, another layer need to be added to wrap up the
> details of the usage of encryption/decryption and shield upper layer
> application like Spark, Presto, Hive transparent.
> The goal is no changes in the existing systems (i.e. Hive, Presto, Spark etc)
> * Only update the parquet library and config
> * Parquet schema should control the access
> The code could be like below.
> *ParquetWriter* (..., schema, ….) {
> if(schema.hasCryptoColumn() && keys == null)
> { Keys = PluggableKeyManagement.getKeys(schema) }
> ……….
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
