Re: HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Saad Mufti
Thank you everyone for the feedback. It was very helpful. Cheers. --- Saad Mufti On Fri, Aug 18, 2017 at 3:20 PM, Andrew Purtell wrote: > The Hadoop KMS in 2.6 or 2.7 can be suitable for demos or prototypes but I > would advise against using it for more than that. Recently the KMS

Re: HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Andrew Purtell
The Hadoop KMS in 2.6 or 2.7 can be suitable for demos or prototypes but I would advise against using it for more than that. Recently the KMS has seen a number of security improvements. Because it is fairly self contained, you can check out branch-2.8 or branch-2, build everything, extract the KMS,

Re: HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Sean Busbey
FWIW, you can check the set of issues CDH includes on top of whatever upstream release it's based on: http://archive.cloudera.com/cdh5/cdh/5/hadoop-2.6.0-cdh5.5.0.releasenotes.html C5.5.0+ should include HADOOP-11710. On Fri, Aug 18, 2017 at 12:55 PM, Josh Elser wrote: > Some specificity (as I

Re: HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Josh Elser
Some specificity (as I still remember it too vividly) https://issues.apache.org/jira/browse/HADOOP-11710 Our Sean got this one fixed for 2.6.1, and would by why using HDFS transparent encryption with 2.6.0 will flat-out not work :) On 8/18/17 1:35 PM, Ted Yu wrote: Please see the 'Hadoop 2.6

Re: HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Ted Yu
Please see the 'Hadoop 2.6.x' bullet under http://hbase.apache.org/book.html#hadoop FYI On Fri, Aug 18, 2017 at 10:25 AM, Saad Mufti wrote: > Hi, > > I'm looking for some guidance as our security team is requiring us to > implement encryption of our HBase data at rest and in motion. I'm reading

HBase Encryption - HDFS Vs HBase Level

2017-08-18 Thread Saad Mufti
Hi, I'm looking for some guidance as our security team is requiring us to implement encryption of our HBase data at rest and in motion. I'm reading the docs and doing research and the choice seems to be between doing it at the HBase level or the more general HDFS level. I am leaning towards HDFS