Re: Does Hbase backup process support encryption while transporting the data from one cluster to other cluster

2018-10-09 Thread Wei-Chiu Chuang
Hi neo0731, depending on what you mean by encryption, it can mean Hadoop at-rest encryption, Hadoop data transport encryption, Hadoop RPC necryption, HBase data transport encryption, Hbase RPC encryption, SSL encryption (Hadoop WebHDFS, HBase Thrift) distcp supports Hadoop at-rest encryption, and

Re: Does Hbase backup process support encryption while transporting the data from one cluster to other cluster

2018-10-09 Thread Ted Yu
bq. Does copyTable support hashing of data while copying? No. bq. Same for distcp utility ? The above would get better answer posting on hadoop mailing list. Thanks On Tue, Oct 9, 2018 at 5:28 AM neo0731 wrote: > > Question arises when migrating the data from one hbase table to another. >

Does Hbase backup process support encryption while transporting the data from one cluster to other cluster

2018-10-09 Thread neo0731
Question arises when migrating the data from one hbase table to another. Input To sync the production cluster data with dev cluster. Additionaly, while copying we need to re-hash the following fields: hashed_email, lexer_id, foo_imsi, foo_msn, signal_uid, bar_imsi. Question is : Does