Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-19 Thread Bryan Beaudreault
We are running about 40 HBase clusters, with over 5000 regionservers total. These are all running cdh5.16.2. We also have thousands of clients (from APIs to kafka workers to hadoop jobs, etc) hitting these various clusters, also running cdh5.16.2. We are starting to plan an upgrade to hbase 2.x an

RE: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-19 Thread Marc Hoppins
: user@hbase.apache.org Subject: Upgrading cdh5.16.2 to apache hbase 2.4 using replication EXTERNAL We are running about 40 HBase clusters, with over 5000 regionservers total. These are all running cdh5.16.2. We also have thousands of clients (from APIs to kafka workers to hadoop jobs, etc) hitting

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-19 Thread Bryan Beaudreault
the data > so cannot justify the exorbitant cost per node that cloudera are asking for > later versions. > > -Original Message- > From: Bryan Beaudreault > Sent: Wednesday, May 19, 2021 2:49 PM > To: user@hbase.apache.org > Subject: Upgrading cdh5.16.2 to apache hbase

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-19 Thread Sergey Semenoff
We are thinking about simulator issue. Our clusters much less - 4 by 100 RS however we need process data continuously too. So I created two clusters in AWS and tried enable replication between HBase 1.4.13 and 2.2.5. But have got error "table exists but descriptors are not the same" (I will put scr

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-20 Thread Wellington Chevreuil
Yes, replication interfaces are compatible between these two major versions. So I created two clusters in AWS and tried enable replication between HBase > 1.4.13 and 2.2.5. But have got error "table exists but descriptors are not > the same" (I will put screenshot in the attachment but not sure it

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-20 Thread bq zhao
We tested replication between Apache HBase1.4 and Apache HBase2.2. We found that if you use 'enable_table_replication' command to enable replication, it will compares table schemas before start. But HBase2 has more default parameters than HBase1, which leads to schema comparison failed. However, if

Re: Upgrading cdh5.16.2 to apache hbase 2.4 using replication

2021-05-29 Thread Anoop John
Yes the command enable_table_replication will check whether a table exists in peer cluster and if so compare the CFs. Ya you correctly said. The difference in the table description results in failure of this command. You can enable replication at src using the alter table command. We can fix thi