Re: hbase data migration from one cluster to another cluster on different versions

2017-10-27 Thread Manjeet Singh
Dear Yang, Anil and Enric, I am now able to execute import command below are the steps as Hadoop version is different as well as Hbase version also differ from source and destination so First I used export command on destination cluster which by default move data to defined HDFS location I took

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread anil gupta
This blogpost from Pinterest can provide you more pointers: https://medium.com/@Pinterest_Engineering/upgrading-pinterest-to-hbase-1-2-from-0-94-e6e34c157783 On Wed, Oct 25, 2017 at 11:28 PM, Enrico Olivelli wrote: > I had the same problem. > I wrote a procedure to move data from 0.94 to 1.x. >

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread Enrico Olivelli
I had the same problem. I wrote a procedure to move data from 0.94 to 1.x. On github I have a prototype, which is not really the procedure used in my company but it can be useful to take as example https://github.com/eolivelli/multi-hbase Hope that helps Enrico Il gio 26 ott 2017, 08:24 Yung-An

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread Yung-An He
Hi Manjeet, I am sorry that I misunderstood your question. The hbase book http://hbase.apache.org/book.html#_upgrade_paths describes: "You must stop your cluster, install the 1.x.x software, run the migration described at Executing the 0.96 Upgrade

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread Manjeet Singh
Furthermore, clarity why I used scp command is : I have copy source cluster files to destination cluster by using scp command and put them into destination cluster HDFS (It's because of two different version of Haddop destination cluster hadoop is 1.2.1 and destination is having Hadoop 2.0 ) Firs

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread Manjeet Singh
Hi Yung, First thanks for reply The link provided by you is for upgrading the Hbase version and problem statement is different Problem is when I am trying to export hbase data from one cluster to another cluster in same N/W, but with a different hbase version i.e. 0.94.27 (source cluster hbase) a

Re: hbase data migration from one cluster to another cluster on different versions

2017-10-25 Thread Yung-An He
Hi, Have you seen the reference guide to make sure that the environment is ready for the upgrade? Perhaps you could try to copy the contents of /data/ExportedFiles to the HBase 1.2.1 cluster using distcp before import data instead of using "hdfs:/

Fwd: hbase data migration from one cluster to another cluster on different versions

2017-10-23 Thread Manjeet Singh
Hi All, Can anyone help? adding few more investigations I have move all files to the destination cluster hdfs and I have run below command:- sudo -u hdfs hbase org.apache.hadoop.hbase.mapreduce.Import test_table hdfs://:8020/data/ExportedFiles I am getting below error 17/10/23 16:13:50 INFO ma

hbase data migration from one cluster to another cluster on different versions

2017-10-23 Thread Manjeet Singh
Hi All, I have query regarding hbase data migration from one cluster to another cluster in same N/W, but with a different version of hbase one is 0.94.27 (source cluster hbase) and another is destination cluster hbase version is 1.2.1. I have used below command to take backup of hbase table on so