Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Hi Dima, As suggest by you not run HDFS Blancer untill I run Major compaction. so till now what i did I added one node with same configuration as other node are. I did not run HDFS blancer due to this I am getting error on cloudera. I have performed Major compation now still I am getting error

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Hi Dima, I have added new node in my cluster and getting below error Dec 15, 8:23:14.549 AM ERROR org.apache.hadoop.hdfs.server.datanode.DiskBalancer Disk Balancer is not enabled. can you please suggest me what to in this case? Thanks Manjeet On Fri, Oct 7, 2016 at 6:33 PM, Dima Spivak

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Manjeet: 'C1' appeared twice in the first command below. Remove the first occurrence and try again. Cheers > On Oct 20, 2016, at 4:38 AM, Manjeet Singh wrote: > > Hi Jean, > > I recreated the table as same I create befor and I disabled it droped it > and run

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Hi Jean, I recreated the table as same I create befor and I disabled it droped it and run Major compaction and after that i again re create the table at this time I got above message below is my table create command create 'TEST_TABLE','C1',{ NAME => 'C1', COMPRESSION => 'SNAPPY' }

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Hi Manjeet, Probably because your table is not really deleted. Can you "list" the tables to confirm? For the balacing, just run a major compaction of your table and locallity will come back. JMS 2016-10-20 6:58 GMT-04:00 Manjeet Singh : > I have deleted my table but

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

I have deleted my table but when I am going to re -create it it said Family 'C1' already exists, the old one will be replaced i used below command echo -e "disable_all '.*'\ny" | hbase shell -n echo -e "drop_all '.*'\ny" | hbase shell -n Thanks Manjeet On Thu, Oct 20, 2016 at 4:19 PM, Manjeet

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Hi, in my dev enviorment my one data node get crashed and we removed that data node from cluster and by mistak I run HDFS Balancer insted of HBase Blancer and my HBase is down can any one suggest me how can I up the Hbase cluster On Fri, Oct 7, 2016 at 1:09 PM, Ted Yu

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

Yeah, just to reinforce what Ted is saying, DO NOT run HDFS's balancer if you use HBase. Doing so will move blocks in such a way as to destroy data locality and negatively impact HBase performance (until a major compaction in HBase is done). On Friday, October 7, 2016, Ted Yu

Re: [Query :] hbase rebalancing the data after adding new nodes in cluster

For #1, it depends on whether major compaction is disabled. If major compaction is enabled, timing of major compaction would affect the data locality. For #2, no. hdfs rebalance is orthogonal to hbase. For #3, perform major compaction at earliest convenience. On Thu, Oct 6, 2016 at 11:47 PM,

[Query :] hbase rebalancing the data after adding new nodes in cluster

Hi All, I have question on re balance, my query is how hbase rebalancing the data after adding new nodes in cluster ? 1.Do I need to explicitly rebalance hbase after adding the new node in