more /etc/hosts ... 10.19.16.31 bjsh19-16-31.qbos.com wjsa-tsl02 ...
There will have six regionservers listed in web console, but only three in the configuration file, metadata tables also are not online [cid:ba7c1b9e-b930-424c-98ff-c2ea6d251a9e] [cid:df08b067-4ad2-4f4a-bdf5-fafdd9484996] Hmaster will be dead after a while. what should I do? snapshot: 2017-01-17 11:45:24,394 INFO [MASTER_SERVER_OPERATIONS-bjsh19-16-30:16000-0] master.AssignmentManager: Assigning hbase:namespace,,1484623643279.30fab746cb3b6ceadcbda421459204b9. to bjsh19-16-34.qbos.com,16020,1484623636195 2017-01-17 11:45:24,395 INFO [bjsh19-16-30:16000.activeMasterManager] master.AssignmentManager: Joined the cluster in 23ms, failover=true 2017-01-17 11:50:24,314 FATAL [bjsh19-16-30:16000.activeMasterManager] master.HMaster: Failed to become active master java.io.IOException: Timedout 300000ms waiting for namespace table to be assigned at org.apache.hadoop.hbase.master.TableNamespaceManager.start(TableNamespaceManager.java:104) at org.apache.hadoop.hbase.master.HMaster.initNamespace(HMaster.java:986) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:780) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:183) at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1652) at java.lang.Thread.run(Thread.java:745) 2017-01-17 11:50:24,315 FATAL [bjsh19-16-30:16000.activeMasterManager] master.HMaster: Master server abort: loaded coprocessors are: [] 2017-01-17 11:50:24,316 FATAL [bjsh19-16-30:16000.activeMasterManager] master.HMaster: Unhandled exception. Starting shutdown. ... 2017-01-17 11:27:17,926 INFO [regionserver/bjsh19-16-34.qbos.com/10.19.16.34:16020] regionserver.HRegionServer: Serving as wjsa-tsl05,16020,1 484623636195, RpcServer on bjsh19-16-34.qbos.com/10.19.16.34:16020, sessionid=0x154563e43e30179 2017-01-17 11:27:17,934 INFO [regionserver/bjsh19-16-34.qbos.com/10.19.16.34:16020] quotas.RegionServerQuotaManager: Quota support disabled 2017-01-17 11:27:23,966 INFO [PriorityRpcServer.handler=14,queue=0,port=16020] regionserver.RSRpcServices: Open hbase:namespace,,148462364327 9.30fab746cb3b6ceadcbda421459204b9. 2017-01-17 11:27:24,008 WARN [RS_OPEN_REGION-bjsh19-16-34:16020-0] zookeeper.ZKAssign: regionserver:16020-0x154563e43e30179, quorum=bjsh19-16 -30:2181,bjsh19-16-31:2181,bjsh19-16-32:2181, baseZNode=/hbase115new Attempt to transition the unassigned node for 30fab746cb3b6ceadcbda421459 204b9 from M_ZK_REGION_OFFLINE to RS_ZK_REGION_OPENING failed, the server that tried to transition was wjsa-tsl05,16020,1484623636195 not the expected bjsh19-16-34.qbos.com,16020,1484623636195 2017-01-17 11:27:24,008 WARN [RS_OPEN_REGION-bjsh19-16-34:16020-0] coordination.ZkOpenRegionCoordination: Failed transition from OFFLINE to O PENING for region=30fab746cb3b6ceadcbda421459204b9 2017-01-17 11:27:24,008 WARN [RS_OPEN_REGION-bjsh19-16-34:16020-0] handler.OpenRegionHandler: Region was hijacked? Opening cancelled for enco dedName=30fab746cb3b6ceadcbda421459204b9