Re: RE: Difficulty in use Hbase fully distributed mode

[shanmuganathan.r]

Hi Gaojinchao,

      Thanks for your reply...



I will try it .
---- On Mon, 18 Jul 2011 16:35:48 +0530 Gaojinchao<gaojinc...@huawei.com> 
wrote ---- 


You need use ntp. 
 
You can reference: 
http://hbase.apache.org/book/os.html#ntp 
 
Hi Gan, 
 
 Thanks for your reply.. 
 
 
 
Now Hmaster and one of my region server working properly but another one region 
server(slave) not working . 
i am using the three node cluster 
 
 
master: namenode , datanode, tasktracker, jobtracker, zookeeper1,Hmaster 
slave: datanode, tasktracker, zookeeper2,Regionserver1 
slave001: datanode, tasktracker, zookeeper2,Regionserver1 
 
 
The log in the slave is 
 
2011-07-18 15:38:42,909 FATAL 
org.apache.hadoop.hbase.regionserver.HRegionServer: Master rejected startup 
because clock is out of sync 
org.apache.hadoop.hbase.ClockOutOfSyncException: 
org.apache.hadoop.hbase.ClockOutOfSyncException: Server 
slave,60020,1310983722679 has been rejected; Reported time is too far out of 
sync with master. Time difference of 33514ms > max allowed of 30000ms 
 
 at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 
 at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 
 at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 
 at java.lang.reflect.Constructor.newInstance(Constructor.java:532) 
 at 
org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:96)
 
 at 
org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:80)
 
 at 
org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1506)
 
 at 
org.apache.hadoop.hbase.regionserver.HRegionServer.tryReportForDuty(HRegionServer.java:1470)
 
 at 
org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:563) 
 at java.lang.Thread.run(Thread.java:636) 
Caused by: org.apache.hadoop.ipc.RemoteException: 
org.apache.hadoop.hbase.ClockOutOfSyncException: Server 
slave,60020,1310983722679 has been rejected; Reported time is too far out of 
sync with master. Time difference of 33514ms > max allowed of 30000ms 
 at 
org.apache.hadoop.hbase.master.ServerManager.checkClockSkew(ServerManager.java:181)
 
 at 
org.apache.hadoop.hbase.master.ServerManager.regionServerStartup(ServerManager.java:129)
 
 at 
org.apache.hadoop.hbase.master.HMaster.regionServerStartup(HMaster.java:613) 
 at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) 
 at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) 
 at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
 
 at java.lang.reflect.Method.invoke(Method.java:616) 
 at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570) 
 at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039) 
 
 
 at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771) 
 at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257) 
 at $Proxy5.regionServerStartup(Unknown Source) 
 at 
org.apache.hadoop.hbase.regionserver.HRegionServer.reportForDuty(HRegionServer.java:1502)
 
 ... 3 more 
 
 
Regards 
 
 
Shanmuganathan 
 
 
 
 
 
---- On Mon, 18 Jul 2011 14:54:25 +0530 Gan<ganxi...@gmail.com> 
wrote ---- 
 
try to use host name in hbase.rootdir instead of ip adress. 
 
On Mon, Jul 18, 2011 at 4:16 PM, Laurent Hatier 
<laurent.hat...@gmail.com> wrote: 
> Are you sure that Hadoop is started, because you use HDFS so you must 
start 
> it before HBase. 
> If not, try to change the HBase port to 60010 
> 
> 2011/7/18 shanmuganathan <shanmuganatha...@zohocorp.com> 
> 
>> Hi, 
>> 
>> I am new user for the hbase and I have trouble in starting 
HBase. 
>> I am using the hadoop-0.20.2, zookeeper 3.3.3 and Hbase 0.90.1 
>> My conf/hbase-site.xml is 
>> 
>> 
>> <property> 
>> <name>hbase.rootdir</name> 
>> 
<value>hdfs://192.168.107.142:54310/hbase</value> 
>> </property> 
>> 
>> <property> 
>> 
<name>hbase.cluster.distributed</name> 
>> <value>true</value> 
>> </property> 
>> 
>> <property> 
>> 
<name>hbase.zookeeper.property.clientPort</name> 
>> <value>2181</value> 
>> </property> 
>> 
>> <property> 
>> 
<name>hbase.zookeeper.property.dataDir</name> 
>> 
<value>/home/hadoop/zookeeperdata</value> 
>> </property> 
>> 
>> <property> 
>> <name>hbase.master.port</name> 
>> <value>60000</value> 
>> </property> 
>> 
>> <property> 
>> 
<name>hbase.zookeeper.quorum</name> 
>> 
<value>192.168.107.142,192.168.107.149,192.168.106.202</value>
 
>> </property> 
>> My Hadoop and zookeeper are working perfectly but when i 
started the HBase 
>> ,I 
>> got the following errors in log. Please give me the solution 
for this 
>> problem 
>> 2011-07-18 12:20:57,048 INFO 
>> org.apache.hadoop.hbase.master.ActiveMasterManager: 
>> Master=shanmuganathanr.zohocorpin.com:60000 
>> 2011-07-18 12:20:57,271 FATAL 
org.apache.hadoop.hbase.master.HMaster: 
>> Unhandled 
>> exception. Starting shutdown. 
>> java.lang.IllegalArgumentException: Wrong FS: 
>> hdfs://192.168.107.142:54310/hbase, expected: 
>> hdfs://shanmuganathanr.zohocorpin.com:54310 
>> at 
org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:310) 
>> at 
>> 
>> 
org.apache.hadoop.hdfs.DistributedFileSystem.checkPath(DistributedFileSystem.jav
 
>> a:99) 
>> at 
>> 
>> 
org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.j
 
>> ava:155) 
>> at 
>> 
>> 
org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem
 
>> .java:462) 
>> at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:648) 
>> at 
>> 
>> 
org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.ja
 
>> va:232) 
>> at 
>> 
>> 
org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(Ma
 
>> sterFileSystem.java:105) 
>> at 
org.apache.hadoop.hbase.master.MasterFileSystem.<init> 
>> (MasterFileSystem.java:90) 
>> at 
>> 
>> 
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:342) 
>> at 
org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:278) 
>> 2011-07-18 12:20:57,274 INFO 
org.apache.hadoop.hbase.master.HMaster: 
>> Aborting 
>> 2011-07-18 12:20:57,274 DEBUG 
org.apache.hadoop.hbase.master.HMaster: 
>> Stopping 
>> service threads 
>> 2011-07-18 12:20:57,274 INFO 
org.apache.hadoop.ipc.HBaseServer: Stopping 
>> server 
>> on 60000 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: IPC Server 
>> handler 1 on 60000: exiting 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: IPC Server 
>> handler 2 on 60000: exiting 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: IPC Server 
>> handler 0 on 60000: exiting 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: IPC Server 
>> handler 5 on 60000: exiting 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: IPC Server 
>> handler 4 on 60000: exiting 
>> 2011-07-18 12:20:57,275 INFO 
org.apache.hadoop.ipc.HBaseServer: Stopping 
>> IPC 
>> Server listener on 60000 
>> 
>> Thanks in advance, 
>> 
>> Regards 
>> Shanmuganathan 
>> 
>> 
> 
> 
> -- 
> Laurent HATIER 
> Étudiant en 2e année du Cycle Ingénieur à l'EISTI 
> 
 
 
 
-- 
Best wishes 
Gan, Xiyun