RE: problem in launching HBase
When I learn the HBase operational guideline on the web, the directory "/home/testuser/zookeeper" doesn't need to be created according the web's step. Actually I think of whether that the directory can't be created result from the reason which the zookeeper can't attempt to authenticate using SASL, just because zookeeper can't set up a socket connection, it can't log on the localhost, and can't create a given directory according to the file--"hbase-stie.xml" configuration. Do you think? /2016-11-22 16:26:20,262 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2181. Will not attempt to authenticate using SASL (unknown error) 2016-11-22 16:26:20,266 WARN [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect java.net.ConnectException: Connection refused at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method) at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081) // http://hbase.apache.org/book.html#quickstart /You do not need to create the HBase data directory. HBase will do this for you. If you create the directory, HBase will attempt to do a migration, which is not what you want. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, November 23, 2016 12:03 PM To: user@hbase.apache.org Subject: Re: problem in launching HBase bq. Unable to create data dir /home/testuser/zookeeper Can you check why the above directory couldn't be created ? The attachment didn't come through. Consider using pastebin. Cheers On Tue, Nov 22, 2016 at 7:51 PM, QI Congyun wrote: > > It's confirmed. Actually. The attached files are including my > /etc/hosts and /hbase/conf/regionservers configuration. I try to > modify the regionservers and restart hbase, the problem appear again. > > > [hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh > localhost: starting zookeeper, logging to /home/hadoop/hbase-1.2.3/bin/. > ./logs/hbase-hadoop-zookeeper-hadoop2.out > localhost: java.io.IOException: Unable to create data dir > /home/testuser/zookeeper > localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer. > writeMyID(HQuorumPeer.java:157) > localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main( > HQuorumPeer.java:70) > starting master, logging to /home/hadoop/hbase-1.2.3/logs/ > hbase-hadoop-master-hadoop2.out > hadoop2: starting regionserver, logging to /home/hadoop/hbase-1.2.3/bin/. > ./logs/hbase-hadoop-regionserver-hadoop2.out > > > > -Original Message----- > From: Sen [mailto:besent...@gmail.com] > Sent: Tuesday, November 22, 2016 11:55 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > Did you ensure your etc/hosts file has the IP addresses of the Hbase > server? > > On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu wrote: > > > I think hbase 1.2.3 should run fine with Hadoop 2.7.3 > > > > Can you replace localhost in your hbase-site.xml and try again > > (remember to set corresponding entry in /etc/hosts) ? > > > > BTW I would be out of office starting tomorrow morning. > > > > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < > > congyun...@alcatel-sbell.com.cn> wrote: > > > > > Hello Ted, > > > > > > I try to remove the folder of Hbase and re-install it many times, > > > the > > same > > > faults below happened. > > > I doubt whether the version of HBase1.2.3 is incompatible with the > > version > > > of Hadoop2.7.3? I search out the similar issues via the internet, > > > the similar issue happened very few. > > > I'm very bewildered, could you help to find the reasons? > > > > > > Thanks. > > > > > > > > > -Original Message- > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > Sent: Wednesday, November 16, 2016 11:13 AM > > > To: user@hbase.apache.org > > > Subject: Re: problem in launching HBase > > > > > > 2016-10-31 15:49:57,503 INFO > > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] > > > zookeeper.Cl
Re: problem in launching HBase
bq. Unable to create data dir /home/testuser/zookeeper Can you check why the above directory couldn't be created ? The attachment didn't come through. Consider using pastebin. Cheers On Tue, Nov 22, 2016 at 7:51 PM, QI Congyun wrote: > > It's confirmed. Actually. The attached files are including my /etc/hosts > and /hbase/conf/regionservers configuration. I try to modify the > regionservers and restart hbase, the problem appear again. > > > [hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh > localhost: starting zookeeper, logging to /home/hadoop/hbase-1.2.3/bin/. > ./logs/hbase-hadoop-zookeeper-hadoop2.out > localhost: java.io.IOException: Unable to create data dir > /home/testuser/zookeeper > localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer. > writeMyID(HQuorumPeer.java:157) > localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main( > HQuorumPeer.java:70) > starting master, logging to /home/hadoop/hbase-1.2.3/logs/ > hbase-hadoop-master-hadoop2.out > hadoop2: starting regionserver, logging to /home/hadoop/hbase-1.2.3/bin/. > ./logs/hbase-hadoop-regionserver-hadoop2.out > > > > -Original Message- > From: Sen [mailto:besent...@gmail.com] > Sent: Tuesday, November 22, 2016 11:55 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > Did you ensure your etc/hosts file has the IP addresses of the Hbase > server? > > On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu wrote: > > > I think hbase 1.2.3 should run fine with Hadoop 2.7.3 > > > > Can you replace localhost in your hbase-site.xml and try again > > (remember to set corresponding entry in /etc/hosts) ? > > > > BTW I would be out of office starting tomorrow morning. > > > > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < > > congyun...@alcatel-sbell.com.cn> wrote: > > > > > Hello Ted, > > > > > > I try to remove the folder of Hbase and re-install it many times, > > > the > > same > > > faults below happened. > > > I doubt whether the version of HBase1.2.3 is incompatible with the > > version > > > of Hadoop2.7.3? I search out the similar issues via the internet, > > > the similar issue happened very few. > > > I'm very bewildered, could you help to find the reasons? > > > > > > Thanks. > > > > > > > > > -Original Message- > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > Sent: Wednesday, November 16, 2016 11:13 AM > > > To: user@hbase.apache.org > > > Subject: Re: problem in launching HBase > > > > > > 2016-10-31 15:49:57,503 INFO > > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] > > > zookeeper.ClientCnxn: Opening socket connection to server > > > localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate > > > using SASL (unknown error) > > > > > > Is your machine running IPv6 ? > > > > > > I don't have much experience with IPv6. > > > > > > Cheers > > > > > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun < > > congyun...@alcatel-sbell.com. > > > cn > > > > wrote: > > > > > > > Hi, Ted, > > > > > > > > Do you feel what I make some incorrect configuration lead to my > > > > encountering issues? > > > > Thanks. > > > > > > > > > > > > -Original Message- > > > > From: QI Congyun > > > > Sent: Tuesday, November 15, 2016 1:29 PM > > > > To: user@hbase.apache.org > > > > Subject: RE: problem in launching HBase > > > > > > > > > > > > I'm so sorry that I make a mistake. The Hadoop configuration files > > > > are attached in the previous e-mail. > > > > > > > > The hbase-site.xml are attached, pls check it. > > > > > > > > > > > > > > > > -Original Message- > > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > > Sent: Tuesday, November 15, 2016 1:25 PM > > > > To: user@hbase.apache.org > > > > Su
RE: problem in launching HBase
It's confirmed. Actually. The attached files are including my /etc/hosts and /hbase/conf/regionservers configuration. I try to modify the regionservers and restart hbase, the problem appear again. [hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh localhost: starting zookeeper, logging to /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-zookeeper-hadoop2.out localhost: java.io.IOException: Unable to create data dir /home/testuser/zookeeper localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.writeMyID(HQuorumPeer.java:157) localhost: at org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(HQuorumPeer.java:70) starting master, logging to /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-master-hadoop2.out hadoop2: starting regionserver, logging to /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-regionserver-hadoop2.out -Original Message- From: Sen [mailto:besent...@gmail.com] Sent: Tuesday, November 22, 2016 11:55 PM To: user@hbase.apache.org Subject: Re: problem in launching HBase Did you ensure your etc/hosts file has the IP addresses of the Hbase server? On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu wrote: > I think hbase 1.2.3 should run fine with Hadoop 2.7.3 > > Can you replace localhost in your hbase-site.xml and try again > (remember to set corresponding entry in /etc/hosts) ? > > BTW I would be out of office starting tomorrow morning. > > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < > congyun...@alcatel-sbell.com.cn> wrote: > > > Hello Ted, > > > > I try to remove the folder of Hbase and re-install it many times, > > the > same > > faults below happened. > > I doubt whether the version of HBase1.2.3 is incompatible with the > version > > of Hadoop2.7.3? I search out the similar issues via the internet, > > the similar issue happened very few. > > I'm very bewildered, could you help to find the reasons? > > > > Thanks. > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Wednesday, November 16, 2016 11:13 AM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > 2016-10-31 15:49:57,503 INFO > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] > > zookeeper.ClientCnxn: Opening socket connection to server > > localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate > > using SASL (unknown error) > > > > Is your machine running IPv6 ? > > > > I don't have much experience with IPv6. > > > > Cheers > > > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun < > congyun...@alcatel-sbell.com. > > cn > > > wrote: > > > > > Hi, Ted, > > > > > > Do you feel what I make some incorrect configuration lead to my > > > encountering issues? > > > Thanks. > > > > > > > > > -Original Message- > > > From: QI Congyun > > > Sent: Tuesday, November 15, 2016 1:29 PM > > > To: user@hbase.apache.org > > > Subject: RE: problem in launching HBase > > > > > > > > > I'm so sorry that I make a mistake. The Hadoop configuration files > > > are attached in the previous e-mail. > > > > > > The hbase-site.xml are attached, pls check it. > > > > > > > > > > > > -Original Message- > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > Sent: Tuesday, November 15, 2016 1:25 PM > > > To: user@hbase.apache.org > > > Subject: Re: problem in launching HBase > > > > > > I don't see hbase-site.xml attached. > > > > > > Consider using pastebin. > > > > > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun < > > congyun...@alcatel-sbell.com. > > > cn > > > > wrote: > > > > > > > > > > > The name node and data node are running normally, such as the > > > > following process. The file "hbase-site.xml" and other > > > > associated files > > > are enclosed. > > > > Thanks. > > > > > > > > > > > > > > > > --- > > > > [hadoop@hadoop2 conf]$ j
Re: problem in launching HBase
Did you ensure your etc/hosts file has the IP addresses of the Hbase server? On Tue, Nov 22, 2016 at 8:39 PM, Ted Yu wrote: > I think hbase 1.2.3 should run fine with Hadoop 2.7.3 > > Can you replace localhost in your hbase-site.xml and try again (remember to > set corresponding entry in /etc/hosts) ? > > BTW I would be out of office starting tomorrow morning. > > On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < > congyun...@alcatel-sbell.com.cn> wrote: > > > Hello Ted, > > > > I try to remove the folder of Hbase and re-install it many times, the > same > > faults below happened. > > I doubt whether the version of HBase1.2.3 is incompatible with the > version > > of Hadoop2.7.3? I search out the similar issues via the internet, the > > similar issue happened very few. > > I'm very bewildered, could you help to find the reasons? > > > > Thanks. > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Wednesday, November 16, 2016 11:13 AM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > 2016-10-31 15:49:57,503 INFO > > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] > > zookeeper.ClientCnxn: Opening socket connection to server > > localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using > > SASL (unknown error) > > > > Is your machine running IPv6 ? > > > > I don't have much experience with IPv6. > > > > Cheers > > > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun < > congyun...@alcatel-sbell.com. > > cn > > > wrote: > > > > > Hi, Ted, > > > > > > Do you feel what I make some incorrect configuration lead to my > > > encountering issues? > > > Thanks. > > > > > > > > > -Original Message- > > > From: QI Congyun > > > Sent: Tuesday, November 15, 2016 1:29 PM > > > To: user@hbase.apache.org > > > Subject: RE: problem in launching HBase > > > > > > > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > > > attached in the previous e-mail. > > > > > > The hbase-site.xml are attached, pls check it. > > > > > > > > > > > > -Original Message- > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > Sent: Tuesday, November 15, 2016 1:25 PM > > > To: user@hbase.apache.org > > > Subject: Re: problem in launching HBase > > > > > > I don't see hbase-site.xml attached. > > > > > > Consider using pastebin. > > > > > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun < > > congyun...@alcatel-sbell.com. > > > cn > > > > wrote: > > > > > > > > > > > The name node and data node are running normally, such as the > > > > following process. The file "hbase-site.xml" and other associated > > > > files > > > are enclosed. > > > > Thanks. > > > > > > > > > > > > --- > > > > [hadoop@hadoop2 conf]$ jps > > > > 11805 SecondaryNameNode > > > > 32314 Jps > > > > 11614 DataNode > > > > 507 NodeManager > > > > 385 ResourceManager > > > > 11379 NameNode > > > > > > > > > > > > -- > > > > -- > > > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks > > > > (with replication factor 1): 0 > > > > > > > > - > > > > > > > > Live datanodes (1): > > > > > > > > Name: 127.0.0.1:9866 (localhost) > > > > Hostname: localhost > > > > Decommission Status : Normal > > > > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > > > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remai
Re: problem in launching HBase
I think hbase 1.2.3 should run fine with Hadoop 2.7.3 Can you replace localhost in your hbase-site.xml and try again (remember to set corresponding entry in /etc/hosts) ? BTW I would be out of office starting tomorrow morning. On Tue, Nov 22, 2016 at 12:44 AM, QI Congyun < congyun...@alcatel-sbell.com.cn> wrote: > Hello Ted, > > I try to remove the folder of Hbase and re-install it many times, the same > faults below happened. > I doubt whether the version of HBase1.2.3 is incompatible with the version > of Hadoop2.7.3? I search out the similar issues via the internet, the > similar issue happened very few. > I'm very bewildered, could you help to find the reasons? > > Thanks. > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Wednesday, November 16, 2016 11:13 AM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > 2016-10-31 15:49:57,503 INFO > [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] > zookeeper.ClientCnxn: Opening socket connection to server > localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using > SASL (unknown error) > > Is your machine running IPv6 ? > > I don't have much experience with IPv6. > > Cheers > > On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun cn > > wrote: > > > Hi, Ted, > > > > Do you feel what I make some incorrect configuration lead to my > > encountering issues? > > Thanks. > > > > > > -Original Message- > > From: QI Congyun > > Sent: Tuesday, November 15, 2016 1:29 PM > > To: user@hbase.apache.org > > Subject: RE: problem in launching HBase > > > > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > > attached in the previous e-mail. > > > > The hbase-site.xml are attached, pls check it. > > > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 1:25 PM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > I don't see hbase-site.xml attached. > > > > Consider using pastebin. > > > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun < > congyun...@alcatel-sbell.com. > > cn > > > wrote: > > > > > > > > The name node and data node are running normally, such as the > > > following process. The file "hbase-site.xml" and other associated > > > files > > are enclosed. > > > Thanks. > > > > > > > > > --- > > > [hadoop@hadoop2 conf]$ jps > > > 11805 SecondaryNameNode > > > 32314 Jps > > > 11614 DataNode > > > 507 NodeManager > > > 385 ResourceManager > > > 11379 NameNode > > > > > > > > > -- > > > -- > > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks > > > (with replication factor 1): 0 > > > > > > - > > > > > > Live datanodes (1): > > > > > > Name: 127.0.0.1:9866 (localhost) > > > Hostname: localhost > > > Decommission Status : Normal > > > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > > > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > > > Xceivers: 1 > > > Last contact: Tue Nov 15 13:17:01 CST 2016 > > > . > > > > > > .. > > > > > > > > > > > > -Original Message- > > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > > Sent: Tuesday, November 15, 2016 11:50 AM > > >
RE: problem in launching HBase
Hello Ted, I try to remove the folder of Hbase and re-install it many times, the same faults below happened. I doubt whether the version of HBase1.2.3 is incompatible with the version of Hadoop2.7.3? I search out the similar issues via the internet, the similar issue happened very few. I'm very bewildered, could you help to find the reasons? Thanks. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, November 16, 2016 11:13 AM To: user@hbase.apache.org Subject: Re: problem in launching HBase 2016-10-31 15:49:57,503 INFO [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using SASL (unknown error) Is your machine running IPv6 ? I don't have much experience with IPv6. Cheers On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun wrote: > Hi, Ted, > > Do you feel what I make some incorrect configuration lead to my > encountering issues? > Thanks. > > > -Original Message- > From: QI Congyun > Sent: Tuesday, November 15, 2016 1:29 PM > To: user@hbase.apache.org > Subject: RE: problem in launching HBase > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > attached in the previous e-mail. > > The hbase-site.xml are attached, pls check it. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 1:25 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > I don't see hbase-site.xml attached. > > Consider using pastebin. > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun cn > > wrote: > > > > > The name node and data node are running normally, such as the > > following process. The file "hbase-site.xml" and other associated > > files > are enclosed. > > Thanks. > > > > > > --- > > [hadoop@hadoop2 conf]$ jps > > 11805 SecondaryNameNode > > 32314 Jps > > 11614 DataNode > > 507 NodeManager > > 385 ResourceManager > > 11379 NameNode > > > > > > -- > > -- > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks > > (with replication factor 1): 0 > > > > - > > > > Live datanodes (1): > > > > Name: 127.0.0.1:9866 (localhost) > > Hostname: localhost > > Decommission Status : Normal > > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > > Xceivers: 1 > > Last contact: Tue Nov 15 13:17:01 CST 2016 > > . > > > > .. > > > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 11:50 AM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > > master.HMaster: Failed to become active master > > java.net.ConnectException: Call From hadoop2/127.0.0.1 to > > localhost:8020 failed on connection exception: > > java.net.ConnectException: Connection refused; For more details see: > > http://wiki.apache.org/hadoop/ConnectionRefused > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > > at > > sun.reflect.NativeConstructorAccessorImpl.newInstance( > > NativeConstructorAccessorImpl.java:57) > > ... > > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > > at > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > > DistributedFileSystem.java:986) > > at > > org.apache.hadoop.h
RE: problem in launching HBase
My PC's interface config: [hadoop@hadoop2 ~]$ ifconfig eth0 Link encap:Ethernet HWaddr 78:E7:D1:C6:D5:D5 inet addr:10.9.41.66 Bcast:10.9.41.255 Mask:255.255.255.0 inet6 addr: fe80::7ae7:d1ff:fec6:d5d5/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:561508251 errors:0 dropped:0 overruns:0 frame:0 TX packets:4087516 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:160222463384 (149.2 GiB) TX bytes:1023949271 (976.5 MiB) Interrupt:19 Memory:f050-f052 eth1 Link encap:Ethernet HWaddr 00:1B:21:54:0F:D6 inet6 addr: fe80::21b:21ff:fe54:fd6/64 Scope:Link UP BROADCAST MULTICAST MTU:1500 Metric:1 RX packets:8942 errors:0 dropped:0 overruns:0 frame:0 TX packets:24 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:779591 (761.3 KiB) TX bytes:1738 (1.6 KiB) loLink encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:7728518 errors:0 dropped:0 overruns:0 frame:0 TX packets:7728518 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:5955537791 (5.5 GiB) TX bytes:5955537791 (5.5 GiB) virbr0Link encap:Ethernet HWaddr 52:54:00:72:E6:9F inet addr:192.168.122.1 Bcast:192.168.122.255 Mask:255.255.255.0 UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:0 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) -Original Message- From: QI Congyun Sent: Wednesday, November 16, 2016 11:17 AM To: user@hbase.apache.org Subject: RE: problem in launching HBase My server is configured a static IPV4 address, not IPV6, I don't understand why the IPV6 address alarm is raised, the master/localhost is banded an IPV4 address:127.0.0.1 -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, November 16, 2016 11:13 AM To: user@hbase.apache.org Subject: Re: problem in launching HBase 2016-10-31 15:49:57,503 INFO [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using SASL (unknown error) Is your machine running IPv6 ? I don't have much experience with IPv6. Cheers On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun wrote: > Hi, Ted, > > Do you feel what I make some incorrect configuration lead to my > encountering issues? > Thanks. > > > -Original Message- > From: QI Congyun > Sent: Tuesday, November 15, 2016 1:29 PM > To: user@hbase.apache.org > Subject: RE: problem in launching HBase > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > attached in the previous e-mail. > > The hbase-site.xml are attached, pls check it. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 1:25 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > I don't see hbase-site.xml attached. > > Consider using pastebin. > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun cn > > wrote: > > > > > The name node and data node are running normally, such as the > > following process. The file "hbase-site.xml" and other associated > > files > are enclosed. > > Thanks. > > > > > > --- > > [hadoop@hadoop2 conf]$ jps > > 11805 SecondaryNameNode > > 32314 Jps > > 11614 DataNode > > 507 NodeManager > > 385 ResourceManager > > 11379 NameNode > > > > > > -- > > -- > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks > > (with replication factor 1): 0 > > > > - > > > > Live datanodes (1): > > > > Name: 127.0.0.1:9866 (localhost) > > Hostname: l
RE: problem in launching HBase
My server is configured a static IPV4 address, not IPV6, I don't understand why the IPV6 address alarm is raised, the master/localhost is banded an IPV4 address:127.0.0.1 -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Wednesday, November 16, 2016 11:13 AM To: user@hbase.apache.org Subject: Re: problem in launching HBase 2016-10-31 15:49:57,503 INFO [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using SASL (unknown error) Is your machine running IPv6 ? I don't have much experience with IPv6. Cheers On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun wrote: > Hi, Ted, > > Do you feel what I make some incorrect configuration lead to my > encountering issues? > Thanks. > > > -Original Message- > From: QI Congyun > Sent: Tuesday, November 15, 2016 1:29 PM > To: user@hbase.apache.org > Subject: RE: problem in launching HBase > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > attached in the previous e-mail. > > The hbase-site.xml are attached, pls check it. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 1:25 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > I don't see hbase-site.xml attached. > > Consider using pastebin. > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun cn > > wrote: > > > > > The name node and data node are running normally, such as the > > following process. The file "hbase-site.xml" and other associated > > files > are enclosed. > > Thanks. > > > > > > --- > > [hadoop@hadoop2 conf]$ jps > > 11805 SecondaryNameNode > > 32314 Jps > > 11614 DataNode > > 507 NodeManager > > 385 ResourceManager > > 11379 NameNode > > > > > > -- > > -- > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks > > (with replication factor 1): 0 > > > > - > > > > Live datanodes (1): > > > > Name: 127.0.0.1:9866 (localhost) > > Hostname: localhost > > Decommission Status : Normal > > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > > Xceivers: 1 > > Last contact: Tue Nov 15 13:17:01 CST 2016 > > . > > > > .. > > > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 11:50 AM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > > master.HMaster: Failed to become active master > > java.net.ConnectException: Call From hadoop2/127.0.0.1 to > > localhost:8020 failed on connection exception: > > java.net.ConnectException: Connection refused; For more details see: > > http://wiki.apache.org/hadoop/ConnectionRefused > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > > at > > sun.reflect.NativeConstructorAccessorImpl.newInstance( > > NativeConstructorAccessorImpl.java:57) > > ... > > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > > at > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > > DistributedFileSystem.java:986) > > at > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > > DistributedFileSystem.java:970) > > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) > > at >
Re: problem in launching HBase
2016-10-31 15:49:57,503 INFO [master/localhost/127.0.0.1:16000-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/0:0:0:0:0:0:0:1: 2181. Will not attempt to authenticate using SASL (unknown error) Is your machine running IPv6 ? I don't have much experience with IPv6. Cheers On Tue, Nov 15, 2016 at 6:59 PM, QI Congyun wrote: > Hi, Ted, > > Do you feel what I make some incorrect configuration lead to my > encountering issues? > Thanks. > > > -Original Message- > From: QI Congyun > Sent: Tuesday, November 15, 2016 1:29 PM > To: user@hbase.apache.org > Subject: RE: problem in launching HBase > > > I'm so sorry that I make a mistake. The Hadoop configuration files are > attached in the previous e-mail. > > The hbase-site.xml are attached, pls check it. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 1:25 PM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > I don't see hbase-site.xml attached. > > Consider using pastebin. > > On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun cn > > wrote: > > > > > The name node and data node are running normally, such as the > > following process. The file "hbase-site.xml" and other associated files > are enclosed. > > Thanks. > > > > > > --- > > [hadoop@hadoop2 conf]$ jps > > 11805 SecondaryNameNode > > 32314 Jps > > 11614 DataNode > > 507 NodeManager > > 385 ResourceManager > > 11379 NameNode > > > > -- > > -- > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with > > replication factor 1): 0 > > > > - > > > > Live datanodes (1): > > > > Name: 127.0.0.1:9866 (localhost) > > Hostname: localhost > > Decommission Status : Normal > > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > > Xceivers: 1 > > Last contact: Tue Nov 15 13:17:01 CST 2016 > > . > > > > .. > > > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 11:50 AM > > To: user@hbase.apache.org > > Subject: Re: problem in launching HBase > > > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > > master.HMaster: Failed to become active master > > java.net.ConnectException: Call From hadoop2/127.0.0.1 to > > localhost:8020 failed on connection exception: > > java.net.ConnectException: Connection refused; For more details see: > > http://wiki.apache.org/hadoop/ConnectionRefused > > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native > Method) > > at > > sun.reflect.NativeConstructorAccessorImpl.newInstance( > > NativeConstructorAccessorImpl.java:57) > > ... > > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > > at > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > > DistributedFileSystem.java:986) > > at > > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > > DistributedFileSystem.java:970) > > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) > > at > > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) > > > > Was the namenode running fine on localhost ? > > > > Can you pastebin the contents of hbase-site.xml ? > > > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun < > congyun...@alcatel-sbell.com. > > cn > > > wrote: > > > > > Dear Ted, > > &
RE: problem in launching HBase
Hi, Ted, Do you feel what I make some incorrect configuration lead to my encountering issues? Thanks. -Original Message- From: QI Congyun Sent: Tuesday, November 15, 2016 1:29 PM To: user@hbase.apache.org Subject: RE: problem in launching HBase I'm so sorry that I make a mistake. The Hadoop configuration files are attached in the previous e-mail. The hbase-site.xml are attached, pls check it. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Tuesday, November 15, 2016 1:25 PM To: user@hbase.apache.org Subject: Re: problem in launching HBase I don't see hbase-site.xml attached. Consider using pastebin. On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun wrote: > > The name node and data node are running normally, such as the > following process. The file "hbase-site.xml" and other associated files are > enclosed. > Thanks. > > > --- > [hadoop@hadoop2 conf]$ jps > 11805 SecondaryNameNode > 32314 Jps > 11614 DataNode > 507 NodeManager > 385 ResourceManager > 11379 NameNode > > -- > -- > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with > replication factor 1): 0 > > - > > Live datanodes (1): > > Name: 127.0.0.1:9866 (localhost) > Hostname: localhost > Decommission Status : Normal > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > Xceivers: 1 > Last contact: Tue Nov 15 13:17:01 CST 2016 > . > > .. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 11:50 AM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > master.HMaster: Failed to become active master > java.net.ConnectException: Call From hadoop2/127.0.0.1 to > localhost:8020 failed on connection exception: > java.net.ConnectException: Connection refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:57) > ... > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:986) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:970) > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) > at > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) > > Was the namenode running fine on localhost ? > > Can you pastebin the contents of hbase-site.xml ? > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun cn > > wrote: > > > Dear Ted, > > > > I had learn the HBase quick-start cookbook although I have not yet > > read all of the document, I have known how to configure the HBase > > primary parameters and basic operation. > > > > I had ever tried to both make HBase control to use zookeeper and > > cancel HBase to start zookeeper server via set up the export > > HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever > > zookeeper is launched by HBase automatically or started manually, > > the same problems and logs are encountered as follows you submitted. > > I don't understand why zookeeper authentication SASL failed. > > > > Actually when do the command "start-hbase.sh", the master process > > was opened at the beginning, afterwards it's closed by itself, > > meanwhile the zookeeper quorum process is always running until kill it > > manually. > > I had do the command
RE: problem in launching HBase
I'm so sorry that I make a mistake. The Hadoop configuration files are attached in the previous e-mail. The hbase-site.xml are attached, pls check it. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Tuesday, November 15, 2016 1:25 PM To: user@hbase.apache.org Subject: Re: problem in launching HBase I don't see hbase-site.xml attached. Consider using pastebin. On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun wrote: > > The name node and data node are running normally, such as the > following process. The file "hbase-site.xml" and other associated files are > enclosed. > Thanks. > > > --- > [hadoop@hadoop2 conf]$ jps > 11805 SecondaryNameNode > 32314 Jps > 11614 DataNode > 507 NodeManager > 385 ResourceManager > 11379 NameNode > > -- > -- > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured > Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 > (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: > 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 > Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with > replication factor 1): 0 > > - > > Live datanodes (1): > > Name: 127.0.0.1:9866 (localhost) > Hostname: localhost > Decommission Status : Normal > Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 > (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: > 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% > Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache > Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% > Xceivers: 1 > Last contact: Tue Nov 15 13:17:01 CST 2016 > . > > .. > > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 11:50 AM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > master.HMaster: Failed to become active master > java.net.ConnectException: Call From hadoop2/127.0.0.1 to > localhost:8020 failed on connection exception: > java.net.ConnectException: Connection refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:57) > ... > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:986) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:970) > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) > at > org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) > > Was the namenode running fine on localhost ? > > Can you pastebin the contents of hbase-site.xml ? > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun cn > > wrote: > > > Dear Ted, > > > > I had learn the HBase quick-start cookbook although I have not yet > > read all of the document, I have known how to configure the HBase > > primary parameters and basic operation. > > > > I had ever tried to both make HBase control to use zookeeper and > > cancel HBase to start zookeeper server via set up the export > > HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever > > zookeeper is launched by HBase automatically or started manually, > > the same problems and logs are encountered as follows you submitted. > > I don't understand why zookeeper authentication SASL failed. > > > > Actually when do the command "start-hbase.sh", the master process > > was opened at the beginning, afterwards it's closed by itself, > > meanwhile the zookeeper quorum process is always running until kill it > > manually. > > I had do the command "JPS" to observe the process. > > > > Thanks. > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 11:01 AM > > To: user@hbase.apache.o
Re: problem in launching HBase
I don't see hbase-site.xml attached. Consider using pastebin. On Mon, Nov 14, 2016 at 9:19 PM, QI Congyun wrote: > > The name node and data node are running normally, such as the following > process. The file "hbase-site.xml" and other associated files are enclosed. > Thanks. > > > --- > [hadoop@hadoop2 conf]$ jps > 11805 SecondaryNameNode > 32314 Jps > 11614 DataNode > 507 NodeManager > 385 ResourceManager > 11379 NameNode > > > [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report > Configured Capacity: 154684043264 (144.06 GB) > Present Capacity: 133174730752 (124.03 GB) > DFS Remaining: 128144982016 (119.34 GB) > DFS Used: 5029748736 (4.68 GB) > DFS Used%: 3.78% > Under replicated blocks: 0 > Blocks with corrupt replicas: 0 > Missing blocks: 0 > Missing blocks (with replication factor 1): 0 > > - > > Live datanodes (1): > > Name: 127.0.0.1:9866 (localhost) > Hostname: localhost > Decommission Status : Normal > Configured Capacity: 154684043264 (144.06 GB) > DFS Used: 5029748736 (4.68 GB) > Non DFS Used: 21509312512 (20.03 GB) > DFS Remaining: 128144982016 (119.34 GB) > DFS Used%: 3.25% > DFS Remaining%: 82.84% > Configured Cache Capacity: 0 (0 B) > Cache Used: 0 (0 B) > Cache Remaining: 0 (0 B) > Cache Used%: 100.00% > Cache Remaining%: 0.00% > Xceivers: 1 > Last contact: Tue Nov 15 13:17:01 CST 2016 > . > > .. > > > > -----Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 11:50 AM > To: user@hbase.apache.org > Subject: Re: problem in launching HBase > > 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] > master.HMaster: Failed to become active master > java.net.ConnectException: Call From hadoop2/127.0.0.1 to localhost:8020 > failed on connection exception: java.net.ConnectException: Connection > refused; For more details see: > http://wiki.apache.org/hadoop/ConnectionRefused > at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) > at > sun.reflect.NativeConstructorAccessorImpl.newInstance( > NativeConstructorAccessorImpl.java:57) > ... > at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:986) > at > org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode( > DistributedFileSystem.java:970) > at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) > at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) > > Was the namenode running fine on localhost ? > > Can you pastebin the contents of hbase-site.xml ? > > On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun cn > > wrote: > > > Dear Ted, > > > > I had learn the HBase quick-start cookbook although I have not yet > > read all of the document, I have known how to configure the HBase > > primary parameters and basic operation. > > > > I had ever tried to both make HBase control to use zookeeper and > > cancel HBase to start zookeeper server via set up the export > > HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever > > zookeeper is launched by HBase automatically or started manually, the > > same problems and logs are encountered as follows you submitted. I > > don't understand why zookeeper authentication SASL failed. > > > > Actually when do the command "start-hbase.sh", the master process was > > opened at the beginning, afterwards it's closed by itself, meanwhile > > the zookeeper quorum process is always running until kill it manually. > > I had do the command "JPS" to observe the process. > > > > Thanks. > > > > > > -Original Message- > > From: Ted Yu [mailto:yuzhih...@gmail.com] > > Sent: Tuesday, November 15, 2016 11:01 AM > > To: user@hbase.apache.org > > Subject: problem in launching HBase > > > > 2016-11-10 11:25:14,177 INFO [main-SendThread(localhost:2181)] > > zookeeper.ClientCnxn: Opening socket connection to server localhost/ > > *127.0.0.1*:2181. Will not attempt to authenticate using SASL > > (unknown error) > > > > Was
RE: problem in launching HBase
The name node and data node are running normally, such as the following process. The file "hbase-site.xml" and other associated files are enclosed. Thanks. --- [hadoop@hadoop2 conf]$ jps 11805 SecondaryNameNode 32314 Jps 11614 DataNode 507 NodeManager 385 ResourceManager 11379 NameNode [hadoop@hadoop2 hadoop-2.7.3]$ bin/hdfs dfsadmin -report Configured Capacity: 154684043264 (144.06 GB) Present Capacity: 133174730752 (124.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used: 5029748736 (4.68 GB) DFS Used%: 3.78% Under replicated blocks: 0 Blocks with corrupt replicas: 0 Missing blocks: 0 Missing blocks (with replication factor 1): 0 - Live datanodes (1): Name: 127.0.0.1:9866 (localhost) Hostname: localhost Decommission Status : Normal Configured Capacity: 154684043264 (144.06 GB) DFS Used: 5029748736 (4.68 GB) Non DFS Used: 21509312512 (20.03 GB) DFS Remaining: 128144982016 (119.34 GB) DFS Used%: 3.25% DFS Remaining%: 82.84% Configured Cache Capacity: 0 (0 B) Cache Used: 0 (0 B) Cache Remaining: 0 (0 B) Cache Used%: 100.00% Cache Remaining%: 0.00% Xceivers: 1 Last contact: Tue Nov 15 13:17:01 CST 2016 . .. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Tuesday, November 15, 2016 11:50 AM To: user@hbase.apache.org Subject: Re: problem in launching HBase 2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] master.HMaster: Failed to become active master java.net.ConnectException: Call From hadoop2/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) ... at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970) at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) Was the namenode running fine on localhost ? Can you pastebin the contents of hbase-site.xml ? On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun wrote: > Dear Ted, > > I had learn the HBase quick-start cookbook although I have not yet > read all of the document, I have known how to configure the HBase > primary parameters and basic operation. > > I had ever tried to both make HBase control to use zookeeper and > cancel HBase to start zookeeper server via set up the export > HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever > zookeeper is launched by HBase automatically or started manually, the > same problems and logs are encountered as follows you submitted. I > don't understand why zookeeper authentication SASL failed. > > Actually when do the command "start-hbase.sh", the master process was > opened at the beginning, afterwards it's closed by itself, meanwhile > the zookeeper quorum process is always running until kill it manually. > I had do the command "JPS" to observe the process. > > Thanks. > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 11:01 AM > To: user@hbase.apache.org > Subject: problem in launching HBase > > 2016-11-10 11:25:14,177 INFO [main-SendThread(localhost:2181)] > zookeeper.ClientCnxn: Opening socket connection to server localhost/ > *127.0.0.1*:2181. Will not attempt to authenticate using SASL > (unknown error) > > Was the zookeeper quorum running on the localhost ? > > In the future, use pastebin for passing config / log files - > attachment would be stripped by mailing list. > > Have you read this ? > > http://hbase.apache.org/book.html#quickstart_fully_distributed > > On Mon, Nov 14, 2016 at 6:26 PM, QI Congyun cn > > wrote: > > > > > My previous e-mail is attached, pls check if the relative traces are > > enough to investigate or not? > > My node configuration are also enclosed. > > > > Thanks a lot. > > > > > > -- Forwarded message -- > > From: QI Congyun > > To: "user-i...@hbase.apa
Re: problem in launching HBase
2016-10-31 15:49:57,528 FATAL [localhost:16000.activeMasterManager] master.HMaster: Failed to become active master java.net.ConnectException: Call From hadoop2/127.0.0.1 to localhost:8020 failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57) ... at org.apache.hadoop.hdfs.DFSClient.setSafeMode(DFSClient.java:2264) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:986) at org.apache.hadoop.hdfs.DistributedFileSystem.setSafeMode(DistributedFileSystem.java:970) at org.apache.hadoop.hbase.util.FSUtils.isInSafeMode(FSUtils.java:525) at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:971) Was the namenode running fine on localhost ? Can you pastebin the contents of hbase-site.xml ? On Mon, Nov 14, 2016 at 7:40 PM, QI Congyun wrote: > Dear Ted, > > I had learn the HBase quick-start cookbook although I have not yet read > all of the document, I have known how to configure the HBase primary > parameters and basic operation. > > I had ever tried to both make HBase control to use zookeeper and cancel > HBase to start zookeeper server via set up the export > HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever zookeeper > is launched by HBase automatically or started manually, the same problems > and logs are encountered as follows you submitted. I don't understand why > zookeeper authentication SASL failed. > > Actually when do the command "start-hbase.sh", the master process was > opened at the beginning, afterwards it's closed by itself, meanwhile the > zookeeper quorum process is always running until kill it manually. I had do > the command "JPS" to observe the process. > > Thanks. > > > -Original Message- > From: Ted Yu [mailto:yuzhih...@gmail.com] > Sent: Tuesday, November 15, 2016 11:01 AM > To: user@hbase.apache.org > Subject: problem in launching HBase > > 2016-11-10 11:25:14,177 INFO [main-SendThread(localhost:2181)] > zookeeper.ClientCnxn: Opening socket connection to server localhost/ > *127.0.0.1*:2181. Will not attempt to authenticate using SASL > (unknown error) > > Was the zookeeper quorum running on the localhost ? > > In the future, use pastebin for passing config / log files - attachment > would be stripped by mailing list. > > Have you read this ? > > http://hbase.apache.org/book.html#quickstart_fully_distributed > > On Mon, Nov 14, 2016 at 6:26 PM, QI Congyun cn > > wrote: > > > > > My previous e-mail is attached, pls check if the relative traces are > > enough to investigate or not? > > My node configuration are also enclosed. > > > > Thanks a lot. > > > > > > -- Forwarded message -- > > From: QI Congyun > > To: "user-i...@hbase.apache.org" > > Cc: > > Date: Mon, 14 Nov 2016 08:20:11 + > > Subject: my questions about launching HBase > > > > Hi, Specialist, > > > > > > > > I try to set up a HBase database, but the HBase is always raised some > > errors. I had ever sent the e-mail to one of hbase mail-list, the > > e-mail is refused some times, then I try to submit my questions to the > > new mail-box, hope to receive your response. > > > > Thanks a lot. > > > > > > > > my hadoop version is Hadoop-2.7.3, > > > > my OS is: CEOS linux6.4. > > > > > > > > > > -- Forwarded message -- > > From: QI Congyun > > To: "hbase-...@lists.apache.org" > > Cc: > > Date: Fri, 11 Nov 2016 02:01:58 + > > Subject: FW: my questions are always not resolved about hbase > > > > > > > > The E-mail can’t be sent to the destination e-mail box, resent it again. > > > > > > > > Thanks. > > > > > > > > *From:* QI Congyun > > *Sent:* Thursday, November 10, 2016 11:53 AM > > *To:* 'hbase-...@lists.apache.org' > > *Subject:* my questions are always not resolved about hbase > > > > > > > > Hello sir, > > > > > > > > So sorry to bather you, I’m interested in the Hadoop system, and > > attempted to use Hadoop and Hbase, but the Hbase issue can’t be > > resolved, could you help me? Thanks in advance. > > > > > > > > 1. I’m very bewildered why the same issue is always encountered > > when launching hbase each time, the raised information is attached as > > follows: > > > > > > > > *[hadoop@hadoop2 hbase-1.2.3]$ * > > > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh * > > > > *localhost: starting zookeeper, logging to > > /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-zookeeper-hadoop2.ou > > t* > > > > *localhost: java.io.IOException: Unable to create data dir > > /home/testuser/zookeeper* > > > > *localhost: at > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.writeMyID(HQuorumPeer.ja > > va:157)* > > > > *localhost: at > > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(HQuorumPeer.java:70 > > )* > > > >
RE: problem in launching HBase
Dear Ted, I had learn the HBase quick-start cookbook although I have not yet read all of the document, I have known how to configure the HBase primary parameters and basic operation. I had ever tried to both make HBase control to use zookeeper and cancel HBase to start zookeeper server via set up the export HBASE_MANAGES_ZK=true/false in the file--hbase-env.sh. Whatever zookeeper is launched by HBase automatically or started manually, the same problems and logs are encountered as follows you submitted. I don't understand why zookeeper authentication SASL failed. Actually when do the command "start-hbase.sh", the master process was opened at the beginning, afterwards it's closed by itself, meanwhile the zookeeper quorum process is always running until kill it manually. I had do the command "JPS" to observe the process. Thanks. -Original Message- From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Tuesday, November 15, 2016 11:01 AM To: user@hbase.apache.org Subject: problem in launching HBase 2016-11-10 11:25:14,177 INFO [main-SendThread(localhost:2181)] zookeeper.ClientCnxn: Opening socket connection to server localhost/ *127.0.0.1*:2181. Will not attempt to authenticate using SASL (unknown error) Was the zookeeper quorum running on the localhost ? In the future, use pastebin for passing config / log files - attachment would be stripped by mailing list. Have you read this ? http://hbase.apache.org/book.html#quickstart_fully_distributed On Mon, Nov 14, 2016 at 6:26 PM, QI Congyun wrote: > > My previous e-mail is attached, pls check if the relative traces are > enough to investigate or not? > My node configuration are also enclosed. > > Thanks a lot. > > > -- Forwarded message -- > From: QI Congyun > To: "user-i...@hbase.apache.org" > Cc: > Date: Mon, 14 Nov 2016 08:20:11 + > Subject: my questions about launching HBase > > Hi, Specialist, > > > > I try to set up a HBase database, but the HBase is always raised some > errors. I had ever sent the e-mail to one of hbase mail-list, the > e-mail is refused some times, then I try to submit my questions to the > new mail-box, hope to receive your response. > > Thanks a lot. > > > > my hadoop version is Hadoop-2.7.3, > > my OS is: CEOS linux6.4. > > > > > -- Forwarded message -- > From: QI Congyun > To: "hbase-...@lists.apache.org" > Cc: > Date: Fri, 11 Nov 2016 02:01:58 + > Subject: FW: my questions are always not resolved about hbase > > > > The E-mail can’t be sent to the destination e-mail box, resent it again. > > > > Thanks. > > > > *From:* QI Congyun > *Sent:* Thursday, November 10, 2016 11:53 AM > *To:* 'hbase-...@lists.apache.org' > *Subject:* my questions are always not resolved about hbase > > > > Hello sir, > > > > So sorry to bather you, I’m interested in the Hadoop system, and > attempted to use Hadoop and Hbase, but the Hbase issue can’t be > resolved, could you help me? Thanks in advance. > > > > 1. I’m very bewildered why the same issue is always encountered > when launching hbase each time, the raised information is attached as > follows: > > > > *[hadoop@hadoop2 hbase-1.2.3]$ * > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/start-hbase.sh * > > *localhost: starting zookeeper, logging to > /home/hadoop/hbase-1.2.3/bin/../logs/hbase-hadoop-zookeeper-hadoop2.ou > t* > > *localhost: java.io.IOException: Unable to create data dir > /home/testuser/zookeeper* > > *localhost: at > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.writeMyID(HQuorumPeer.ja > va:157)* > > *localhost: at > org.apache.hadoop.hbase.zookeeper.HQuorumPeer.main(HQuorumPeer.java:70 > )* > > *starting master, logging to > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-master-hadoop2.out* > > *starting regionserver, logging to > /home/hadoop/hbase-1.2.3/logs/hbase-hadoop-1-regionserver-hadoop2.out* > > … > > *[hadoop@hadoop2 hbase-1.2.3]$ jps* > > *11805 SecondaryNameNode* > > *11614 DataNode* > > *507 NodeManager* > > *30687 HRegionServer* > > *385 ResourceManager* > > *11379 NameNode* > > *30899 Jps* > > *..* > > *[hadoop@hadoop2 hbase-1.2.3]$ bin/stop-hbase.sh * > > *stopping hbasecat: /tmp/hbase-hadoop-master.pid: No such file or > directory* > > > > *localhost: no zookeeper to stop because no pid file > /tmp/hbase-hadoop-zookeeper.pid* > > > > 2. When I check the logs, and a fatal errors are raised once again, > but I don’t know why. > > > > 2016-11-10 11:25:14,177 INFO [main-SendThread(localhost:2181)] > zookeeper.ClientCnxn: Opening socket connection to server localhost/ > 127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown > error) > > 2016-11-10 11:25:14,181 WARN [main-SendThread(localhost:2181)] > zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, > closing socket connection and attempting reconnect > > java.net.ConnectException: Connection refused > > at sun.nio.ch.SocketChannelImpl.checkConnect(Native > Method)
