ZooKeeper servers should only be deployed in numbers that can determine
majorities. 1, 3, 5, etc. If you have only two ZooKeeper servers, they
can not make a decision on elections.
Would recommend that you use only one ZK server if you only have two nodes.
Vincent Fontana wrote:
I started this project a few week ago.Thus I use only 2 computer at the
moment (probably more afterward when it works).
I have change the configuration to:
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://fontana-04:9000/opt/hbase</value>
</property>
<property>
<name>hbase.security.authentication</name>
<value>simple</value>
</property>
<property>
<name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>localhost:2181</value>
</property>
<property>
<name>hbase.client.keyvalue.maxsize</name>
<value>0</value>
</property>
<property>
<name>zookeeper.znode.parent</name>
<value>/hbase</value>
</property>
</configuration>
and i have remove fontana-03 to slave, regionserver and quorum for more
clarity.
Did i have make something wrong in other file or it was zookeeper?
the 2 error was:
WARN zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error,
closing socket connection and attempting reconnect
zookeeper.ClientCnxn: Opening socket connection to server localhost/
127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
2016-12-08 11:49 GMT+01:00 Ted Yu<yuzhih...@gmail.com>:
Please check the zookeeper server logs to see what might be happening.
bq. fontana-04,fontana-03
Why only two servers in the quorum ? Can you add one more zookeeper server
?
Cheers
On Thu, Dec 8, 2016 at 1:18 AM, Vincent Fontana<74f...@gmail.com> wrote:
now i have this...
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/opt/hadoop/lib/native
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:os.name
=Linux
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:os.arch=amd64
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:os.version=4.4.0-51-generic
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client environment:user.name
=hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/opt/hadoop
16/12/08 10:08:32 INFO zookeeper.ZooKeeper: Initiating client connection,
connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-0x65d637e7, quorum=localhost:2181, baseZNode=/hbase
16/12/08 10:08:32 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
16/12/08 10:08:32 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connexion refusée
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(
ClientCnxn.java:1081)
16/12/08 10:08:32 WARN zookeeper.RecoverableZooKeeper: Possibly
transient
ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
16/12/08 10:08:32 INFO util.RetryCounter: Sleeping 1000ms before retry
#0...
16/12/08 10:08:33 INFO zookeeper.ClientCnxn: Opening socket connection to
server localhost/127.0.0.1:2181. Will not attempt to authenticate using
SASL (unknown error)
16/12/08 10:08:33 WARN zookeeper.ClientCnxn: Session 0x0 for server null,
unexpected error, closing socket connection and attempting reconnect
java.net.ConnectException: Connexion refusée
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:744)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(
ClientCnxnSocketNIO.java:361)
at org.apache.zookeeper.ClientCnxn$SendThread.run(
ClientCnxn.java:1081)
16/12/08 10:08:33 WARN zookeeper.RecoverableZooKeeper: Possibly
transient
ZooKeeper, quorum=localhost:2181,
exception=org.apache.zookeeper.KeeperException$ConnectionLossException:
KeeperErrorCode = ConnectionLoss for /hbase/hbaseid
16/12/08 10:08:33 INFO util.RetryCounter: Sleeping 2000ms before retry
#1...
2016-12-08 10:02 GMT+01:00 Sandeep Nemuri<nhsande...@gmail.com>:
Looks like your project is unable to pick zookeeper and zk node details
which are in hbase-site.xml.
quorum=localhost:2181, baseZNode=/hbase
On Thu, Dec 8, 2016 at 2:19 PM,<74f...@gmail.com> wrote:
Hello,
I have and error i can't understand and resolve i think it was cause
by
this:
client.ZooKeeperRegistry: ClusterId read in ZooKeeper is null
My project was to use nutch crawler with hadoop and hbase.
I have start hbase ,yarn and dfs
I when i start a job like Injector Job for nutch, nothing hapend.
I have this writing on the console.
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=/opt/hadoop/lib/native
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/tmp
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
os.name
=Linux
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:os.arch=amd64
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:os.version=4.4.0-45-generic
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client environment:
user.name
=hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:user.home=/home/hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/opt/hadoop
16/12/02 13:05:14 INFO zookeeper.ZooKeeper: Initiating client
connection,
connectString=localhost:2181 sessionTimeout=90000
watcher=hconnection-
0x75cf7815,
quorum=localhost:2181, baseZNode=/hbase
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Opening socket
connection
to
server localhost/127.0.0.1:2181. Will not attempt to authenticate
using
SASL (unknown error)
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Socket connection
established
to localhost/127.0.0.1:2181, initiating session
16/12/02 13:05:14 INFO zookeeper.ClientCnxn: Session establishment
complete on server localhost/127.0.0.1:2181, sessionid =
0x58bf6bd3390001, negotiated timeout = 90000
16/12/02 13:05:14 INFO client.ZooKeeperRegistry: ClusterId read in
ZooKeeper is null
16/12/02 13:05:14 INFO Configuration.deprecation: hadoop.native.lib
is
deprecated. Instead, use io.native.lib.available
16/12/02 13:05:15 INFO zookeeper.RecoverableZooKeeper: Process
identifier=catalogtracker-on-hconnection-0x75cf7815 connecting to
ZooKeeper ensemble=localhost:2181
16/12/02 13:05:15 INFO zookeeper.ZooKeeper: Initiating client
connection,
connectString=localhost:2181 sessionTimeout=90000
watcher=catalogtracker-on-hconnection-0x75cf7815,
quorum=localhost:2181, baseZNode=/hbase
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Opening socket
connection
to
server localhost/127.0.0.1:2181. Will not attempt to authenticate
using
SASL (unknown error)
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Socket connection
established
to localhost/127.0.0.1:2181, initiating session
16/12/02 13:05:15 INFO zookeeper.ClientCnxn: Session establishment
complete on server localhost/127.0.0.1:2181, sessionid =
0x58bf6bd3390002, negotiated timeout = 90000
my hbase-site.xml configuration is:
<configuration>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://fontana-04:9000/opt/hbase</value>
</property>
<property>
<name>hbase.security.authentication</name>
<value>simple</value>
</property>
<property>
<name>hbase.ipc.client.fallback-to-simple-auth-allowed</name>
<value>true</value>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>fontana-04,fontana-03</value>
</property>
<property>
<name>hbase.client.keyvalue.maxsize</name>
<value>0</value>
</property>
<property>
<name>zookeeper.znode.parent</name>
<value>/hbase</value>
</property>
</configuration>
--
* Regards*
* Sandeep Nemuri*
